00010000:00010000:0.0:1746140864.431463:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb5919 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.431476:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb5919 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.431512:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb5919 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140864.431543:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960572963584:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 22723us (23014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.431549:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15096 00000100:00100000:0.0:1746140864.436668:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.440258:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572966144 00000100:00100000:0.0:1746140864.440267:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572966144 00010000:00010000:0.0:1746140864.440325:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ece1a00/0x8156357b7fdb587f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eca9 expref: 17 pid: 9872 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746140864.440358:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7785 00000100:00100000:0.0:1746140864.440364:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960572966144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.440375:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.440396:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ece1a00/0x8156357b7fdb587f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eca9 expref: 17 pid: 9872 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746140864.440406:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ece1a00/0x8156357b7fdb587f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eca9 expref: 17 pid: 9872 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746140864.440426:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ece1a00/0x8156357b7fdb587f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eca9 expref: 17 pid: 9872 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746140864.440439:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.440441:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.440445:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe61c00/0x8156357b7fdb5927 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.440452:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe61c00/0x8156357b7fdb5927 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.440475:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.440525:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960572966144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 160us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.440531:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7785 00000100:00100000:0.0:1746140864.442810:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572966272 00000100:00100000:0.0:1746140864.442817:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572966272 00010000:00010000:0.0:1746140864.442845:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a530f000/0x8156357b7fdb58a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ecb7 expref: 14 pid: 32377 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746140864.442868:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7786 00000100:00100000:0.0:1746140864.442874:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960572966272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.442884:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.442902:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a530f000/0x8156357b7fdb58a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ecb7 expref: 14 pid: 32377 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.442912:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a530f000/0x8156357b7fdb58a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ecb7 expref: 14 pid: 32377 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.442935:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a530f000/0x8156357b7fdb58a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ecb7 expref: 14 pid: 32377 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.442949:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.442951:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.442955:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800949e1600/0x8156357b7fdb590b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.442962:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949e1600/0x8156357b7fdb590b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.444140:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800949e1600/0x8156357b7fdb590b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.444166:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.449166:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.449931:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.459703:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.459820:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.459837:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.459851:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.459868:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572967424 00000100:00100000:0.0:1746140864.459874:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572967424 00010000:00010000:0.0:1746140864.459907:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfbc00/0x8156357b7fdb56e2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb7c expref: 14 pid: 20524 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746140864.459925:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572967296 00000100:00100000:0.0:1746140864.459928:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572967296 00010000:00010000:0.0:1746140864.459938:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb56f0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb8a expref: 275 pid: 20524 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746140864.459947:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572967168 00000100:00100000:0.0:1746140864.459948:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572967168 00010000:00010000:0.0:1746140864.459955:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee800/0x8156357b7fdb5832 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ec63 expref: 15 pid: 14742 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746140864.459965:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7787 00000100:00100000:0.0:1746140864.459970:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960572967424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.459979:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.459985:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfbc00/0x8156357b7fdb56e2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb7c expref: 15 pid: 20524 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.459993:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfbc00/0x8156357b7fdb56e2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb7c expref: 15 pid: 20524 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460011:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfbc00/0x8156357b7fdb56e2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb7c expref: 15 pid: 20524 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460022:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.460027:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3ba200/0x8156357b7fdb5935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140864.460034:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.460051:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960572967424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.460056:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7787 00000100:00100000:0.0:1746140864.460068:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7788 00000100:00100000:0.0:1746140864.460072:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:1982:x1830960572967296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.460078:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.460081:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb56f0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb8a expref: 275 pid: 20524 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460088:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb56f0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb8a expref: 275 pid: 20524 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460098:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb56f0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb8a expref: 275 pid: 20524 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460105:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.460107:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3ba200/0x8156357b7fdb5935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140864.460111:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.460121:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:1982:x1830960572967296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.460125:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7788 00000100:00100000:0.0:1746140864.460132:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7789 00000100:00100000:0.0:1746140864.460135:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960572967168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.460141:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.460144:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee800/0x8156357b7fdb5832 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ec63 expref: 13 pid: 14742 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460150:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee800/0x8156357b7fdb5832 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ec63 expref: 13 pid: 14742 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460158:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee800/0x8156357b7fdb5832 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ec63 expref: 13 pid: 14742 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460164:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.460166:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3ba200/0x8156357b7fdb5935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140864.460170:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.460178:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960572967168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.460182:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7789 00000100:00100000:0.0:1746140864.460208:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.460217:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572967552 00000100:00100000:0.0:1746140864.460219:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572967552 00010000:00010000:0.0:1746140864.460227:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e7a800/0x8156357b7fdb56db lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb75 expref: 12 pid: 14741 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746140864.460235:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7790 00000100:00100000:0.0:1746140864.460238:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960572967552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.460243:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.460246:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e7a800/0x8156357b7fdb56db lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb75 expref: 12 pid: 14741 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460252:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e7a800/0x8156357b7fdb56db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eb75 expref: 12 pid: 14741 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746140864.460259:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.460263:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3ba200/0x8156357b7fdb5935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140864.460267:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.460277:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960572967552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 37us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.460281:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7790 00000100:00100000:0.0:1746140864.465198:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.469836:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572967808 00000100:00100000:0.0:1746140864.469845:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572967808 00000100:00100000:0.0:1746140864.469887:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15100 00000100:00100000:0.0:1746140864.469894:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+13:31756:x1830960572967808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140864.469908:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.469924:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdb593c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829ed04 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140864.469945:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4747392, mtime: 0x6813fec1, atime: 0x6813fec1, ctime: 0x6813fec1, blocks: 0x1481 00010000:00010000:0.0:1746140864.469964:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.469966:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.469973:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdb593c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed04 expref: 14 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.469988:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdb593c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed04 expref: 14 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.469997:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41b4000, rc 0) 00000100:00100000:0.0:1746140864.470037:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+14:31756:x1830960572967808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 143us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.470045:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15100 00000100:00100000:0.0:1746140864.484007:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.495611:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572968448 00000100:00100000:0.0:1746140864.495620:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572968448 00000100:00100000:0.0:1746140864.495661:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10308 00000100:00100000:0.0:1746140864.495669:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:31766:x1830960572968448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140864.495690:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.495707:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4400/0x8156357b7fdb595f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829ed19 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.495911:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.495924:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.495932:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.495942:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.495947:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.495952:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507339:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507352:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507362:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140864.507372:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140864.507506:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507513:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507518:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507524:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc9e600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140864.507527:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507532:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507543:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.507545:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140864.507548:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507553:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc9e600/0x8156357b7fdb5974 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507570:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507574:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507582:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507586:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a41b4c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140864.507588:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507593:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507603:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140864.507604:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140864.507607:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507611:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4c00/0x8156357b7fdb5966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507619:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507624:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507629:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507633:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a41b4a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140864.507635:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507639:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507647:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293700) 00010000:00010000:0.0:1746140864.507649:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140864.507651:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507655:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4a00/0x8156357b7fdb596d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.507685:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4400/0x8156357b7fdb595f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed19 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.507691:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41b4400/0x8156357b7fdb595f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed19 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.507697:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41b4400, rc 0) 00000100:00100000:0.0:1746140864.507723:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:31766:x1830960572968448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 12056us (12292us total) trans 8589944489 rc 301/301 00000100:00100000:0.0:1746140864.507728:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10308 00000100:00100000:0.0:1746140864.508187:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575756032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.508225:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140864.508243:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575756544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.508257:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140864.508267:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575757056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.508281:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140864.508291:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575757568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.508321:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140864.508338:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746140864.508342:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575756416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.508357:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140864.508366:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575756928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.508377:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140864.508387:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575757440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.508400:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140864.508410:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575757952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.508421:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140864.508440:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575756544 00000100:00100000:0.0:1746140864.508443:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575756544 00000100:00100000:0.0:1746140864.508472:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575757568 00000100:00100000:0.0:1746140864.508474:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575757568 00000100:00100000:0.0:1746140864.508501:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575756928 00000100:00100000:0.0:1746140864.508503:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575756928 00000100:00100000:0.0:1746140864.508511:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575757952 00000100:00100000:0.0:1746140864.508512:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575757952 00000100:00100000:0.0:1746140864.508527:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15102 00000100:00100000:0.0:1746140864.508532:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3311:x1830960575756544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.509045:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575756160 00000100:00100000:0.0:1746140864.509048:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575756160 00000100:00100000:0.0:1746140864.509060:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575756672 00000100:00100000:0.0:1746140864.509062:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575756672 00000100:00100000:0.0:1746140864.509069:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15103 00000100:00100000:0.0:1746140864.509072:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3311:x1830960575757056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.509201:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3311:x1830960575757056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 127us (918us total) trans 21474840973 rc 0/0 00000100:00100000:0.0:1746140864.509206:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15103 00000100:00100000:0.0:1746140864.509217:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575757824 00000100:00100000:0.0:1746140864.509219:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575757824 00000100:00100000:0.0:1746140864.509229:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15105 00000100:00100000:0.0:1746140864.509232:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3311:x1830960575756416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.509288:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15106 00000100:00100000:0.0:1746140864.509294:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3311:x1830960575756928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.509396:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960575756928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1017us total) trans 17179873716 rc 0/0 00000100:00100000:0.0:1746140864.509402:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15106 00000100:00100000:0.0:1746140864.509412:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15108 00000100:00100000:0.0:1746140864.509417:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3311:x1830960575757952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.509491:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3311:x1830960575757952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (1058us total) trans 21474840976 rc 0/0 00000100:00100000:0.0:1746140864.509496:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15108 00000100:00100000:0.0:1746140864.509505:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15111 00000100:00100000:0.0:1746140864.509509:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3312:x1830960575757184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.509575:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3312:x1830960575757184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (500us total) trans 21474840977 rc 0/0 00000100:00100000:0.0:1746140864.509580:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15111 00000100:00100000:0.0:1746140864.509589:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15113 00000100:00100000:0.0:1746140864.509593:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009334ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3312:x1830960575756288:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140864.509686:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8df80/2, rc 0, transno 17179873716 00000100:00100000:0.0:1746140864.509691:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575756928:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140864.509698:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8d500/2, rc 0, transno 21474840975 00000100:00100000:0.0:1746140864.509706:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575757440:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140864.509711:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8f800/2, rc 0, transno 21474840976 00000100:00100000:0.0:1746140864.509714:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575757952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140864.509719:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8ca80/2, rc 0, transno 21474840973 00000100:00100000:0.0:1746140864.509721:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575757056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140864.509726:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8e680/2, rc 0, transno 21474840974 00000100:00100000:0.0:1746140864.509728:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575757568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.509758:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575758080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.509773:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140864.510000:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc34380/2, rc 0, transno 21474840981 00000100:00100000:0.0:1746140864.510004:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575758080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.510630:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.511573:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.511600:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572968576 00000100:00100000:0.0:1746140864.511606:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572968576 00000100:00100000:0.0:1746140864.511637:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572968704 00000100:00100000:0.0:1746140864.511639:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572968704 00000100:00100000:0.0:1746140864.511659:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10309 00000100:00100000:0.0:1746140864.511664:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:31758:x1830960572968576:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140864.511682:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.511697:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a530f000/0x8156357b7fdb5989 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829ed20 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.511752:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a530f000/0x8156357b7fdb5989 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed20 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.511768:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a530f000/0x8156357b7fdb5989 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed20 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.511785:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.511788:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140864.511790:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a530f000, rc 0) 00000100:00100000:0.0:1746140864.512315:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:31758:x1830960572968576:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 638us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.512322:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10309 00000100:00100000:0.0:1746140864.512506:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960575756416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3272us (4148us total) trans 17179873720 rc 0/0 00000100:00100000:0.0:1746140864.512512:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15105 00000004:00080000:0.0:1746140864.512550:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b67480/2, rc 0, transno 17179873720 00000100:00100000:0.0:1746140864.512555:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575756416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140864.512565:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edcad80/2, rc 0, transno 17179873719 00000100:00100000:0.0:1746140864.512568:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575756032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.512613:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746140864.513207:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140864.513210:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140864.513213:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140864.513214:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140864.513216:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140864.513240:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009334ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3312:x1830960575756288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3646us (4123us total) trans 17179873722 rc 0/0 00000100:00100000:0.0:1746140864.513249:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15113 00000100:00100000:0.0:1746140864.513336:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960575756544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4804us (5077us total) trans 17179873723 rc 0/0 00000100:00100000:0.0:1746140864.513342:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15102 00000004:00080000:0.0:1746140864.513460:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b65180/2, rc 0, transno 17179873723 00000100:00100000:0.0:1746140864.513464:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575756544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.514095:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572969216 00000100:00100000:0.0:1746140864.514099:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572969216 00000100:00100000:0.0:1746140864.514121:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4430 00000100:00100000:0.0:1746140864.514126:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:31756:x1830960572969216:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746140864.514173:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:31756:x1830960572969216:12345-192.168.204.16@tcp:49:cat.0 Request processed in 47us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.514178:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4430 00000100:00100000:0.0:1746140864.516937:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.516978:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.517005:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.517018:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.517046:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.517058:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.517268:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.519787:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.522173:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.522219:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.534654:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.534698:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.534724:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.534750:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.534785:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.540119:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.553883:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.575502:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.598513:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575760640 00000100:00100000:0.0:1746140864.598520:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575760640 00000100:00100000:0.0:1746140864.598556:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15140 00000100:00100000:0.0:1746140864.598561:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3312:x1830960575760640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.598679:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3312:x1830960575760640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (251us total) trans 21474840990 rc 0/0 00000100:00100000:0.0:1746140864.598685:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15140 00000100:00100000:0.0:1746140864.605178:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140864.605746:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a17e00/0x8156357b7fdb5a07 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140864.605754:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a17e00/0x8156357b7fdb5a07 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00000040:00080000:0.0:1746140864.606365:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3139, 88 off264872 00000004:00080000:0.0:1746140864.606371:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682065555ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606426:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3200, 88 off270424 00000004:00080000:0.0:1746140864.606429:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843682123943ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140864.606437:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3201, 88 off270512 00000004:00080000:0.0:1746140864.606440:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843682134947ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140864.606445:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3140, 88 off264960 00000004:00080000:0.0:1746140864.606447:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682142757ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606453:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3141, 88 off265048 00000004:00080000:0.0:1746140864.606455:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682150003ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606460:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3202, 88 off270600 00000004:00080000:0.0:1746140864.606462:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843682157718ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140864.606467:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3203, 88 off270688 00000004:00080000:0.0:1746140864.606470:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843682164875ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140864.606474:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3204, 88 off270776 00000004:00080000:0.0:1746140864.606476:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843682171319ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140864.606491:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3142, 88 off265136 00000004:00080000:0.0:1746140864.606494:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682188833ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606499:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3205, 88 off270864 00000004:00080000:0.0:1746140864.606500:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843682195679ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140864.606506:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3143, 88 off265224 00000004:00080000:0.0:1746140864.606508:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682202933ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606513:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3206, 88 off270952 00000004:00080000:0.0:1746140864.606515:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843682210225ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140864.606520:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3144, 88 off265312 00000004:00080000:0.0:1746140864.606522:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682217432ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606527:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3145, 88 off265400 00000004:00080000:0.0:1746140864.606529:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682224287ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606534:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3146, 88 off265488 00000004:00080000:0.0:1746140864.606536:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682230863ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606540:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3147, 88 off265576 00000004:00080000:0.0:1746140864.606542:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843682237455ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140864.606547:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3207, 88 off271040 00000004:00080000:0.0:1746140864.606549:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843682243942ns, next at 809142599738ns, rc = 0 00000100:00100000:0.0:1746140864.656236:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575761024 00000100:00100000:0.0:1746140864.656244:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575761024 00000100:00100000:0.0:1746140864.656280:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575761536 00000100:00100000:0.0:1746140864.656283:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575761536 00000100:00100000:0.0:1746140864.656299:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15141 00000100:00100000:0.0:1746140864.656327:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3311:x1830960575761024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140864.656504:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140864.656508:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140864.656510:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140863 -> 1746140863 00002000:00010000:0.0:1746140864.656512:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140864.656514:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746140864.656549:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3311:x1830960575761024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (334us total) trans 17179873732 rc 0/0 00000100:00100000:0.0:1746140864.656555:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15141 00000100:00100000:0.0:1746140864.656569:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15143 00000100:00100000:0.0:1746140864.656574:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3311:x1830960575762048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.656656:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3311:x1830960575762048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (355us total) trans 21474840992 rc 0/0 00000100:00100000:0.0:1746140864.656660:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15143 00000100:00100000:0.0:1746140864.656670:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15144 00000100:00100000:0.0:1746140864.656673:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f21dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3311:x1830960575762560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.656911:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f21dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3311:x1830960575762560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 237us (557us total) trans 21474840993 rc 0/0 00000100:00100000:0.0:1746140864.659224:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15144 00000100:00100000:0.0:1746140864.659858:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15152 00000100:00100000:0.0:1746140864.659865:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960575761152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140864.659947:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140864.659950:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140864.659953:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140864.659954:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140864.659956:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140864.660035:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3313:x1830960575761152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (3136us total) trans 17179873735 rc 0/0 00000100:00100000:0.0:1746140864.660041:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15152 00000100:00100000:0.0:1746140864.660054:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15155 00000100:00100000:0.0:1746140864.660059:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960575762688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140864.660107:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15156 00000100:00100000:0.0:1746140864.660114:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3313:x1830960575760768:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140864.660189:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8f100/2, rc 0, transno 21474840994 00000100:00100000:0.0:1746140864.660200:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575760896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140864.660211:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135698700/2, rc 0, transno 17179873733 00000100:00100000:0.0:1746140864.660215:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575761408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140864.660222:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135699180/2, rc 0, transno 17179873734 00000100:00100000:0.0:1746140864.660225:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575761920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140864.660233:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355bc380/2, rc 0, transno 21474840995 00000100:00100000:0.0:1746140864.660237:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575762432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140864.660247:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc35180/2, rc 0, transno 17179873732 00000100:00100000:0.0:1746140864.660250:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575761024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140864.660259:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355bce00/2, rc 0, transno 21474840991 00000100:00100000:0.0:1746140864.660262:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575761536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140864.660271:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355bea00/2, rc 0, transno 21474840992 00000100:00100000:0.0:1746140864.660275:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575762048:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140864.660283:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355bd880/2, rc 0, transno 21474840993 00000100:00100000:0.0:1746140864.660285:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575762560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140864.664975:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.665350:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.666769:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.666804:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.674508:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.675041:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.675072:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.675092:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.675236:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.675327:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15160 00000100:00100000:0.0:1746140864.675333:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960572974208:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140864.675339:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.675346:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009243f800/0x8156357b7fdb5a4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829ed9e expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.675363:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.675365:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.675371:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009243f800/0x8156357b7fdb5a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed9e expref: 11 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.675382:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009243f800/0x8156357b7fdb5a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed9e expref: 11 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.675389:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009243f800, rc 0) 00000100:00100000:0.0:1746140864.675432:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960572974208:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 101us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.675436:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15160 00000100:00100000:0.0:1746140864.675449:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15161 00000100:00100000:0.0:1746140864.675454:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960572974336:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140864.675459:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.675465:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009243e800/0x8156357b7fdb5a5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829eda5 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.675488:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.675490:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.675494:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009243e800/0x8156357b7fdb5a5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eda5 expref: 11 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.675503:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009243e800/0x8156357b7fdb5a5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eda5 expref: 11 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.675509:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009243e800, rc 0) 00000100:00100000:0.0:1746140864.675681:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960572974336:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 225us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.675687:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15161 00000100:00100000:0.0:1746140864.679012:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.679060:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.679757:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.679782:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.679836:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.679869:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572974464 00000100:00100000:0.0:1746140864.679879:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572974464 00000100:00100000:0.0:1746140864.679916:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572974592 00000100:00100000:0.0:1746140864.679918:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572974592 00000100:00100000:0.0:1746140864.679932:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572974720 00000100:00100000:0.0:1746140864.679933:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572974720 00000100:00100000:0.0:1746140864.680142:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15162 00000100:00100000:0.0:1746140864.680150:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960572974464:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140864.680170:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.680187:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829edac expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.680210:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.680212:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.680219:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 11 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.680233:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 11 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.680242:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481200, rc 0) 00000100:00100000:0.0:1746140864.680284:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960572974464:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 135us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.680290:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15162 00000100:00100000:0.0:1746140864.680325:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15164 00000100:00100000:0.0:1746140864.680331:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:31767:x1830960572974720:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140864.680337:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.680343:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb5a70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829edba expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.680474:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdb593c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed04 expref: 13 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.680493:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 10 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.680499:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb8c00/0x8156357b7fdb59e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed51 expref: 28 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.680504:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.680505:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.680508:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb5a70 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2707456->2891775] (req 2707456->2891775) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edba expref: 28 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.680532:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb8c00/0x8156357b7fdb59e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed51 expref: 28 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.680540:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb8c00/0x8156357b7fdb59e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed51 expref: 28 pid: 32376 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746140864.680550:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575763456:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140864.680591:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 10 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.680598:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 10 pid: 4785 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746140864.680606:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575763584:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140864.680624:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdb593c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed04 expref: 13 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.680631:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdb593c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed04 expref: 13 pid: 32376 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746140864.680638:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575763712:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140864.680652:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140864.680690:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.681707:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.688692:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.688792:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575763456:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140864.688806:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575763584:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140864.688817:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575763712:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140864.688859:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb5a70 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2707456->2891775] (req 2707456->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edba expref: 29 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.688875:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009243fa00, rc 0) 00000100:00100000:0.0:1746140864.688904:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:31767:x1830960572974720:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8572us (9154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.688913:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15164 00000100:00100000:0.0:1746140864.689294:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572976128 00000100:00100000:0.0:1746140864.689300:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572976128 00010000:00010000:0.0:1746140864.689343:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 11 pid: 4785 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746140864.689364:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7798 00000100:00100000:0.0:1746140864.689369:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960572976128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.689379:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.689395:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 11 pid: 4785 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746140864.689404:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 11 pid: 4785 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746140864.689422:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481200/0x8156357b7fdb5a62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edac expref: 11 pid: 4785 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746140864.689438:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.689440:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.689447:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb5a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->2891775) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edba expref: 26 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.689454:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb5a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->2891775) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edba expref: 26 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.689495:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb5a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edba expref: 26 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140864.689511:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575763840:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140864.689558:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140864.696440:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.696555:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.702043:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.702077:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.705788:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.705843:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.709085:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572977792 00000100:00100000:0.0:1746140864.709176:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572977792 00000100:00100000:0.0:1746140864.709219:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572977920 00000100:00100000:0.0:1746140864.709222:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572977920 00000100:00100000:0.0:1746140864.709247:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15166 00000100:00100000:0.0:1746140864.709253:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960572977792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140864.709268:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.709284:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ecd8600/0x8156357b7fdb5aa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829edd6 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.709320:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.709322:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.709330:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ecd8600/0x8156357b7fdb5aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edd6 expref: 14 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.709344:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ecd8600/0x8156357b7fdb5aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edd6 expref: 14 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.709359:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ecd8600, rc 0) 00000100:00100000:0.0:1746140864.709401:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960572977792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 148us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.709406:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15166 00000100:00100000:0.0:1746140864.709420:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15167 00000100:00100000:0.0:1746140864.709424:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960572977920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140864.709431:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.709440:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ecd9a00/0x8156357b7fdb5aa8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829eddd expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.709449:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.709456:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ecd9a00/0x8156357b7fdb5aa8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eddd expref: 18 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.709464:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ecd9a00/0x8156357b7fdb5aa8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eddd expref: 18 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.709474:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ecd9a00, rc 0) 00000100:00100000:0.0:1746140864.709551:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960572977920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 127us (1674us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140864.709557:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15167 00000100:00100000:0.0:1746140864.711665:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572978560 00000100:00100000:0.0:1746140864.711668:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572978560 00000100:00100000:0.0:1746140864.711699:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15170 00000100:00100000:0.0:1746140864.711704:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f21c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960572978560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140864.711715:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.711728:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ecd9600/0x8156357b7fdb5abd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829edf2 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140864.711767:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575764096:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140864.711814:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140864.716943:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.721123:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575764096:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140864.721154:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ecd9600/0x8156357b7fdb5abd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edf2 expref: 16 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.721168:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ecd9600/0x8156357b7fdb5abd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edf2 expref: 16 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.721179:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ecd9600, rc 0) 00000100:00100000:0.0:1746140864.721219:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f21c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960572978560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9513us (10400us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140864.721226:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15170 00000100:00100000:0.0:1746140864.727726:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fce7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960575764224:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140864.727749:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.728668:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1983:x1830960572978944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9836us (11736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.728678:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7800 00000100:00100000:0.0:1746140864.730759:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960572978304:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 20751us (20930us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140864.730770:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7698 00002000:00100000:0.0:1746140864.730776:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009fce7800 x1830960572978304/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:280/0 lens 488/440 e 0 to 0 dl 1746140875 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140864.730784:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce7800 with x1830960572978304 ext(1048576->2097151) 00002000:00010000:0.0:1746140864.730788:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce7800 00000100:00100000:0.0:1746140864.734342:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.735102:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.735530:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7700 00000100:00100000:0.0:1746140864.735537:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960572979584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140864.735665:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960572979584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 128us (1365us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140864.735670:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7700 00002000:00100000:0.0:1746140864.735675:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a7:0x0] (1409024->1413119) req@ffff880093130700 x1830960572979584/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:280/0 lens 488/4536 e 0 to 0 dl 1746140875 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140864.735682:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130700 with x1830960572979584 ext(1409024->1413119) 00002000:00010000:0.0:1746140864.735685:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130700 00000100:00100000:0.0:1746140864.739531:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.741558:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.742109:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.749505:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.764074:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.770401:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7705 00000100:00100000:0.0:1746140864.770410:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960572981504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140864.771879:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.805452:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.813251:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.850061:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.863389:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.869483:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.929748:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.939060:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.939109:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.939187:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.939231:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572983424 00000100:00100000:0.0:1746140864.939239:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572983424 00000100:00100000:0.0:1746140864.939278:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572983552 00000100:00100000:0.0:1746140864.939280:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572983552 00000100:00100000:0.0:1746140864.939345:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15176 00000100:00100000:0.0:1746140864.939353:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960572983424:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140864.939371:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.939387:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef400/0x8156357b7fdb5b26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829ee31 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140864.939438:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575765120:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140864.939551:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140864.939621:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15177 00000100:00100000:0.0:1746140864.939628:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960572983552:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140864.939636:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140864.939645:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a44df200/0x8156357b7fdb5b2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829ee38 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.939658:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.939660:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140864.939668:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a44df200/0x8156357b7fdb5b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee38 expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.939684:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a44df200/0x8156357b7fdb5b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee38 expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140864.939694:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a44df200, rc 0) 00000100:00100000:0.0:1746140864.939717:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960572983552:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 91us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.939723:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15177 00000100:00100000:0.0:1746140864.965380:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.971463:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572984064 00000100:00100000:0.0:1746140864.971482:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572984064 00010000:00010000:0.0:1746140864.971525:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8be600/0x8156357b7fdb5b1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee23 expref: 12 pid: 20524 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746140864.971565:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572983936 00000100:00100000:0.0:1746140864.971569:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572983936 00010000:00010000:0.0:1746140864.971586:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b1800/0x8156357b7fdb5b49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee2a expref: 272 pid: 20524 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746140864.971604:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572984192 00000100:00100000:0.0:1746140864.971608:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572984192 00010000:00010000:0.0:1746140864.971620:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5afc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee1c expref: 11 pid: 20524 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746140864.971648:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7802 00000100:00100000:0.0:1746140864.971656:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f21f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960572984064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.971671:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.971678:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8be600/0x8156357b7fdb5b1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee23 expref: 12 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971688:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8be600/0x8156357b7fdb5b1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee23 expref: 12 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971712:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8be600/0x8156357b7fdb5b1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee23 expref: 12 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971733:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.971738:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdb5b5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.971745:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdb5b5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.971750:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.971805:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f21f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960572984064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 149us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.971813:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7802 00000100:00100000:0.0:1746140864.971833:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7803 00000100:00100000:0.0:1746140864.971840:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f21df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1982:x1830960572983936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.971848:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.971854:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b1800/0x8156357b7fdb5b49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee2a expref: 272 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971862:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b1800/0x8156357b7fdb5b49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee2a expref: 272 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971874:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b1800/0x8156357b7fdb5b49 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee2a expref: 272 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971884:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.971887:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdb5b5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.971893:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdb5b5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.971897:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.971920:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f21df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:1982:x1830960572983936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.971926:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7803 00000100:00100000:0.0:1746140864.971939:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7804 00000100:00100000:0.0:1746140864.971946:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f21f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1982:x1830960572984192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140864.971954:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140864.971958:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5afc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee1c expref: 11 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971968:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5afc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee1c expref: 11 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971983:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5afc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee1c expref: 11 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140864.971993:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.971996:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdb5b5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.972002:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdb5b5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.972008:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdb5b5e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.972030:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140864.972051:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f21f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1982:x1830960572984192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.972057:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7804 00000100:00100000:0.0:1746140864.975878:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.980577:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140864.981076:0:20524:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5b73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.981082:0:20524:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5b73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00000004:00200000:0.0:1746140864.981125:0:20524:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00000004:00200000:0.0:1746140864.981129:0:20524:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140864.981145:0:20524:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5b73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140864.981173:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdb5b6c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee46 expref: 12 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.981203:0:20524:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5b73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee46 expref: 11 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140864.981209:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140864.981211:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140864.981213:0:20524:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ac9b0400, rc 0) 00000100:00100000:0.0:1746140864.981247:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:31779:x1830960572984320:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4389us (5379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140864.981254:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10325 00000100:00100000:0.0:1746140864.983175:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.989442:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140864.991788:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.002459:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.014576:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.014617:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.014646:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.014683:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.017573:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7709 00000100:00100000:0.0:1746140865.017583:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960572986240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140865.031235:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.038672:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.039514:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960572986240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21931us (24864us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140865.039521:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7709 00002000:00100000:0.0:1746140865.039527:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801359b0e00 x1830960572986240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/440 e 0 to 0 dl 1746140876 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.039535:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0e00 with x1830960572986240 ext(1048576->2097151) 00002000:00010000:0.0:1746140865.039843:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b0e00 00000100:00100000:0.0:1746140865.039868:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1554 00000100:00100000:0.0:1746140865.039876:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960572986624:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140865.042936:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960572986112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24576us (28243us total) trans 0 rc 798720/798720 00000100:00100000:0.0:1746140865.042946:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7710 00002000:00100000:0.0:1746140865.042956:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff8801359b2a00 x1830960572986112/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 504/440 e 0 to 0 dl 1746140876 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.042965:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b2a00 with x1830960572986112 ext(1048576->2097151) 00010000:00010000:0.0:1746140865.042974:0:21691:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb5a77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edc1 expref: 20 pid: 12255 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140865.042989:0:21691:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb5a77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edc1 expref: 20 pid: 12255 timeout: 944 lvb_type: 0 00002000:00010000:0.0:1746140865.042995:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801359b2a00 00000100:00100000:0.0:1746140865.046663:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.046692:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.052934:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.053512:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.058111:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.058146:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.058421:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7711 00000100:00100000:0.0:1746140865.058429:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960572987904:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140865.058551:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960572987904:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 123us (404us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140865.058556:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7711 00002000:00100000:0.0:1746140865.058561:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a0:0x0] (290816->294911) req@ffff88009f2c0a80 x1830960572987904/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/4536 e 0 to 0 dl 1746140876 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.058568:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0a80 with x1830960572987904 ext(290816->294911) 00002000:00010000:0.0:1746140865.058571:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c0a80 00000100:00100000:0.0:1746140865.067625:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.075352:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.076479:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.082849:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.094795:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.096877:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.100859:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.100916:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.106730:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.115847:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.126106:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960572989696:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 18262us (19372us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140865.126120:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1558 00002000:00100000:0.0:1746140865.126131:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f2c0380 x1830960572989696/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/440 e 0 to 0 dl 1746140876 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.126141:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0380 with x1830960572989696 ext(1048576->2097151) 00010000:00010000:0.0:1746140865.126151:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a49dbc00/0x8156357b7fdb5bb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee69 expref: 21 pid: 4785 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140865.126164:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a49dbc00/0x8156357b7fdb5bb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee69 expref: 21 pid: 4785 timeout: 944 lvb_type: 0 00002000:00010000:0.0:1746140865.126170:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c0380 00000100:00100000:0.0:1746140865.126767:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572989952 00000100:00100000:0.0:1746140865.126776:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572989952 00002000:00100000:0.0:1746140865.126813:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (290816->1048575) req@ffff88009fce7100 x1830960572989952/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/0 e 0 to 0 dl 1746140876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.126820:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce7100 with x1830960572989952 ext(290816->1048575) 00010000:00010000:0.0:1746140865.126826:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdb5bc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 290816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee70 expref: 16 pid: 32376 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140865.126837:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdb5bc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 290816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee70 expref: 16 pid: 32376 timeout: 944 lvb_type: 0 00002000:00010000:0.0:1746140865.126843:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce7100 00000100:00100000:0.0:1746140865.126875:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1559 00000100:00100000:0.0:1746140865.126882:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960572989952:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140865.152882:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.154247:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572991104 00000100:00100000:0.0:1746140865.154252:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572991104 00002000:00100000:0.0:1746140865.154280:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009fce4a80 x1830960572991104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/0 e 0 to 0 dl 1746140876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.154290:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4a80 with x1830960572991104 ext(2097152->3145727) 00002000:00010000:0.0:1746140865.154295:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce4a80 00000100:00100000:0.0:1746140865.154329:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572991360 00000100:00100000:0.0:1746140865.154332:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572991360 00002000:00100000:0.0:1746140865.154344:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009fce4000 x1830960572991360/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/0 e 0 to 0 dl 1746140876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.154351:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4000 with x1830960572991360 ext(3145728->4194303) 00002000:00010000:0.0:1746140865.154353:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce4000 00000100:00100000:0.0:1746140865.154365:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7714 00000100:00100000:0.0:1746140865.154464:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960572991104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140865.169417:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.186685:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.189654:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.189986:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.194173:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.194429:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.199207:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.199258:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.230388:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.317453:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.325488:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.328565:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7816 00000100:00100000:0.0:1746140865.328574:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f21dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960572993920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140865.328581:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140865.328585:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5b73 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee46 expref: 12 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140865.328597:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9b0400/0x8156357b7fdb5b73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ee46 expref: 12 pid: 20524 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746140865.328608:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140865.328610:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49dae00/0x8156357b7fdb5c29 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.328617:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49dae00/0x8156357b7fdb5c29 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.328622:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49dae00/0x8156357b7fdb5c29 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.328636:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140865.328650:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f21dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960572993920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140865.328655:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7816 00000100:00100000:0.0:1746140865.389663:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572994176 00000100:00100000:0.0:1746140865.389678:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572994176 00000100:00100000:0.0:1746140865.389745:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10330 00000100:00100000:0.0:1746140865.389753:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:31797:x1830960572994176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140865.389774:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140865.389790:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae3200/0x8156357b7fdb5c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829eebd expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.389895:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.389908:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.389918:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.389931:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.389936:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.389940:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390044:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2800/0x8156357b7fdb5c4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390051:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2800/0x8156357b7fdb5c4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390057:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2800/0x8156357b7fdb5c4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:0.0:1746140865.390065:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140865.390146:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390151:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390156:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390160:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bae2e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140865.390164:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390171:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390181:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140865.390184:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140865.390187:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390191:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2e00/0x8156357b7fdb5c3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390210:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390214:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390219:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390222:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bae2600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140865.390224:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390228:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390232:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293600) 00010000:00010000:0.0:1746140865.390234:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140865.390236:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390240:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2600/0x8156357b7fdb5c45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140865.390273:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae3200/0x8156357b7fdb5c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eebd expref: 279 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.390284:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bae2800/0x8156357b7fdb5c4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eebd expref: 278 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.390289:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140865.390291:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140865.390293:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bae2800, rc 0) 00000100:00100000:0.0:1746140865.390366:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:31797:x1830960572994176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 614us (3222us total) trans 8589944513 rc 0/0 00000100:00100000:0.0:1746140865.390372:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10330 00000100:00100000:0.0:1746140865.427098:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.428348:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.437298:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.450716:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.450859:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.450905:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.513351:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.595870:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.606158:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.617913:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.643281:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.645181:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.653979:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572997504 00000100:00100000:0.0:1746140865.653987:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572997504 00000100:00100000:0.0:1746140865.654023:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572997376 00000100:00100000:0.0:1746140865.654025:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572997376 00000100:00100000:0.0:1746140865.654035:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572997632 00000100:00100000:0.0:1746140865.654036:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572997632 00000100:00100000:0.0:1746140865.654055:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15192 00000100:00100000:0.0:1746140865.654061:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+21:31798:x1830960572997504:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140865.654077:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140865.654093:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bae2c00/0x8156357b7fdb5ced lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829eef5 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.654121:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3bae00/0x8156357b7fdb592e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ecfd expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.654128:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba000/0x8156357b7fdb5a69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edb3 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.654134:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba400/0x8156357b7fdb59eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed58 expref: 25 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.654139:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140865.654141:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140865.654143:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2c00/0x8156357b7fdb5ced lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2752512->3145727] (req 2752512->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eef5 expref: 22 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.654169:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba400/0x8156357b7fdb59eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed58 expref: 25 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.654179:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba400/0x8156357b7fdb59eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed58 expref: 25 pid: 32377 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746140865.654194:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b890380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575768960:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140865.654273:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba000/0x8156357b7fdb5a69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edb3 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.654281:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba000/0x8156357b7fdb5a69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829edb3 expref: 10 pid: 12255 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746140865.654628:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b892300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575769088:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140865.654655:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a3bae00/0x8156357b7fdb592e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ecfd expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.654663:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a3bae00/0x8156357b7fdb592e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ecfd expref: 22 pid: 8458 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746140865.654670:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575769344:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140865.654684:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140865.656114:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.660401:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b890380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575768960:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140865.660493:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575769344:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140865.660707:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b892300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575769088:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140865.660730:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bae2c00/0x8156357b7fdb5ced lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2752512->3145727] (req 2752512->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eef5 expref: 22 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.660747:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bae2c00, rc 0) 00000100:00100000:0.0:1746140865.661348:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+22:31798:x1830960572997504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7286us (7595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140865.661353:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15192 00000100:00100000:0.0:1746140865.665531:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.666158:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.666429:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572998272 00000100:00100000:0.0:1746140865.666432:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572998272 00000100:00100000:0.0:1746140865.666578:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15195 00000100:00100000:0.0:1746140865.666584:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:31792:x1830960572998272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140865.666597:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140865.666609:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a16e00/0x8156357b7fdb5d02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829ef03 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.666629:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb9c00/0x8156357b7fdb59d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed43 expref: 26 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.666636:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b464c00/0x8156357b7fdb5aaf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ede4 expref: 22 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.666640:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009243f800/0x8156357b7fdb5a4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed9e expref: 10 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.666646:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140865.666647:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140865.666651:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a16e00/0x8156357b7fdb5d02 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef03 expref: 26 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.666675:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009243f800/0x8156357b7fdb5a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed9e expref: 10 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.666684:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009243f800/0x8156357b7fdb5a4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed9e expref: 10 pid: 4785 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746140865.666695:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575769472:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140865.666759:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b464c00/0x8156357b7fdb5aaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ede4 expref: 22 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.666766:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b464c00/0x8156357b7fdb5aaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ede4 expref: 22 pid: 8459 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746140865.666773:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b890380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575769600:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140865.666795:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb9c00/0x8156357b7fdb59d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed43 expref: 26 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140865.666801:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb9c00/0x8156357b7fdb59d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ed43 expref: 26 pid: 32376 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746140865.666808:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575769728:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140865.666820:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140865.672580:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960572999296 00000100:00100000:0.0:1746140865.672587:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960572999296 00002000:00100000:0.0:1746140865.672623:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2752512->2756607) req@ffff88009f21f100 x1830960572999296/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/0 e 0 to 0 dl 1746140876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.672631:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f21f100 with x1830960572999296 ext(2752512->2756607) 00002000:00010000:0.0:1746140865.672636:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f21f100 00000100:00100000:0.0:1746140865.672793:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7721 00000100:00100000:0.0:1746140865.672800:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f21f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960572999296:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140865.674651:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f21f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960572999296:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1846us (2651us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140865.674660:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7721 00002000:00100000:0.0:1746140865.674668:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2752512->2756607) req@ffff88009f21f100 x1830960572999296/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/4536 e 0 to 0 dl 1746140876 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.674674:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f21f100 with x1830960572999296 ext(2752512->2756607) 00002000:00010000:0.0:1746140865.674678:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f21f100 00010000:00010000:0.0:1746140865.676757:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261600/0x8156357b7fdb5d1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef0a expref: 18 pid: 20524 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746140865.676772:0:20524:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f21c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20524:1830960575769984:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140865.676786:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009445fc00/0x8156357b7fdb5cdf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829eee0 expref: 13 pid: 20524 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746140865.676797:0:20524:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f21ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20524:1830960575770112:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140865.676815:0:20524:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb5d33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140865.676825:0:20524:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb5d33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140865.676829:0:20524:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb5d33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00000004:00200000:0.0:1746140865.677036:0:20524:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140865.677176:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdb5d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef11 expref: 14 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.677187:0:20524:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb5d33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef11 expref: 13 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.677193:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140865.677195:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140865.677197:0:20524:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009243ee00, rc 0) 00000100:00100000:0.0:1746140865.677228:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28b972ba-4133-49d1-b679-ce80456803d9+13:31807:x1830960572998912:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9376us (11070us total) trans 8589944521 rc 0/0 00000100:00100000:0.0:1746140865.677234:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10336 00000100:00100000:0.0:1746140865.679786:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.682678:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.682997:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.688705:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573000704 00000100:00100000:0.0:1746140865.688715:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573000704 00002000:00100000:0.0:1746140865.688754:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1150976->1155071) req@ffff88012bf10000 x1830960573000704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:281/0 lens 488/0 e 0 to 0 dl 1746140876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.688763:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf10000 with x1830960573000704 ext(1150976->1155071) 00002000:00010000:0.0:1746140865.688768:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf10000 00000100:00100000:0.0:1746140865.688790:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7722 00000100:00100000:0.0:1746140865.688797:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573000704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140865.688983:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573000704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 186us (369us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140865.688990:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7722 00002000:00100000:0.0:1746140865.688995:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1150976->1155071) req@ffff88012bf10000 x1830960573000704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:281/0 lens 488/4536 e 0 to 0 dl 1746140876 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140865.689002:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf10000 with x1830960573000704 ext(1150976->1155071) 00002000:00010000:0.0:1746140865.689006:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf10000 00000100:00100000:0.0:1746140865.693076:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.693653:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.693693:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.697524:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.699183:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.701334:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573001984 00000100:00100000:0.0:1746140865.701338:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573001984 00000100:00100000:0.0:1746140865.701363:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4449 00000100:00100000:0.0:1746140865.701368:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:31792:x1830960573001984:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746140865.701596:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:31792:x1830960573001984:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 227us (808us total) trans 8589944522 rc 0/0 00000100:00100000:0.0:1746140865.701602:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4449 00000100:00100000:0.0:1746140865.704153:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.714426:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.718893:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.720265:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.720610:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.727015:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.738727:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.742127:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.748020:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.755045:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.776488:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.776527:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.777148:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.778374:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7727 00000100:00100000:0.0:1746140865.778383:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573004672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140865.785722:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.793983:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.810637:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.810675:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.810703:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.810746:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.817777:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.838238:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.838291:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.840468:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7732 00000100:00100000:0.0:1746140865.842486:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.850907:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.874020:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.874081:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.881728:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.888144:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.900043:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.907003:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.920798:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.925590:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.925665:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.947093:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573009664 00000100:00100000:0.0:1746140865.947100:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573009664 00000100:00100000:0.0:1746140865.947142:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15214 00000100:00100000:0.0:1746140865.947148:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:31822:x1830960573009664:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140865.947165:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140865.947180:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a44dfc00/0x8156357b7fdb5e36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829efb9 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.947207:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094616200/0x8156357b7fdb5e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1044479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829efab expref: 18 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.947214:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140865.947215:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140865.947218:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a44dfc00/0x8156357b7fdb5e36 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [409600->483327] (req 409600->483327) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829efb9 expref: 29 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.947245:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094616200/0x8156357b7fdb5e1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1044479) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829efab expref: 18 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140865.947256:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094616200/0x8156357b7fdb5e1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1044479) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829efab expref: 18 pid: 32376 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746140865.947266:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099494e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575773824:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140865.962484:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.977021:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.977065:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.977098:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140865.977148:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.005722:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573011584 00000100:00100000:0.0:1746140866.005735:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573011584 00002000:00100000:0.0:1746140866.005817:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a0:0x0] (442368->1044479) req@ffff88012bf13480 x1830960573011584/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:281/0 lens 488/0 e 0 to 0 dl 1746140876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140866.005828:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf13480 with x1830960573011584 ext(442368->1044479) 00010000:00010000:0.0:1746140866.005838:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094616200/0x8156357b7fdb5e1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829efab expref: 19 pid: 32376 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746140866.005856:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094616200/0x8156357b7fdb5e1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829efab expref: 19 pid: 32376 timeout: 945 lvb_type: 0 00002000:00010000:0.0:1746140866.005864:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bf13480 00000100:00100000:0.0:1746140866.005885:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1567 00000100:00100000:0.0:1746140866.005892:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573011584:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140866.033254:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573011712 00000100:00100000:0.0:1746140866.033263:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573011712 00000100:00100000:0.0:1746140866.033319:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15215 00000100:00100000:0.0:1746140866.033325:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573011712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140866.033340:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140866.033354:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edec200/0x8156357b7fdb5e3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829efc0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140866.033404:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575774080:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140866.033486:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140866.045489:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.054019:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.054055:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.063251:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.067669:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.086845:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.091236:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.093767:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.094648:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.100461:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.103533:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.110182:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.115466:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.143922:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.152014:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.152033:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573015680 00000100:00100000:0.0:1746140866.152036:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573015680 00002000:00100000:0.0:1746140866.152055:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8800a513d500 x1830960573015680/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:282/0 lens 488/0 e 0 to 0 dl 1746140877 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140866.152062:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d500 with x1830960573015680 ext(3145728->4194303) 00002000:00010000:0.0:1746140866.152065:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513d500 00000100:00100000:0.0:1746140866.155181:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7744 00000100:00100000:0.0:1746140866.155199:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573015680:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140866.193700:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.199271:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.201030:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.209016:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.209077:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.209337:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.215488:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.221756:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.224856:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.238537:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.243138:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.245172:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.245234:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.258555:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.265150:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.265187:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.286003:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.303665:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.310409:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.315235:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.318585:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.319917:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.325239:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.325291:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.327739:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.331060:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.432579:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.441357:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.441417:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.451790:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.451840:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.455262:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.456851:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.457357:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.461974:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.471490:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.471595:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.471632:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.472330:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15230 00000100:00100000:0.0:1746140866.472340:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:31846:x1830960573023488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140866.472350:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140866.472365:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba200/0x8156357b7fdb5f78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f053 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.472384:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140866.472385:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140866.472392:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba200/0x8156357b7fdb5f78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f053 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.472406:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba200/0x8156357b7fdb5f78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f053 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.472416:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a3ba200, rc 0) 00000100:00100000:0.0:1746140866.472466:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:31846:x1830960573023488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 130us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140866.472475:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15230 00000100:00100000:0.0:1746140866.481014:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.510117:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.510174:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.528373:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.542652:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.556577:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.564905:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.564930:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.564961:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.568965:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.576625:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.579866:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.591569:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.594373:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.599485:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.602784:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573027968 00000100:00100000:0.0:1746140866.602792:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573027968 00002000:00100000:0.0:1746140866.602830:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3a9:0x0] (2211840->2215935) req@ffff8801359b0000 x1830960573027968/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:282/0 lens 488/0 e 0 to 0 dl 1746140877 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140866.602839:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0000 with x1830960573027968 ext(2211840->2215935) 00002000:00010000:0.0:1746140866.602844:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b0000 00000100:00100000:0.0:1746140866.602860:0:21377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7759 00000100:00100000:0.0:1746140866.603410:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573027968:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140866.611296:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.626483:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140866.627436:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140866.629785:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.634379:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.637916:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.637956:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.637981:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.637994:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.638031:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.645692:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.647778:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.650067:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.653288:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.654502:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15241 00000100:00100000:0.0:1746140866.654508:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573030272:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140866.654523:0:4782:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a49db600/0x8156357b7fdb6043 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.654531:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009445ec00/0x8156357b7fdb5d64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef34 expref: 22 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.654538:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b1cd200/0x8156357b7fdb6004 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f084 expref: 12 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140866.654545:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e427800/0x8156357b7fdb5dbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef6c expref: 31 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140866.654555:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140866.654556:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140866.654558:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49db600/0x8156357b7fdb6043 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.654570:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e427800/0x8156357b7fdb5dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef6c expref: 31 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140866.654575:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e427800/0x8156357b7fdb5dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef6c expref: 31 pid: 8459 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746140866.654581:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575777792:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140866.654868:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b1cd200/0x8156357b7fdb6004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f084 expref: 12 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140866.654876:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b1cd200/0x8156357b7fdb6004 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f084 expref: 12 pid: 8459 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746140866.654883:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575778304:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140866.654902:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009445ec00/0x8156357b7fdb5d64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef34 expref: 22 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.654909:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009445ec00/0x8156357b7fdb5d64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ef34 expref: 22 pid: 8459 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746140866.654921:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575778560:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140866.654936:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140866.661824:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.661861:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.664757:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.664787:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573032192 00000100:00100000:0.0:1746140866.664794:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573032192 00010000:00010000:0.0:1746140866.664830:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba200/0x8156357b7fdb5f78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f053 expref: 31 pid: 12255 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746140866.664874:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7857 00000100:00100000:0.0:1746140866.664882:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573032192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140866.664896:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140866.664917:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba200/0x8156357b7fdb5f78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f053 expref: 31 pid: 12255 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746140866.664929:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba200/0x8156357b7fdb5f78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f053 expref: 31 pid: 12255 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746140866.664951:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3ba200/0x8156357b7fdb5f78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f053 expref: 31 pid: 12255 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746140866.664972:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140866.665016:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573032192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140866.665026:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7857 00000100:00100000:0.0:1746140866.677002:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573030912 00000100:00100000:0.0:1746140866.677012:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573030912 00010000:00010000:0.0:1746140866.677073:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8ad600/0x8156357b7fdb5ff6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f08b expref: 11 pid: 8459 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746140866.680106:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7867 00000100:00100000:0.0:1746140866.680117:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573030912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140866.680131:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140866.680149:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8ad600/0x8156357b7fdb5ff6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f08b expref: 11 pid: 8459 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746140866.680158:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8ad600/0x8156357b7fdb5ff6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f08b expref: 11 pid: 8459 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746140866.680177:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8ad600/0x8156357b7fdb5ff6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f08b expref: 11 pid: 8459 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746140866.680193:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140866.680195:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140866.680199:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc9e600/0x8156357b7fdb603c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.680207:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc9e600/0x8156357b7fdb603c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.680226:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140866.680248:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573030912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (8110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140866.680253:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7867 00000100:00100000:0.0:1746140866.684009:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.692495:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.696203:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.702156:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.703657:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.736416:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575780352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.738046:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.738063:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575780864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.738078:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.738086:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575781376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.738099:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.738108:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575781888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.738121:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140866.739003:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513df80/2, rc 0, transno 21474841010 00000100:00100000:0.0:1746140866.739007:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575780352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140866.739013:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513f100/2, rc 0, transno 21474841011 00000100:00100000:0.0:1746140866.739016:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575780864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140866.739023:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b1b0e00/2, rc 0, transno 17179873750 00000100:00100000:0.0:1746140866.739026:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575781376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140866.739031:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009edcb100/2, rc 0, transno 17179873751 00000100:00100000:0.0:1746140866.739033:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575781888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.741551:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.745791:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.747967:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.750926:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.770170:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.775958:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.778889:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.778926:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.778948:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.778962:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.779021:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.796869:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.797055:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.797549:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.801361:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.801454:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.803994:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7764 00000100:00100000:0.0:1746140866.804003:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573036288:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140866.822813:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.827421:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573035904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24843us (30559us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140866.827428:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7761 00002000:00100000:0.0:1746140866.827434:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88012bf10a80 x1830960573035904/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:282/0 lens 488/440 e 0 to 0 dl 1746140877 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140866.827451:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf10a80 with x1830960573035904 ext(0->1048575) 00002000:00010000:0.0:1746140866.827455:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf10a80 00000100:00100000:0.0:1746140866.829869:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.830294:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.834047:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.840367:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.842885:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.848593:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.848614:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.848660:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.848681:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.848697:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573040384 00000100:00100000:0.0:1746140866.848699:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573040384 00010000:00010000:0.0:1746140866.848725:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2600/0x8156357b7fdb614d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f12c expref: 271 pid: 27790 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746140866.848747:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573040256 00000100:00100000:0.0:1746140866.848749:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573040256 00010000:00010000:0.0:1746140866.848756:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece0e00/0x8156357b7fdb606d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0ae expref: 9 pid: 20524 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746140866.848768:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7877 00000100:00100000:0.0:1746140866.848774:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:1984:x1830960573040384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140866.848785:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140866.848790:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2600/0x8156357b7fdb614d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f12c expref: 271 pid: 27790 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746140866.848800:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2600/0x8156357b7fdb614d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f12c expref: 271 pid: 27790 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746140866.848824:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140866.848829:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece0000/0x8156357b7fdb615b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140866.848834:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece0000/0x8156357b7fdb615b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140866.848838:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140866.848873:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:1984:x1830960573040384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140866.848878:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7877 00000100:00100000:0.0:1746140866.848893:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7878 00000100:00100000:0.0:1746140866.848897:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573040256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140866.848901:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140866.848904:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece0e00/0x8156357b7fdb606d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0ae expref: 9 pid: 20524 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746140866.848911:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece0e00/0x8156357b7fdb606d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0ae expref: 9 pid: 20524 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746140866.848919:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140866.848922:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece0000/0x8156357b7fdb615b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140866.848928:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece0000/0x8156357b7fdb615b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140866.848933:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece0000/0x8156357b7fdb615b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140866.848939:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2e00/0x8156357b7fdb6169 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140866.848944:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2e00/0x8156357b7fdb6169 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140866.848955:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140866.848965:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573040256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140866.848970:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7878 00000100:00100000:0.0:1746140866.849038:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.849070:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573040512 00000100:00100000:0.0:1746140866.849073:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573040512 00000100:00100000:0.0:1746140866.849091:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10363 00000100:00100000:0.0:1746140866.849095:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:31861:x1830960573040512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140866.849105:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140866.849114:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3bb800/0x8156357b7fdb6170 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f141 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.849154:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2e00/0x8156357b7fdb6169 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140866.849160:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3bb800/0x8156357b7fdb6170 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f141 expref: 272 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.849172:0:14743:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2e00/0x8156357b7fdb6169 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140866.849180:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3bb800/0x8156357b7fdb6170 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f141 expref: 272 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.849189:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140866.849191:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140866.849193:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2e00/0x8156357b7fdb6169 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140866.849197:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a3bb800, rc 0) 00000100:00100000:0.0:1746140866.849211:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:31861:x1830960573040512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 116us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140866.849215:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10363 00000100:00100000:0.0:1746140866.849270:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7768 00000100:00100000:0.0:1746140866.849275:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009334b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573040128:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140866.868674:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009334aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573039872:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 19623us (19829us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140866.868686:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7767 00002000:00100000:0.0:1746140866.868699:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009334aa00 x1830960573039872/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:282/0 lens 488/440 e 0 to 0 dl 1746140877 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140866.868708:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009334aa00 with x1830960573039872 ext(1048576->2097151) 00002000:00010000:0.0:1746140866.868715:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009334aa00 00000100:00100000:0.0:1746140866.869188:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009334b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573040128:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 19912us (20572us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140866.869195:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7768 00002000:00100000:0.0:1746140866.869200:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009334b480 x1830960573040128/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:282/0 lens 488/440 e 0 to 0 dl 1746140877 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140866.869212:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009334b480 with x1830960573040128 ext(1048576->2097151) 00002000:00010000:0.0:1746140866.869215:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009334b480 00000100:00100000:0.0:1746140866.872869:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.887729:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575783168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.888974:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.888985:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575783680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.888998:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.889005:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575784192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.889018:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.889024:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575784704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.889040:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.889062:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575783680 00000100:00100000:0.0:1746140866.889064:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575783680 00000100:00100000:0.0:1746140866.889625:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15280 00000100:00100000:0.0:1746140866.889631:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+69:3310:x1830960575784576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.889723:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:3310:x1830960575784576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1031us total) trans 17179873757 rc 0/0 00000100:00100000:0.0:1746140866.889729:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15280 00000100:00100000:0.0:1746140866.889738:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15282 00000100:00100000:0.0:1746140866.889743:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3313:x1830960575783808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.889823:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3313:x1830960575783808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1081us total) trans 21474841021 rc 0/0 00000100:00100000:0.0:1746140866.889829:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15282 00000100:00100000:0.0:1746140866.889838:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15284 00000100:00100000:0.0:1746140866.889841:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:3313:x1830960575784832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.889912:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:3313:x1830960575784832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1136us total) trans 17179873759 rc 0/0 00000100:00100000:0.0:1746140866.889917:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15284 00000100:00100000:0.0:1746140866.889925:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15286 00000100:00100000:0.0:1746140866.889929:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960575783680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.889997:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960575783680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (997us total) trans 21474841023 rc 0/0 00000100:00100000:0.0:1746140866.890002:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15286 00000004:00080000:0.0:1746140866.890032:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093137800/2, rc 0, transno 21474841022 00000100:00100000:0.0:1746140866.890041:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575783168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140866.890048:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093135500/2, rc 0, transno 21474841023 00000100:00100000:0.0:1746140866.890051:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575783680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140866.890058:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf3480/2, rc 0, transno 17179873760 00000100:00100000:0.0:1746140866.890060:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575784704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140866.890793:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf3b80/2, rc 0, transno 17179873761 00000100:00100000:0.0:1746140866.890796:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575784192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.893193:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140866.894037:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2e00/0x8156357b7fdb6169 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140866.894044:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2e00/0x8156357b7fdb6169 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00000040:00080000:0.0:1746140866.894725:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3166, 88 off267248 00000004:00080000:0.0:1746140866.894733:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970427252ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894771:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3224, 88 off272536 00000004:00080000:0.0:1746140866.894774:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845970469117ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140866.894798:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3225, 88 off272624 00000004:00080000:0.0:1746140866.894802:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845970496945ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140866.894809:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3167, 88 off267336 00000004:00080000:0.0:1746140866.894812:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970507352ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894817:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3168, 88 off267424 00000004:00080000:0.0:1746140866.894821:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970516245ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894863:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3226, 88 off272712 00000004:00080000:0.0:1746140866.894866:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845970561569ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140866.894875:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3227, 88 off272800 00000004:00080000:0.0:1746140866.894878:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845970573262ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140866.894886:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3228, 88 off272888 00000004:00080000:0.0:1746140866.894888:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845970583177ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140866.894896:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3169, 88 off267512 00000004:00080000:0.0:1746140866.894898:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970593692ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894904:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3229, 88 off272976 00000004:00080000:0.0:1746140866.894906:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845970601475ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140866.894913:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3170, 88 off267600 00000004:00080000:0.0:1746140866.894916:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970610687ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894921:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3230, 88 off273064 00000004:00080000:0.0:1746140866.894924:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845970618969ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140866.894930:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3171, 88 off267688 00000004:00080000:0.0:1746140866.894933:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970627855ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894938:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3172, 88 off267776 00000004:00080000:0.0:1746140866.894941:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970636127ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894971:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3173, 88 off267864 00000004:00080000:0.0:1746140866.894974:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970668937ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894982:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3174, 88 off267952 00000004:00080000:0.0:1746140866.894984:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845970679284ns, next at 809142640841ns, rc = 0 00000040:00080000:0.0:1746140866.894992:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3231, 88 off273152 00000004:00080000:0.0:1746140866.894995:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845970690472ns, next at 809142599738ns, rc = 0 00000100:00100000:0.0:1746140866.913263:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575785984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.913295:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.913325:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575786496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.913341:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.913351:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575787008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.913366:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.913376:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746140866.913380:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575786112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.913392:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.913402:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575786624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.913415:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.913424:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575787136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.913445:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140866.913698:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15293 00000100:00100000:0.0:1746140866.913705:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:3312:x1830960575786496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.913805:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960575786496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (462us total) trans 21474841026 rc 0/0 00000100:00100000:0.0:1746140866.913811:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15293 00000100:00100000:0.0:1746140866.913821:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15295 00000100:00100000:0.0:1746140866.913825:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3312:x1830960575786112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.913898:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960575786112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (505us total) trans 21474841027 rc 0/0 00000100:00100000:0.0:1746140866.914710:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15295 00000100:00100000:0.0:1746140866.914719:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15301 00000100:00100000:0.0:1746140866.914724:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3311:x1830960575785728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140866.914798:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140866.914801:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140866 -> 1746140866 00002000:00010000:0.0:1746140866.914803:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140865 -> 1746140865 00002000:00010000:0.0:1746140866.914805:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140866 -> 1746140866 00002000:00010000:0.0:1746140866.914807:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746140866.914825:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3311:x1830960575785728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (1218us total) trans 21474841029 rc 0/0 00000100:00100000:0.0:1746140866.914830:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15301 00000100:00100000:0.0:1746140866.914839:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15303 00000100:00100000:0.0:1746140866.914843:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960575786752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140866.914917:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3311:x1830960575786752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1273us total) trans 17179873770 rc 0/0 00000100:00100000:0.0:1746140866.914922:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15303 00000100:00100000:0.0:1746140866.914931:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15305 00000100:00100000:0.0:1746140866.914935:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3311:x1830960575785856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140866.914996:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140866.914999:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140863 -> 1746140863 00002000:00010000:0.0:1746140866.915001:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140863 -> 1746140863 00002000:00010000:0.0:1746140866.915002:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140864 -> 1746140864 00002000:00010000:0.0:1746140866.915005:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140866.915020:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3311:x1830960575785856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1497us total) trans 21474841032 rc 0/0 00000100:00100000:0.0:1746140866.915493:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15305 00000100:00100000:0.0:1746140866.915836:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575787520 00000100:00100000:0.0:1746140866.915840:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575787520 00000100:00100000:0.0:1746140866.915857:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15306 00000100:00100000:0.0:1746140866.915861:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960575787520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140866.915950:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:3312:x1830960575787520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (310us total) trans 21474841033 rc 0/0 00000100:00100000:0.0:1746140866.915955:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15306 00000100:00100000:0.0:1746140866.916352:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575785216:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140866.916361:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575785344:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140866.916393:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2c00/0x8156357b7fdb6162 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f13a expref: 270 pid: 14741 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746140866.916411:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936c2e00/0x8156357b7fdb6169 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f13a expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.916429:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936c2e00, rc 0) 00000100:00100000:0.0:1746140866.916787:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009334a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:31868:x1830960573039104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 73667us (73904us total) trans 8589944558 rc 0/0 00000100:00100000:0.0:1746140866.916793:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10362 00000100:00100000:0.0:1746140866.921206:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.932512:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.933390:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.933985:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573041536 00000100:00100000:0.0:1746140866.933990:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573041536 00000100:00100000:0.0:1746140866.934024:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15308 00000100:00100000:0.0:1746140866.934029:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:31868:x1830960573041536:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140866.934037:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140866.934048:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec31c00/0x8156357b7fdb618c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f15d expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.934065:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800902dbc00/0x8156357b7fdb609e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0c3 expref: 35 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140866.934072:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb60f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0f4 expref: 25 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140866.934078:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140866.934079:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140866.934082:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec31c00/0x8156357b7fdb618c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1429504->1433599] (req 1429504->1433599) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f15d expref: 35 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140866.934096:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb60f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0f4 expref: 25 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140866.934104:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb60f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0f4 expref: 25 pid: 8460 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140866.934112:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575787904:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140866.934139:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800902dbc00/0x8156357b7fdb609e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0c3 expref: 35 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140866.934146:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800902dbc00/0x8156357b7fdb609e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0c3 expref: 35 pid: 32376 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140866.934152:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575788032:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140866.934162:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140866.935026:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573041792 00000100:00100000:0.0:1746140866.935029:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573041792 00002000:00100000:0.0:1746140866.935054:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc08e00 x1830960573041792/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:282/0 lens 488/0 e 0 to 0 dl 1746140877 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140866.935063:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08e00 with x1830960573041792 ext(1048576->2097151) 00010000:00010000:0.0:1746140866.935070:0:21691:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb60f2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0f4 expref: 26 pid: 8460 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140866.935079:0:21691:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb60f2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0f4 expref: 26 pid: 8460 timeout: 946 lvb_type: 1 00002000:00010000:0.0:1746140866.935085:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc08e00 00000100:00100000:0.0:1746140866.935239:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1576 00000100:00100000:0.0:1746140866.935245:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573041792:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140866.951354:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.951622:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.952837:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.952918:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.957509:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.962884:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.964717:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.967050:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.967648:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.981994:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.992229:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.993187:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.993211:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.993223:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.993242:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140866.993256:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573045632 00000100:00100000:0.0:1746140866.993258:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573045632 00002000:00100000:0.0:1746140866.993272:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880094add880 x1830960573045632/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:282/0 lens 488/0 e 0 to 0 dl 1746140877 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140866.993278:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094add880 with x1830960573045632 ext(2097152->3145727) 00002000:00010000:0.0:1746140866.993281:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094add880 00000100:00100000:0.0:1746140866.993290:0:21377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7772 00000100:00100000:0.0:1746140866.993295:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573045120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140867.020694:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573044864:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 27613us (28474us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140867.020706:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7771 00002000:00100000:0.0:1746140867.020718:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880094adc700 x1830960573044864/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:282/0 lens 488/440 e 0 to 0 dl 1746140877 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.020728:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adc700 with x1830960573044864 ext(1048576->2097151) 00002000:00010000:0.0:1746140867.020733:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094adc700 00000100:00100000:0.0:1746140867.030283:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.030364:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140867.033594:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746140867.043806:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140867.044785:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140867.054219:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140867.055367:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746140867.058270:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.069817:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.069852:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.069875:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.069914:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.071379:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7780 00000100:00100000:0.0:1746140867.071391:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573047936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140867.097293:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573048576 00000100:00100000:0.0:1746140867.097300:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573048576 00000100:00100000:0.0:1746140867.097356:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10367 00000100:00100000:0.0:1746140867.097364:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:31876:x1830960573048576:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140867.097384:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140867.097401:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093819a00/0x8156357b7fdb61cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f187 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.097508:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097521:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097530:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097540:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097546:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097552:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097646:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093818e00/0x8156357b7fdb61e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097654:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093818e00/0x8156357b7fdb61e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097659:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093818e00/0x8156357b7fdb61e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:0.0:1746140867.097666:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140867.097740:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097746:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097752:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097758:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093819800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140867.097761:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097767:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097777:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140867.097780:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140867.097784:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.097788:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093819800/0x8156357b7fdb61d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.098735:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.098742:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.098747:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.098751:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093819e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140867.098754:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.098759:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.098767:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880131034600) 00010000:00010000:0.0:1746140867.098769:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140867.098772:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.098776:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093819e00/0x8156357b7fdb61d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140867.098803:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093819a00/0x8156357b7fdb61cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f187 expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.098814:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093818e00/0x8156357b7fdb61e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f187 expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.098820:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140867.098822:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140867.098825:0:14741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dde00/0x8156357b7fdb61c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140867.098830:0:14741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dde00/0x8156357b7fdb61c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140867.098834:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093818e00, rc 0) 00000100:00100000:0.0:1746140867.105901:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.108364:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.108384:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.108398:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.108409:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.108452:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140867.110541:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746140867.110546:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140867.129246:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.130213:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.133683:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.135874:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.144806:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.144849:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.147940:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.147974:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.148042:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.153450:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.156340:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.157623:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.160052:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.165913:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.173393:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.226709:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.226724:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.226797:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.226832:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575790720:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140867.226840:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575790848:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140867.226847:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575790976:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140867.226871:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f1dcc00/0x8156357b7fdb629d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f205 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.226885:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1dcc00, rc 0) 00000100:00100000:0.0:1746140867.226919:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:31874:x1830960573053952:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11360us (11474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.226925:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15326 00000100:00100000:0.0:1746140867.226949:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7893 00000100:00100000:0.0:1746140867.226954:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573054208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140867.226960:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140867.226968:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x8156357b7fdb60f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f102 expref: 28 pid: 8460 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.226981:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x8156357b7fdb60f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f102 expref: 28 pid: 8460 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.226992:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x8156357b7fdb60f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f102 expref: 28 pid: 8460 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.227010:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140867.227023:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573054208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.227028:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7893 00000100:00100000:0.0:1746140867.240581:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.240611:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573054720 00000100:00100000:0.0:1746140867.240619:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573054720 00000100:00100000:0.0:1746140867.240657:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15327 00000100:00100000:0.0:1746140867.240665:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:31874:x1830960573054720:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140867.240681:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140867.240698:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093819200/0x8156357b7fdb62a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f20c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.240727:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c8a00/0x8156357b7fdb6257 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4751359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1cd expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.240735:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb627a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1e9 expref: 9 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.240746:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140867.240748:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140867.240751:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093819200/0x8156357b7fdb62a4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2314239] (req 2097152->2314239) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f20c expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.240778:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb627a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1e9 expref: 9 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.240789:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb627a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1e9 expref: 9 pid: 20960 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140867.240801:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575791232:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140867.240872:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51c8a00/0x8156357b7fdb6257 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4751359) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1cd expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.240881:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c8a00/0x8156357b7fdb6257 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4751359) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1cd expref: 26 pid: 12255 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746140867.240888:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575791360:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140867.240904:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140867.244471:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.244536:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.244579:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575791232:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140867.244589:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575791360:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140867.244616:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093819200/0x8156357b7fdb62a4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2314239] (req 2097152->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f20c expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.244633:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093819200, rc 0) 00000100:00100000:0.0:1746140867.244669:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:31874:x1830960573054720:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4004us (4096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.244676:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15327 00000100:00100000:0.0:1746140867.244740:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573054976 00000100:00100000:0.0:1746140867.244745:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573054976 00010000:00010000:0.0:1746140867.244765:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c8a00/0x8156357b7fdb6257 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4751359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1cd expref: 27 pid: 12255 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746140867.244783:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573054848 00000100:00100000:0.0:1746140867.244785:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573054848 00010000:00010000:0.0:1746140867.244792:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb627a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1e9 expref: 10 pid: 20960 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140867.244803:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7895 00000100:00100000:0.0:1746140867.244809:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573054976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140867.244820:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140867.244836:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a51c8a00/0x8156357b7fdb6257 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4751359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1cd expref: 27 pid: 12255 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746140867.244844:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a51c8a00/0x8156357b7fdb6257 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4751359) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1cd expref: 27 pid: 12255 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746140867.244864:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c8a00/0x8156357b7fdb6257 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4751359) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1cd expref: 27 pid: 12255 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746140867.244873:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140867.244890:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573054976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.244896:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7895 00000100:00100000:0.0:1746140867.244904:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7896 00000100:00100000:0.0:1746140867.244908:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573054848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140867.244914:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140867.244922:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb627a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1e9 expref: 10 pid: 20960 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.244929:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb627a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1e9 expref: 10 pid: 20960 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.244939:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb627a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1e9 expref: 10 pid: 20960 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.244946:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140867.244948:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140867.244954:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093819200/0x8156357b7fdb62a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f20c expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.244961:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093819200/0x8156357b7fdb62a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f20c expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.244985:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093819200/0x8156357b7fdb62a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f20c expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140867.244996:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960575791488:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140867.245041:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140867.248647:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960575791488:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140867.248667:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140867.248704:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573054848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3793us (4166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.248714:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7896 00000100:00100000:0.0:1746140867.251230:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.256206:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746140867.281164:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873770 is committed 00000001:00080000:0.0:1746140867.281190:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873714 is committed 00000001:00080000:0.0:1746140867.281203:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873695 is committed 00000001:00080000:0.0:1746140867.281207:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873684 is committed 00000001:00080000:0.0:1746140867.281216:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873771 is committed 00000001:00080000:0.0:1746140867.281230:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873747 is committed 00000001:00080000:0.0:1746140867.281895:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873742 is committed 00000001:00080000:0.0:1746140867.281924:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873772 is committed 00000001:00080000:0.0:1746140867.281997:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873696 is committed 00000100:00100000:0.0:1746140867.296581:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573056512 00000100:00100000:0.0:1746140867.296584:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573056512 00000100:00100000:0.0:1746140867.296608:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15328 00000100:00100000:0.0:1746140867.296615:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:31883:x1830960573056512:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140867.296627:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140867.296644:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927c5000/0x8156357b7fdb62f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f221 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.296672:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800902da200/0x8156357b7fdb60ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0df expref: 19 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.296680:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f1dc400/0x8156357b7fdb6234 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1b8 expref: 6 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.296686:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800902dbe00/0x8156357b7fdb6107 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f110 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.296691:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140867.296693:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140867.296696:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927c5000/0x8156357b7fdb62f1 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f221 expref: 8 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.296723:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800902dbe00/0x8156357b7fdb6107 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f110 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.298397:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800902dbe00/0x8156357b7fdb6107 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f110 expref: 8 pid: 8460 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140867.298423:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575791616:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140867.298543:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f1dc400/0x8156357b7fdb6234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1b8 expref: 6 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.298557:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f1dc400/0x8156357b7fdb6234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1b8 expref: 6 pid: 4784 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140867.298567:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575791744:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140867.298598:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800902da200/0x8156357b7fdb60ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0df expref: 19 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.298607:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800902da200/0x8156357b7fdb60ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f0df expref: 19 pid: 32376 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140867.298615:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575791872:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140867.298634:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140867.301331:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573057024 00000100:00100000:0.0:1746140867.301335:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573057024 00002000:00100000:0.0:1746140867.301357:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009fc0a680 x1830960573057024/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:283/0 lens 488/0 e 0 to 0 dl 1746140878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.301365:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0a680 with x1830960573057024 ext(1048576->2097151) 00002000:00010000:0.0:1746140867.301371:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc0a680 00000100:00100000:0.0:1746140867.301392:0:21377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7786 00000100:00100000:0.0:1746140867.301400:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573057024:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140867.303707:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573057152 00000100:00100000:0.0:1746140867.303715:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573057152 00002000:00100000:0.0:1746140867.303745:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1507327) req@ffff88009fc08a80 x1830960573057152/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:283/0 lens 488/0 e 0 to 0 dl 1746140878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.303754:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08a80 with x1830960573057152 ext(1048576->1507327) 00002000:00010000:0.0:1746140867.303758:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc08a80 00000100:00100000:0.0:1746140867.303775:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7788 00000100:00100000:0.0:1746140867.303781:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573057152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140867.310090:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573057280 00000100:00100000:0.0:1746140867.310102:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573057280 00010000:00010000:0.0:1746140867.310138:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1dc400/0x8156357b7fdb6234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1b8 expref: 7 pid: 4784 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140867.310184:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7897 00000100:00100000:0.0:1746140867.310191:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573057280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140867.310203:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140867.310223:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f1dc400/0x8156357b7fdb6234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1b8 expref: 7 pid: 4784 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.310234:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f1dc400/0x8156357b7fdb6234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1b8 expref: 7 pid: 4784 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.310254:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f1dc400/0x8156357b7fdb6234 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1b8 expref: 7 pid: 4784 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.310270:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140867.310332:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573057280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.310339:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7897 00000100:00100000:0.0:1746140867.312904:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.312946:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.313288:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1985:x1830960573057152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9505us (10276us total) trans 0 rc 458752/458752 00000100:00100000:0.0:1746140867.313299:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7788 00002000:00100000:0.0:1746140867.313341:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1507327) req@ffff88009fc08a80 x1830960573057152/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:283/0 lens 488/440 e 0 to 0 dl 1746140878 ref 1 fl Complete:/200/0 rc 458752/458752 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.313354:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08a80 with x1830960573057152 ext(1048576->1507327) 00002000:00010000:0.0:1746140867.313359:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc08a80 00000100:00100000:0.0:1746140867.322756:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.329188:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.336470:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.340650:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.340688:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.341021:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.342492:0:21377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573058688:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1342us (1467us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140867.342500:0:21377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7790 00002000:00100000:0.0:1746140867.342507:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a3:0x0] (3190784->3194879) req@ffff88009f2c2a00 x1830960573058688/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746140878 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.342515:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2a00 with x1830960573058688 ext(3190784->3194879) 00002000:00010000:0.0:1746140867.342519:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c2a00 00002000:00010000:0.0:1746140867.342660:0:8460:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime: 1746140867 -> 1746140868 00002000:00010000:0.0:1746140867.342663:0:8460:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140866 -> 1746140867 00002000:00010000:0.0:1746140867.342665:0:8460:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime: 1746140867 -> 1746140868 00000100:00100000:0.0:1746140867.342674:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960575792384:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140867.342689:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a49dae00/0x8156357b7fdb62ff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f22f expref: 15 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.342704:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a49dae00/0x8156357b7fdb62ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f22f expref: 15 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.342726:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49dae00, rc 0) 00000100:00100000:0.0:1746140867.342746:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1984:x1830960573058304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1836us (2105us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140867.342751:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15330 00000100:00100000:0.0:1746140867.344087:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.344126:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.346733:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.351616:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.369570:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.372132:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.387280:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.393440:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.394282:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.403361:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.425894:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.429248:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.433617:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.433885:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.433911:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.434109:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.447004:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.475482:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.482035:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.486290:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.491636:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.495703:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573063680 00000100:00100000:0.0:1746140867.495707:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573063680 00000100:00100000:0.0:1746140867.495730:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 712 00000100:00100000:0.0:1746140867.495734:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:1982:x1830960573063680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140867.495741:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140867.495757:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef51c00/0x8156357b7fdb637d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f27c expref: 277 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.495772:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140867.495776:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140867.495794:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:1982:x1830960573063680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.495799:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 712 00000100:00100000:0.0:1746140867.499298:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.502061:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.551051:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.551170:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.576565:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.578368:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.587495:0:21377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573064320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 35925us (36313us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140867.587507:0:21377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7797 00002000:00100000:0.0:1746140867.587520:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f170700 x1830960573064320/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:283/0 lens 488/440 e 0 to 0 dl 1746140878 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.587535:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170700 with x1830960573064320 ext(1048576->2097151) 00002000:00010000:0.0:1746140867.587540:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f170700 00000100:00100000:0.0:1746140867.589778:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.606060:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.612475:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.612632:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573065728 00000100:00100000:0.0:1746140867.612638:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573065728 00002000:00100000:0.0:1746140867.612671:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a2:0x0] (1507328->2097151) req@ffff88009f173100 x1830960573065728/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:283/0 lens 488/0 e 0 to 0 dl 1746140878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.612680:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173100 with x1830960573065728 ext(1507328->2097151) 00010000:00010000:0.0:1746140867.612686:0:21377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f1dcc00/0x8156357b7fdb629d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f205 expref: 15 pid: 12255 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746140867.612698:0:21377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f1dcc00/0x8156357b7fdb629d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f205 expref: 15 pid: 12255 timeout: 946 lvb_type: 0 00002000:00010000:0.0:1746140867.612703:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f173100 00000100:00100000:0.0:1746140867.612722:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1588 00000100:00100000:0.0:1746140867.612727:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573065728:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140867.640846:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.647063:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.649126:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1982:x1830960573066368:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140867.657714:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.671538:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.683184:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.685824:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.689636:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.697221:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.698365:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.698413:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.701878:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573068160 00000100:00100000:0.0:1746140867.701887:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573068160 00002000:00100000:0.0:1746140867.701926:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3166207) req@ffff88009f24f480 x1830960573068160/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:283/0 lens 504/0 e 0 to 0 dl 1746140878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.701936:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f480 with x1830960573068160 ext(2097152->3166207) 00010000:00010000:0.0:1746140867.701944:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009454c000/0x8156357b7fdb638b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f283 expref: 12 pid: 20960 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746140867.701958:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009454c000/0x8156357b7fdb638b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f283 expref: 12 pid: 20960 timeout: 946 lvb_type: 0 00002000:00010000:0.0:1746140867.701965:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f24f480 00000100:00100000:0.0:1746140867.701984:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573068416 00000100:00100000:0.0:1746140867.701987:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573068416 00002000:00100000:0.0:1746140867.701999:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3166208->4194303) req@ffff88009f24fb80 x1830960573068416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:283/0 lens 488/0 e 0 to 0 dl 1746140878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.702006:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24fb80 with x1830960573068416 ext(3166208->4194303) 00010000:00010000:0.0:1746140867.702009:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009454c000/0x8156357b7fdb638b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f283 expref: 13 pid: 20960 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746140867.702017:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009454c000/0x8156357b7fdb638b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f283 expref: 13 pid: 20960 timeout: 946 lvb_type: 0 00002000:00010000:0.0:1746140867.702022:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f24fb80 00000100:00100000:0.0:1746140867.702039:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1591 00000100:00100000:0.0:1746140867.702044:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960573068416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140867.731399:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.737644:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1982:x1830960573067904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 35457us (35693us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140867.737652:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7804 00002000:00100000:0.0:1746140867.737657:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f24e680 x1830960573067904/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:283/0 lens 488/440 e 0 to 0 dl 1746140878 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.737665:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24e680 with x1830960573067904 ext(3145728->4194303) 00002000:00010000:0.0:1746140867.737669:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24e680 00000100:00100000:0.0:1746140867.742484:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573069056 00000100:00100000:0.0:1746140867.742492:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573069056 00010000:00010000:0.0:1746140867.742528:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51c8e00/0x8156357b7fdb621f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1a3 expref: 6 pid: 20960 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140867.742549:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573069184 00000100:00100000:0.0:1746140867.742551:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573069184 00010000:00010000:0.0:1746140867.742560:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f5b4c00/0x8156357b7fdb6193 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f164 expref: 13 pid: 4782 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746140867.742573:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573069312 00000100:00100000:0.0:1746140867.742575:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573069312 00010000:00010000:0.0:1746140867.742582:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093cd2400/0x8156357b7fdb61a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f172 expref: 24 pid: 4782 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746140867.742599:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7912 00000100:00100000:0.0:1746140867.742604:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573069056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140867.742611:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140867.742634:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a51c8e00/0x8156357b7fdb621f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1a3 expref: 6 pid: 20960 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.742643:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a51c8e00/0x8156357b7fdb621f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1a3 expref: 6 pid: 20960 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.742659:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51c8e00/0x8156357b7fdb621f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f1a3 expref: 6 pid: 20960 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.742673:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140867.742690:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+5:1983:x1830960573069056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.742696:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7912 00000100:00100000:0.0:1746140867.743035:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7914 00000100:00100000:0.0:1746140867.743042:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1982:x1830960573069312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140867.743050:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140867.743058:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093cd2400/0x8156357b7fdb61a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f172 expref: 23 pid: 4782 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.743066:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093cd2400/0x8156357b7fdb61a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f172 expref: 23 pid: 4782 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.743081:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093cd2400/0x8156357b7fdb61a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f172 expref: 23 pid: 4782 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746140867.743089:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140867.743104:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573069312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 63us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.743109:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7914 00000100:00100000:0.0:1746140867.743884:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.748385:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.748668:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573069824 00000100:00100000:0.0:1746140867.748672:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573069824 00002000:00100000:0.0:1746140867.748700:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1167360->1171455) req@ffff88012b06aa00 x1830960573069824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:283/0 lens 488/0 e 0 to 0 dl 1746140878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.748832:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06aa00 with x1830960573069824 ext(1167360->1171455) 00002000:00010000:0.0:1746140867.748838:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b06aa00 00000100:00100000:0.0:1746140867.748863:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7806 00000100:00100000:0.0:1746140867.748869:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573069824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140867.749046:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573069824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 176us (418us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140867.749052:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7806 00002000:00100000:0.0:1746140867.749057:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1167360->1171455) req@ffff88012b06aa00 x1830960573069824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:283/0 lens 488/4536 e 0 to 0 dl 1746140878 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140867.749064:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06aa00 with x1830960573069824 ext(1167360->1171455) 00002000:00010000:0.0:1746140867.749067:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b06aa00 00000100:00100000:0.0:1746140867.758553:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.758969:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.759005:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.765141:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.765174:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.765203:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.787010:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.787081:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.787151:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15349 00000100:00100000:0.0:1746140867.787162:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960573071744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140867.787193:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140867.787202:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013733a600/0x8156357b7fdb63fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f2d0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140867.787248:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575796224:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140867.787373:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140867.791631:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.792143:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.797055:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.804699:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960575796736:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140867.804717:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008feefc00/0x8156357b7fdb6410 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2ec expref: 12 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.804725:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008feefc00/0x8156357b7fdb6410 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2ec expref: 12 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140867.804741:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008feefc00, rc 0) 00000100:00100000:0.0:1746140867.804759:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573072512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3341us (3428us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140867.804765:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15353 00000100:00100000:0.0:1746140867.805326:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.808403:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.808685:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.808781:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573073024 00000100:00100000:0.0:1746140867.808784:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573073024 00000100:00100000:0.0:1746140867.808802:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15357 00000100:00100000:0.0:1746140867.808807:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573073024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140867.808813:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140867.808819:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930e8000/0x8156357b7fdb642c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f308 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140867.808842:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575797248:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140867.809054:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140867.811859:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.871979:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.872032:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.872064:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.872094:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.872145:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573073792 00000100:00100000:0.0:1746140867.872148:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573073792 00000100:00100000:0.0:1746140867.872176:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 368 00000100:00100000:0.0:1746140867.872181:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573073792:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746140867.872411:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573073792:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 227us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.872427:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 368 00000100:00100000:0.0:1746140867.872461:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 196 00000100:00100000:0.0:1746140867.872467:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573073664:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746140867.872492:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573073664:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140867.872497:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 196 00000100:00100000:0.0:1746140867.930893:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.941207:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.942535:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.952832:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.961982:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.970344:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.970449:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.982920:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140867.984094:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573075200 00000100:00100000:0.0:1746140867.984097:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573075200 00010000:00010000:0.0:1746140867.984115:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d230e00/0x8156357b7fdb63df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1171456->18446744073709551615] (req 1753088->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2bb expref: 13 pid: 4186 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140867.984135:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7917 00000100:00100000:0.0:1746140867.984140:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960573075200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140867.987458:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140867.987496:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d230e00/0x8156357b7fdb63df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1171456->18446744073709551615] (req 1753088->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2bb expref: 13 pid: 4186 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140867.987514:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d230e00/0x8156357b7fdb63df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1171456->18446744073709551615] (req 1753088->2043903) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2bb expref: 13 pid: 4186 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140867.987536:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d230e00/0x8156357b7fdb63df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1171456->18446744073709551615] (req 1753088->2043903) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2bb expref: 13 pid: 4186 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140867.987572:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140867.987574:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140867.987582:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008feef600/0x8156357b7fdb645d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f31d expref: 23 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.987589:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008feef600/0x8156357b7fdb645d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f31d expref: 23 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140867.987630:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008feef600/0x8156357b7fdb645d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f31d expref: 23 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140867.987642:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094452680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960575797760:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140867.987745:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140868.001320:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140868.003337:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140868.005031:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140868.006566:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140868.006931:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.006978:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.012554:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.012609:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.012650:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.012666:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.012680:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.012700:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.012721:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573076480 00000100:00100000:0.0:1746140868.012728:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573076480 00000100:00100000:0.0:1746140868.012760:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573076608 00000100:00100000:0.0:1746140868.012762:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573076608 00000100:00100000:0.0:1746140868.012770:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573076736 00000100:00100000:0.0:1746140868.012772:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573076736 00000100:00100000:0.0:1746140868.012782:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573076992 00000100:00100000:0.0:1746140868.012783:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573076992 00000100:00100000:0.0:1746140868.013714:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15361 00000100:00100000:0.0:1746140868.013723:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573076608:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140868.013731:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.013741:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930e8800/0x8156357b7fdb64aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f339 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.013754:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.013756:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.013764:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930e8800/0x8156357b7fdb64aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f339 expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.013778:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930e8800/0x8156357b7fdb64aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f339 expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.013789:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930e8800, rc 0) 00000100:00100000:0.0:1746140868.013813:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573076608:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 93us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.013819:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15361 00000100:00100000:0.0:1746140868.013834:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15362 00000100:00100000:0.0:1746140868.013839:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573076736:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140868.013845:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.013854:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb64b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f340 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.013866:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.013867:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.013870:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb64b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f340 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.013881:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb64b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f340 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.013887:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930e9000, rc 0) 00000100:00100000:0.0:1746140868.013901:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573076736:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 62us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.013906:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15362 00000100:00100000:0.0:1746140868.013914:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15363 00000100:00100000:0.0:1746140868.013919:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009334b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573076864:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140868.013923:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.013928:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930e9a00/0x8156357b7fdb64b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f347 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.013942:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.013943:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.013947:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930e9a00/0x8156357b7fdb64b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f347 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.013955:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930e9a00/0x8156357b7fdb64b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f347 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.013961:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930e9a00, rc 0) 00000100:00100000:0.0:1746140868.013974:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009334b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573076864:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 55us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.013979:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15363 00000100:00100000:0.0:1746140868.013994:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15364 00000100:00100000:0.0:1746140868.013998:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573076992:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140868.014002:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.014009:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930e9c00/0x8156357b7fdb64bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f34e expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.014017:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.014018:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.014022:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930e9c00/0x8156357b7fdb64bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f34e expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.014030:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930e9c00/0x8156357b7fdb64bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f34e expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.014041:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930e9c00, rc 0) 00000100:00100000:0.0:1746140868.014053:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573076992:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 54us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.014057:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15364 00000100:00100000:0.0:1746140868.019408:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140868.026836:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140868.041432:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.042650:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.054239:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.054276:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.055100:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573079552 00000100:00100000:0.0:1746140868.055103:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573079552 00000100:00100000:0.0:1746140868.055128:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15368 00000100:00100000:0.0:1746140868.055132:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573079552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140868.055138:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.055146:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930e8200/0x8156357b7fdb6528 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f386 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.055155:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.055157:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.055164:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930e8200/0x8156357b7fdb6528 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f386 expref: 15 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.055177:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930e8200/0x8156357b7fdb6528 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f386 expref: 15 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.055189:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930e8200, rc 0) 00000100:00100000:0.0:1746140868.055210:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573079552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 78us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.055215:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15368 00000100:00100000:0.0:1746140868.055264:0:20524:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20524:1830960575798784:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140868.055280:0:20524:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.056945:0:20524:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.056951:0:20524:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.056973:0:20524:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.056978:0:20524:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.056984:0:20524:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.056988:0:20524:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0d44a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140868.056992:0:20524:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.056996:0:20524:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.057008:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140868.057011:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140868.057014:0:20524:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.057018:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d44a00/0x8156357b7fdb6513 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.057067:0:20524:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d45600/0x8156357b7fdb650c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f371 expref: 12 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.057074:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d45600/0x8156357b7fdb650c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f371 expref: 12 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.057081:0:20524:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d45600, rc 0) 00000100:00100000:0.0:1746140868.058663:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:31911:x1830960573079040:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5855us (5927us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140868.058669:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10384 00000100:00100000:0.0:1746140868.069301:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.069998:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.092868:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.098978:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.125499:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.132631:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.134620:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.144833:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.151224:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.151248:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573081472 00000100:00100000:0.0:1746140868.151254:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573081472 00002000:00100000:0.0:1746140868.151289:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a0:0x0] (315392->319487) req@ffff88012bf10700 x1830960573081472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:284/0 lens 488/0 e 0 to 0 dl 1746140879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.151297:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf10700 with x1830960573081472 ext(315392->319487) 00002000:00010000:0.0:1746140868.151302:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf10700 00000100:00100000:0.0:1746140868.151344:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7818 00000100:00100000:0.0:1746140868.151351:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573081472:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140868.151508:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573081472:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 157us (285us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140868.151514:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7818 00002000:00100000:0.0:1746140868.151519:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a0:0x0] (315392->319487) req@ffff88012bf10700 x1830960573081472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746140879 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.151525:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf10700 with x1830960573081472 ext(315392->319487) 00002000:00010000:0.0:1746140868.151528:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf10700 00000100:00100000:0.0:1746140868.156860:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.160424:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.165034:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.166034:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.166440:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.194868:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.231441:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.234486:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.239093:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.239149:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.243826:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.254139:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.256496:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.292632:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.297851:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.298300:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.298888:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.300767:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.304208:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.310040:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.327695:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.338120:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.338176:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.377782:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.378396:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.378429:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573086336 00000100:00100000:0.0:1746140868.378433:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573086336 00002000:00100000:0.0:1746140868.378451:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3645440->4194303) req@ffff8801355be680 x1830960573086336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:284/0 lens 488/0 e 0 to 0 dl 1746140879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.378458:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355be680 with x1830960573086336 ext(3645440->4194303) 00002000:00010000:0.0:1746140868.378461:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355be680 00000100:00100000:0.0:1746140868.378476:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7827 00000100:00100000:0.0:1746140868.378481:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1983:x1830960573086336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140868.395069:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.398106:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.404097:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.404366:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.408252:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.412489:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.413335:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.418400:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.418787:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.419908:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.419939:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.419953:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.419987:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.425121:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.433415:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.433454:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.433506:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.468208:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.472790:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.483737:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.486897:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.494832:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.494891:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.505772:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.513693:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.514445:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.521222:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573091328 00000100:00100000:0.0:1746140868.521233:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573091328 00002000:00100000:0.0:1746140868.521277:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a3:0x0] (2867200->2871295) req@ffff88009b890e00 x1830960573091328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:284/0 lens 488/0 e 0 to 0 dl 1746140879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.521286:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890e00 with x1830960573091328 ext(2867200->2871295) 00002000:00010000:0.0:1746140868.521291:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b890e00 00000100:00100000:0.0:1746140868.521337:0:21377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7835 00000100:00100000:0.0:1746140868.521344:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573091328:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140868.521527:0:21377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573091328:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 181us (956us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140868.521534:0:21377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7835 00002000:00100000:0.0:1746140868.521539:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a3:0x0] (2867200->2871295) req@ffff88009b890e00 x1830960573091328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:284/0 lens 488/4536 e 0 to 0 dl 1746140879 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.521546:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890e00 with x1830960573091328 ext(2867200->2871295) 00002000:00010000:0.0:1746140868.521549:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b890e00 00000100:00100000:0.0:1746140868.536027:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.537579:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.542576:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.542638:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.542664:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.545683:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573092224 00000100:00100000:0.0:1746140868.545688:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573092224 00000100:00100000:0.0:1746140868.545711:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573092480 00000100:00100000:0.0:1746140868.545713:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573092480 00000100:00100000:0.0:1746140868.545925:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15390 00000100:00100000:0.0:1746140868.545932:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573092224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140868.545941:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.545951:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d44800/0x8156357b7fdb6624 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f435 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.545970:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d44800/0x8156357b7fdb6624 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f435 expref: 22 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.545985:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d44800/0x8156357b7fdb6624 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f435 expref: 22 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.545998:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d44800, rc 0) 00000100:00100000:0.0:1746140868.546174:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573092224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 241us (1447us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140868.546179:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15390 00000100:00100000:0.0:1746140868.552355:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.554974:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575803776:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140868.554997:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee800/0x8156357b7fdb662b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f443 expref: 14 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.555011:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2ee800, rc 0) 00000100:00100000:0.0:1746140868.555052:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:31932:x1830960573092480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9000us (9609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.555059:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15391 00000100:00100000:0.0:1746140868.557256:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.558670:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.567947:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573093120:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8972us (9266us total) trans 17179873779 rc 0/0 00000100:00100000:0.0:1746140868.567959:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1599 00002000:00100000:0.0:1746140868.567969:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2228223) req@ffff8800a6bafb80 x1830960573093120/t17179873779(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:284/0 lens 488/448 e 0 to 0 dl 1746140879 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.567984:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bafb80 with x1830960573093120 ext(2097152->2228223) 00010000:00010000:0.0:1746140868.567993:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f1dd600/0x8156357b7fdb6608 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f420 expref: 27 pid: 4785 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.568006:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f1dd600/0x8156357b7fdb6608 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f420 expref: 27 pid: 4785 timeout: 947 lvb_type: 0 00002000:00010000:0.0:1746140868.568012:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6bafb80 00000100:00100000:0.0:1746140868.568364:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573093248 00000100:00100000:0.0:1746140868.568372:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573093248 00002000:00100000:0.0:1746140868.568414:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a7:0x0] (1609728->2097151) req@ffff880135b64700 x1830960573093248/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:284/0 lens 488/0 e 0 to 0 dl 1746140879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.568421:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64700 with x1830960573093248 ext(1609728->2097151) 00010000:00010000:0.0:1746140868.568428:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f1dd800/0x8156357b7fdb65ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f3d3 expref: 14 pid: 4785 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.568437:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f1dd800/0x8156357b7fdb65ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f3d3 expref: 14 pid: 4785 timeout: 947 lvb_type: 0 00002000:00010000:0.0:1746140868.568443:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b64700 00000100:00100000:0.0:1746140868.568890:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1600 00000100:00100000:0.0:1746140868.568897:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573093248:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140868.571046:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.583757:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.593661:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.601869:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.601906:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.607571:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573094528 00000100:00100000:0.0:1746140868.607580:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573094528 00002000:00100000:0.0:1746140868.607794:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4751359) req@ffff880129e0c000 x1830960573094528/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:284/0 lens 488/0 e 0 to 0 dl 1746140879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.607804:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0c000 with x1830960573094528 ext(4194304->4751359) 00002000:00010000:0.0:1746140868.607809:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0c000 00000100:00100000:0.0:1746140868.607840:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7839 00000100:00100000:0.0:1746140868.607846:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960573094528:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140868.610338:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.624788:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.625518:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.625541:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.630833:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573095552 00000100:00100000:0.0:1746140868.630844:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573095552 00000100:00100000:0.0:1746140868.630900:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15398 00000100:00100000:0.0:1746140868.630908:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573095552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140868.630923:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.630942:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4922600/0x8156357b7fdb665c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f474 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.630970:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4922600/0x8156357b7fdb665c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f474 expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.630979:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4922600/0x8156357b7fdb665c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f474 expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.631012:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4922600, rc 0) 00000100:00100000:0.0:1746140868.631065:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573095552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 158us (562us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140868.631071:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15398 00000100:00100000:0.0:1746140868.659817:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.659864:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.665826:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.669653:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.683131:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.696726:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.696758:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.696774:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.696797:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573097088 00000100:00100000:0.0:1746140868.696805:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573097088 00002000:00100000:0.0:1746140868.696842:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880099f57100 x1830960573097088/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:284/0 lens 488/0 e 0 to 0 dl 1746140879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.696850:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f57100 with x1830960573097088 ext(3145728->4194303) 00002000:00010000:0.0:1746140868.696855:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099f57100 00000100:00100000:0.0:1746140868.696869:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573096448 00000100:00100000:0.0:1746140868.696871:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573096448 00002000:00100000:0.0:1746140868.696888:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099f57480 x1830960573096448/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:284/0 lens 488/0 e 0 to 0 dl 1746140879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.696895:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f57480 with x1830960573096448 ext(2097152->3145727) 00002000:00010000:0.0:1746140868.696898:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f57480 00000100:00100000:0.0:1746140868.696918:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573096576 00000100:00100000:0.0:1746140868.696921:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573096576 00002000:00100000:0.0:1746140868.696934:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880099f57800 x1830960573096576/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:284/0 lens 488/0 e 0 to 0 dl 1746140879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.696940:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f57800 with x1830960573096576 ext(3145728->4194303) 00002000:00010000:0.0:1746140868.696942:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f57800 00000100:00100000:0.0:1746140868.696952:0:21377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7842 00000100:00100000:0.0:1746140868.696957:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573096448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140868.728914:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573096960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 31040us (31334us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140868.728926:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7844 00002000:00100000:0.0:1746140868.728937:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b893800 x1830960573096960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:284/0 lens 488/440 e 0 to 0 dl 1746140879 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140868.728947:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893800 with x1830960573096960 ext(2097152->3145727) 00002000:00010000:0.0:1746140868.728952:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b893800 00000100:00100000:0.0:1746140868.746742:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.783620:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.788997:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.789415:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.789433:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573097856 00000100:00100000:0.0:1746140868.789436:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573097856 00010000:00010000:0.0:1746140868.789451:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x8156357b7fdb6601 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f419 expref: 12 pid: 20960 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140868.789468:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7947 00000100:00100000:0.0:1746140868.789472:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573097856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.789481:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.789491:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x8156357b7fdb6601 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f419 expref: 12 pid: 20960 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.789499:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x8156357b7fdb6601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f419 expref: 12 pid: 20960 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.789510:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x8156357b7fdb6601 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f419 expref: 12 pid: 20960 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.789535:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.789537:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.789544:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943ad600/0x8156357b7fdb6678 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3391487) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f490 expref: 23 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.789551:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943ad600/0x8156357b7fdb6678 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3391487) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f490 expref: 23 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.789581:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800943ad600/0x8156357b7fdb6678 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3391487) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f490 expref: 23 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140868.789592:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575805056:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140868.789641:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538180 going to sleep for 11 seconds 00000100:00100000:0.0:1746140868.790891:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.794927:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.822633:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.827036:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.827215:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.830437:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.837063:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.841229:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.841817:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.846161:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.857588:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.861379:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.861416:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.864366:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.864417:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.867477:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.867513:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.867536:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.867552:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.867581:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.867780:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15407 00000100:00100000:0.0:1746140868.867785:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573100672:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140868.867792:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.867799:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c3ec00/0x8156357b7fdb66b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f4ac expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140868.867821:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960575806464:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140868.868833:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140868.873433:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.876867:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.880524:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.880563:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.880606:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.885207:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.886845:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.887598:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.887852:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.887883:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.888153:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.888538:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.889162:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573102976 00000100:00100000:0.0:1746140868.889166:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573102976 00000100:00100000:0.0:1746140868.889192:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15418 00000100:00100000:0.0:1746140868.889198:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573102976:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746140868.889214:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.889226:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee800/0x8156357b7fdb662b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f443 expref: 17 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.889234:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54c4600/0x8156357b7fdb66c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f4c8 expref: 9 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.889240:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb6663 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f482 expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.889244:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.889245:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.889247:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.889265:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb6663 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f482 expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.889272:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb6663 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f482 expref: 26 pid: 24958 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746140868.889280:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575808128:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140868.889324:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54c4600/0x8156357b7fdb66c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f4c8 expref: 9 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.889332:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54c4600/0x8156357b7fdb66c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f4c8 expref: 9 pid: 4785 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746140868.889339:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575808256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140868.889357:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee800/0x8156357b7fdb662b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f443 expref: 17 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.889364:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee800/0x8156357b7fdb662b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f443 expref: 17 pid: 8459 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140868.889370:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575808384:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140868.889380:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140868.889526:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.895408:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575808512:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140868.895425:0:8460:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140868.897200:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.897232:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.897251:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.900360:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.900383:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.900409:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573103616 00000100:00100000:0.0:1746140868.900415:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573103616 00010000:00010000:0.0:1746140868.900440:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008feef400/0x8156357b7fdb6647 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f45f expref: 27 pid: 8459 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140868.900463:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7958 00000100:00100000:0.0:1746140868.900468:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573103616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.900478:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.900621:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008feef400/0x8156357b7fdb6647 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f45f expref: 27 pid: 8459 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.900632:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008feef400/0x8156357b7fdb6647 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f45f expref: 27 pid: 8459 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.900648:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008feef400/0x8156357b7fdb6647 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f45f expref: 27 pid: 8459 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.900793:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140868.901024:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573103616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 554us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.901031:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7958 00000100:00100000:0.0:1746140868.901065:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.901078:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573104000 00000100:00100000:0.0:1746140868.901080:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573104000 00010000:00010000:0.0:1746140868.901092:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54c4600/0x8156357b7fdb66c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f4c8 expref: 9 pid: 4785 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746140868.901113:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7959 00000100:00100000:0.0:1746140868.901118:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573104000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.901124:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.901135:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54c4600/0x8156357b7fdb66c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f4c8 expref: 9 pid: 4785 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901142:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54c4600/0x8156357b7fdb66c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f4c8 expref: 9 pid: 4785 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901152:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54c4600/0x8156357b7fdb66c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f4c8 expref: 9 pid: 4785 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901161:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140868.901175:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573104000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.901180:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7959 00000100:00100000:0.0:1746140868.901219:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.901259:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.901274:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573103232 00000100:00100000:0.0:1746140868.901277:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573103232 00010000:00010000:0.0:1746140868.901288:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948cb600/0x8156357b7fdb6655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f466 expref: 18 pid: 20960 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746140868.901301:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7960 00000100:00100000:0.0:1746140868.901323:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573103232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.901329:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.901336:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948cb600/0x8156357b7fdb6655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f466 expref: 18 pid: 20960 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901344:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948cb600/0x8156357b7fdb6655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f466 expref: 18 pid: 20960 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901354:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948cb600/0x8156357b7fdb6655 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f466 expref: 18 pid: 20960 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901363:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.901365:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.901368:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdb6712 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901376:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdb6712 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901411:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140868.901426:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573103232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 104us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.901432:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7960 00000100:00100000:0.0:1746140868.901462:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.901471:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573103744 00000100:00100000:0.0:1746140868.901474:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573103744 00010000:00010000:0.0:1746140868.901483:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094958200/0x8156357b7fdb63ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2a6 expref: 24 pid: 12255 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140868.901497:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7961 00000100:00100000:0.0:1746140868.901502:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573103744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.901510:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.901519:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094958200/0x8156357b7fdb63ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2a6 expref: 24 pid: 12255 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.901527:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094958200/0x8156357b7fdb63ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2a6 expref: 24 pid: 12255 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.901538:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094958200/0x8156357b7fdb63ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f2a6 expref: 24 pid: 12255 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.901548:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.901549:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.901552:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090544e00/0x8156357b7fdb6720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901558:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090544e00/0x8156357b7fdb6720 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901570:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140868.901584:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573103744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.901590:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7961 00000100:00100000:0.0:1746140868.901619:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.901628:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573104256 00000100:00100000:0.0:1746140868.901630:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573104256 00010000:00010000:0.0:1746140868.901638:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb6663 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f482 expref: 26 pid: 24958 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746140868.901651:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7962 00000100:00100000:0.0:1746140868.901656:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573104256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.901662:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.901668:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb6663 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f482 expref: 26 pid: 24958 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901675:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb6663 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f482 expref: 26 pid: 24958 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901685:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb6663 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f482 expref: 26 pid: 24958 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746140868.901693:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140868.901705:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573104256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.901711:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7962 00000100:00100000:0.0:1746140868.901749:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.901759:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573104512 00000100:00100000:0.0:1746140868.901762:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573104512 00010000:00010000:0.0:1746140868.901771:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee800/0x8156357b7fdb662b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f443 expref: 17 pid: 8459 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140868.901781:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7963 00000100:00100000:0.0:1746140868.901785:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573104512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.901791:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.901798:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee800/0x8156357b7fdb662b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f443 expref: 17 pid: 8459 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.901805:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee800/0x8156357b7fdb662b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f443 expref: 17 pid: 8459 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.901820:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee800/0x8156357b7fdb662b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f443 expref: 17 pid: 8459 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.901828:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.901829:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.901832:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901837:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901850:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140868.901862:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573104512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.901867:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7963 00010000:00010000:0.0:1746140868.901883:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901891:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901907:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901915:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901922:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901928:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131c3f200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140868.901932:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901938:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901947:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.901951:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c3f200/0x8156357b7fdb6727 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140868.901988:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573102976:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12790us (13450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.901995:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15418 00010000:00010000:0.0:1746140868.915804:0:8460:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.915818:0:8460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.915836:0:8460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.915847:0:8460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.915853:0:8460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.915860:0:8460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ffba00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140868.915863:0:8460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.915870:0:8460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.915886:0:8460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.915898:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb672e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140868.916280:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+5:1985:x1830960573102464:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 27184us (28395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.916288:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15416 00000100:00100000:0.0:1746140868.918485:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.922064:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.922127:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.922147:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573105280 00000100:00100000:0.0:1746140868.922153:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573105280 00010000:00010000:0.0:1746140868.922179:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dc800/0x8156357b7fdb6203 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f18e expref: 289 pid: 27790 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140868.922206:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573105408 00000100:00100000:0.0:1746140868.922208:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573105408 00010000:00010000:0.0:1746140868.922214:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093818e00/0x8156357b7fdb61e0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f187 expref: 22 pid: 14741 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140868.922226:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7967 00000100:00100000:0.0:1746140868.922232:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:1984:x1830960573105280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.922243:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.922247:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dc800/0x8156357b7fdb6203 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f18e expref: 289 pid: 27790 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.922257:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dc800/0x8156357b7fdb6203 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f18e expref: 289 pid: 27790 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.922277:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140868.922283:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5e00/0x8156357b7fdb6735 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.922292:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140868.922334:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:1984:x1830960573105280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.922650:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7967 00000100:00100000:0.0:1746140868.923196:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.925353:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.925394:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.925433:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.925507:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.925524:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573106048 00000100:00100000:0.0:1746140868.925701:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573106048 00010000:00010000:0.0:1746140868.925720:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800902dac00/0x8156357b7fdb6177 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f148 expref: 23 pid: 27790 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746140868.925753:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7969 00000100:00100000:0.0:1746140868.925758:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:1984:x1830960573106176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140868.925766:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140868.925773:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3bb800/0x8156357b7fdb6170 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f141 expref: 290 pid: 14743 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.925783:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3bb800/0x8156357b7fdb6170 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f141 expref: 290 pid: 14743 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.925804:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3bb800/0x8156357b7fdb6170 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f141 expref: 290 pid: 14743 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746140868.925833:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140868.925838:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5e00/0x8156357b7fdb6735 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140868.925845:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140868.926225:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:1984:x1830960573106176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 464us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.926231:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7969 00000100:00100000:0.0:1746140868.926942:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.928615:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.963864:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575809664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140868.963910:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140868.963944:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575810176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140868.963956:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140868.963967:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746140868.963971:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575809792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140868.963983:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140868.963991:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575810304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140868.964002:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140868.964020:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575809664 00000100:00100000:0.0:1746140868.964027:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575809664 00000100:00100000:0.0:1746140868.964058:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575810176 00000100:00100000:0.0:1746140868.964059:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575810176 00000100:00100000:0.0:1746140868.964067:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575809792 00000100:00100000:0.0:1746140868.964068:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575809792 00000100:00100000:0.0:1746140868.964076:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575810304 00000100:00100000:0.0:1746140868.964077:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575810304 00000100:00100000:0.0:1746140868.964087:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15419 00000100:00100000:0.0:1746140868.964091:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1830960575809664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140868.964272:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3310:x1830960575809664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (361us total) trans 21474841044 rc 0/0 00000100:00100000:0.0:1746140868.964278:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15419 00000100:00100000:0.0:1746140868.964288:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575809920 00000100:00100000:0.0:1746140868.964291:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575809920 00000100:00100000:0.0:1746140868.964302:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575810432 00000100:00100000:0.0:1746140868.964323:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575810432 00000100:00100000:0.0:1746140868.964335:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575809536 00000100:00100000:0.0:1746140868.964337:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575809536 00000100:00100000:0.0:1746140868.964345:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15420 00000100:00100000:0.0:1746140868.964349:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3310:x1830960575810176:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746140868.966759:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746140868.966763:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746140868.966793:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc09880/2, rc 0, transno 21474841046 00000100:00100000:0.0:1746140868.966797:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575809792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140868.966805:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172680/2, rc 0, transno 21474841047 00000100:00100000:0.0:1746140868.966807:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575810304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140868.966814:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc0bb80/2, rc 0, transno 21474841044 00000100:00100000:0.0:1746140868.966817:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575809664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140868.966870:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3310:x1830960575810176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2520us (2913us total) trans 21474841045 rc 0/0 00000100:00100000:0.0:1746140868.966875:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15420 00000004:00080000:0.0:1746140868.966894:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172a00/2, rc 0, transno 21474841045 00000100:00100000:0.0:1746140868.966897:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575810176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140868.967377:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.969631:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575811584 00000100:00100000:0.0:1746140868.969638:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575811584 00000100:00100000:0.0:1746140868.969664:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15435 00000100:00100000:0.0:1746140868.969669:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3313:x1830960575811584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140868.969866:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3313:x1830960575811584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (654us total) trans 21474841052 rc 0/0 00000100:00100000:0.0:1746140868.969872:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15435 00000100:00100000:0.0:1746140868.970362:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.973134:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.973180:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.973211:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.973224:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.973238:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.973300:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.973361:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573106944 00000100:00100000:0.0:1746140868.973367:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573106944 00000100:00100000:0.0:1746140868.973408:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573107200 00000100:00100000:0.0:1746140868.973410:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573107200 00000100:00100000:0.0:1746140868.973423:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573107456 00000100:00100000:0.0:1746140868.973424:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573107456 00000100:00100000:0.0:1746140868.973433:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573107072 00000100:00100000:0.0:1746140868.973435:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573107072 00000100:00100000:0.0:1746140868.973443:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573107328 00000100:00100000:0.0:1746140868.973444:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573107328 00000100:00100000:0.0:1746140868.973453:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573107584 00000100:00100000:0.0:1746140868.973454:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573107584 00000100:00100000:0.0:1746140868.973466:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15436 00000100:00100000:0.0:1746140868.973471:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573106944:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140868.973490:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.973506:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a699600/0x8156357b7fdb6751 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f500 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140868.973529:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fec5, atime: 0x6813fec4, ctime: 0x6813fec5, blocks: 0x807 00010000:00010000:0.0:1746140868.973543:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.973545:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.973554:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a699600/0x8156357b7fdb6751 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f500 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.973569:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a699600/0x8156357b7fdb6751 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f500 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.973578:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a699600, rc 0) 00000100:00100000:0.0:1746140868.973610:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573106944:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 139us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.973615:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15436 00000100:00100000:0.0:1746140868.973629:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15437 00000100:00100000:0.0:1746140868.973633:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573107200:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140868.973640:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.973651:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a698800/0x8156357b7fdb6758 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f50e expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140868.973664:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fec5, atime: 0x6813fec5, ctime: 0x6813fec5, blocks: 0x81d 00010000:00010000:0.0:1746140868.973671:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.973672:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.973676:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a698800/0x8156357b7fdb6758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f50e expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.973687:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a698800/0x8156357b7fdb6758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f50e expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.973692:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a698800, rc 0) 00000100:00100000:0.0:1746140868.973707:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573107200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 75us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.973711:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15437 00000100:00100000:0.0:1746140868.973720:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15438 00000100:00100000:0.0:1746140868.973724:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573107456:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140868.973729:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.973735:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e4a4800/0x8156357b7fdb675f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f51c expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140868.973746:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4747392, mtime: 0x6813fec5, atime: 0x6813fec5, ctime: 0x6813fec5, blocks: 0x1481 00010000:00010000:0.0:1746140868.973754:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.973755:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.973759:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4a4800/0x8156357b7fdb675f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f51c expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.973768:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e4a4800/0x8156357b7fdb675f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f51c expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.973774:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e4a4800, rc 0) 00000100:00100000:0.0:1746140868.973789:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573107456:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 64us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.973795:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15438 00000100:00100000:0.0:1746140868.973805:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15440 00000100:00100000:0.0:1746140868.973809:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573107328:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140868.973814:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140868.973820:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e4a4200/0x8156357b7fdb676d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f515 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140868.973830:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fec4, atime: 0x6813fec4, ctime: 0x6813fec3, blocks: 0x81f 00010000:00010000:0.0:1746140868.973836:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.973838:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.973842:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4a4200/0x8156357b7fdb676d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f515 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.973850:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e4a4200/0x8156357b7fdb676d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f515 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140868.973855:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e4a4200, rc 0) 00000100:00100000:0.0:1746140868.973869:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573107328:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 61us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140868.973874:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15440 00000100:00100000:0.0:1746140868.985548:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.987771:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.987810:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.987886:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.987910:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573108352 00000100:00100000:0.0:1746140868.987915:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573108352 00000100:00100000:0.0:1746140868.987963:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573108608 00000100:00100000:0.0:1746140868.987966:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573108608 00000100:00100000:0.0:1746140868.987986:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7851 00000100:00100000:0.0:1746140868.987992:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573108352:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140868.988021:0:32428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.988034:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.988035:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.988039:0:32428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.988050:0:32428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140868.991905:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.994268:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.995512:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.995544:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140868.995670:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7854 00000100:00100000:0.0:1746140868.995679:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573109120:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140868.995710:0:32429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb679e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.995722:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.995724:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140868.995728:0:32429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb679e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140868.995740:0:32429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb679e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.002567:0:32428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.002574:0:32428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.002579:0:32428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.002584:0:32428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e426800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140869.002587:0:32428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.002594:0:32428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.002606:0:32428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.002613:0:32428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e426800/0x8156357b7fdb6782 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140869.002675:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573108352:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 14682us (14863us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140869.002687:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7851 00000100:00100000:0.0:1746140869.028663:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.031530:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.031557:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.031576:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.031588:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.031601:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.031618:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140869.032252:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746140869.032259:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746140869.035133:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.037219:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00010000:0.0:1746140869.064587:0:21104:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fc35c00 reply state ffff880093b00c00 transno 8589944601 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdb67ba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00000100:00100000:0.0:1746140869.064600:0:21104:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746140869.064610:0:21104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f3ee000) 00010000:00010000:0.0:1746140869.064613:0:21104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140869.064621:0:21104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54c5400/0x8156357b7fdb66fd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f4eb expref: 9 pid: 20524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140869.064737:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:31950:x1830960573110912:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 29389us (29608us total) trans 8589944601 rc 0/0 00000100:00100000:0.0:1746140869.064746:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4489 00000100:00100000:0.0:1746140869.065155:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575811840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.065200:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.065228:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746140869.065233:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575811968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.065247:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.065268:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575811840 00000100:00100000:0.0:1746140869.065275:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575811840 00000100:00100000:0.0:1746140869.065300:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575811968 00000100:00100000:0.0:1746140869.065302:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575811968 00000100:00100000:0.0:1746140869.065332:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15448 00000100:00100000:0.0:1746140869.065338:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3310:x1830960575811840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140869.065514:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140869.065517:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.065520:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.065521:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.065523:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746140869.065546:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3310:x1830960575811840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (346us total) trans 21474841056 rc 0/0 00000100:00100000:0.0:1746140869.065552:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15448 00000100:00100000:0.0:1746140869.065564:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15449 00000100:00100000:0.0:1746140869.065569:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3310:x1830960575811968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140869.065639:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140869.065641:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.065643:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.065644:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.065646:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140869.065662:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3310:x1830960575811968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (413us total) trans 21474841057 rc 0/0 00000100:00100000:0.0:1746140869.065667:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15449 00000004:00080000:0.0:1746140869.065695:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f2c1c00/2, rc 0, transno 21474841057 00000100:00100000:0.0:1746140869.065699:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575811968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.065704:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f2c0000/2, rc 0, transno 21474841056 00000100:00100000:0.0:1746140869.065707:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575811840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.068176:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15457 00000100:00100000:0.0:1746140869.068182:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3311:x1830960575813504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.068489:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3311:x1830960575813504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 308us (1538us total) trans 17179873795 rc 0/0 00000100:00100000:0.0:1746140869.068497:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15457 00000100:00100000:0.0:1746140869.068617:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.068649:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575813248 00000100:00100000:0.0:1746140869.068651:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575813248 00000100:00100000:0.0:1746140869.068666:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575813760 00000100:00100000:0.0:1746140869.068668:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575813760 00000100:00100000:0.0:1746140869.068677:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15460 00000100:00100000:0.0:1746140869.068680:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3313:x1830960575813248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140869.068750:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140869.068752:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.068754:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.068756:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.068757:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140869.068777:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3313:x1830960575813248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (165us total) trans 17179873798 rc 0/0 00000100:00100000:0.0:1746140869.068782:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15460 00000100:00100000:0.0:1746140869.068792:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15462 00000100:00100000:0.0:1746140869.068796:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3313:x1830960575813120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140869.068866:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140869.068868:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.068870:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.068872:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.068873:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746140869.068891:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3313:x1830960575813120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (211us total) trans 17179873800 rc 0/0 00000100:00100000:0.0:1746140869.068896:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15462 00000100:00100000:0.0:1746140869.088675:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.090755:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.092337:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.105024:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140869.105689:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140869.108081:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.108340:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15466 00000100:00100000:0.0:1746140869.108352:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:31963:x1830960573112704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140869.108921:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.108937:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb683f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f554 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.108959:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.108961:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.108968:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb683f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f554 expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.108980:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb683f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f554 expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.108994:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1600, rc 0) 00000100:00100000:0.0:1746140869.109621:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:31963:x1830960573112704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1270us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.109630:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15466 00000100:00100000:0.0:1746140869.109873:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.117004:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.127027:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.142161:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.143850:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573114112 00000100:00100000:0.0:1746140869.143858:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573114112 00000100:00100000:0.0:1746140869.143901:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15469 00000100:00100000:0.0:1746140869.143909:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:31962:x1830960573114112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140869.143924:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.143942:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093cd2e00/0x8156357b7fdb6854 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f569 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.143967:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.143969:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.143978:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093cd2e00/0x8156357b7fdb6854 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f569 expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.143995:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093cd2e00/0x8156357b7fdb6854 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f569 expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.144007:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093cd2e00, rc 0) 00000100:00100000:0.0:1746140869.144069:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:31962:x1830960573114112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 158us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.144076:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15469 00000100:00100000:0.0:1746140869.152692:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.165700:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.172989:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.179911:0:14739:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575814144 00000100:00100000:0.0:1746140869.179920:0:14739:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575814144 00000100:00100000:0.0:1746140869.179961:0:14739:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1746140869.179969:0:14739:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3312:x1830960575814144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140869.180030:0:14739:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3312:x1830960575814144:12345-0@lo:400:kworker.0 Request processed in 62us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.180036:0:14739:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1746140869.180267:0:20524:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575814272 00000100:00100000:0.0:1746140869.180270:0:20524:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575814272 00000100:00100000:0.0:1746140869.180301:0:20524:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1746140869.180322:0:20524:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1830960575814272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140869.180351:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1830960575814272:12345-0@lo:400:kworker.0 Request processed in 30us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.180355:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1746140869.182792:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.185359:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.187371:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573115264 00000100:00100000:0.0:1746140869.187379:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573115264 00000100:00100000:0.0:1746140869.188021:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10402 00000100:00100000:0.0:1746140869.188032:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:31962:x1830960573115264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140869.188048:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.188063:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4d600/0x8156357b7fdb6877 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f585 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.188112:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfb000/0x8156357b7fdb6870 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140869.188122:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4d600/0x8156357b7fdb6877 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f585 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.188139:0:27790:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfb000/0x8156357b7fdb6870 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140869.188151:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4d600/0x8156357b7fdb6877 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f585 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.188163:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008d152800) 00010000:00010000:0.0:1746140869.188166:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140869.188169:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfb000/0x8156357b7fdb6870 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140869.188176:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4d600, rc 0) 00000100:00100000:0.0:1746140869.188563:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:31962:x1830960573115264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 530us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.188570:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10402 00000100:00100000:0.0:1746140869.189413:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.189674:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.189701:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.189786:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.194371:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573115904 00000100:00100000:0.0:1746140869.194380:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573115904 00000100:00100000:0.0:1746140869.194435:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10403 00000100:00100000:0.0:1746140869.194442:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:31963:x1830960573115904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140869.194460:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.194476:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4d400/0x8156357b7fdb6885 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f593 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.194532:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4d400/0x8156357b7fdb6885 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f593 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.194543:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4d400/0x8156357b7fdb6885 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f593 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.194553:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008d152800) 00010000:00010000:0.0:1746140869.194556:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140869.194559:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4d600/0x8156357b7fdb6877 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f585 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.194564:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4d400, rc 0) 00000100:00100000:0.0:1746140869.195212:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:31963:x1830960573115904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 765us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.195220:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10403 00000100:00100000:0.0:1746140869.197591:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575815040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746140869.226648:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575816448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.226674:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.226692:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575816960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.226709:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.226722:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575817472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.226740:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.226755:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746140869.226760:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575816832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.226775:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.226795:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575817344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.226810:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.226830:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575817088 00000100:00100000:0.0:1746140869.226833:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575817088 00000100:00100000:0.0:1746140869.226848:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575817216 00000100:00100000:0.0:1746140869.226849:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575817216 00000100:00100000:0.0:1746140869.226857:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575817344 00000100:00100000:0.0:1746140869.226859:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575817344 00000100:00100000:0.0:1746140869.226881:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15483 00000100:00100000:0.0:1746140869.226885:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3313:x1830960575816960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.226991:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3313:x1830960575816960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (280us total) trans 17179873802 rc 0/0 00000100:00100000:0.0:1746140869.226995:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15483 00000100:00100000:0.0:1746140869.227005:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15486 00000100:00100000:0.0:1746140869.227008:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009334b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3310:x1830960575817216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.227032:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15487 00000100:00100000:0.0:1746140869.227036:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3313:x1830960575817472:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.227069:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece2a00/2, rc 0, transno 21474841073 00000100:00100000:0.0:1746140869.227073:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575816448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.227081:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ce300/2, rc 0, transno 17179873802 00000100:00100000:0.0:1746140869.227084:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575816960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.227716:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009334b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960575817216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 706us (957us total) trans 17179873806 rc 0/0 00000100:00100000:0.0:1746140869.227723:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15486 00002000:00010000:0.0:1746140869.227997:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140869.228000:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.228002:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.228004:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140869 -> 1746140869 00002000:00010000:0.0:1746140869.228005:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140869.228467:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3313:x1830960575816832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1409us (1690us total) trans 17179873808 rc 0/0 00000100:00100000:0.0:1746140869.228472:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15488 00000004:00080000:0.0:1746140869.228497:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e4e680/2, rc 0, transno 17179873808 00000100:00100000:0.0:1746140869.228500:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575816832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.228637:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135698700/2, rc 0, transno 17179873809 00000100:00100000:0.0:1746140869.228640:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575817344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.228645:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135699180/2, rc 0, transno 17179873807 00000100:00100000:0.0:1746140869.228647:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575817472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.228993:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.229256:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.244142:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.244178:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.244266:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.244507:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7979 00000100:00100000:0.0:1746140869.244514:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573117184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.244519:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.244532:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4800/0x8156357b7fdb6766 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f507 expref: 11 pid: 32376 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746140869.244644:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4800/0x8156357b7fdb6766 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f507 expref: 11 pid: 32376 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746140869.244668:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.244706:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573117184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 192us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.244715:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7979 00000100:00100000:0.0:1746140869.249701:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.256095:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.258047:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.258301:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.259147:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.259963:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.260000:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.261236:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.261729:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.261742:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.261764:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.261778:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573118336 00000100:00100000:0.0:1746140869.261781:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573118336 00010000:00010000:0.0:1746140869.261797:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a698800/0x8156357b7fdb6758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f50e expref: 10 pid: 24958 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746140869.261810:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573118208 00000100:00100000:0.0:1746140869.261812:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573118208 00010000:00010000:0.0:1746140869.261820:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b5cd600/0x8156357b7fdb685b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f570 expref: 21 pid: 32376 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.267615:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.272664:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.272701:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.272726:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.272751:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.272764:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.272796:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.273292:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7870 00000100:00100000:0.0:1746140869.273300:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573119744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140869.273494:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.273572:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.273583:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.273604:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.273617:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573120512 00000100:00100000:0.0:1746140869.273620:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573120512 00002000:00100000:0.0:1746140869.273634:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a513ea00 x1830960573120512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:285/0 lens 488/0 e 0 to 0 dl 1746140880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140869.273641:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ea00 with x1830960573120512 ext(3145728->4194303) 00002000:00010000:0.0:1746140869.273644:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513ea00 00000100:00100000:0.0:1746140869.273651:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7872 00000100:00100000:0.0:1746140869.273656:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573121024:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140869.275746:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.295044:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.304921:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.307586:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.308143:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.308156:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.308512:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15502 00000100:00100000:0.0:1746140869.308520:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573122816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140869.308527:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.308535:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a519c600/0x8156357b7fdb68e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f5ee expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140869.308559:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575819776:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140869.308580:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140869.315173:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.315263:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.332518:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.332560:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.332585:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.332624:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.338812:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.338849:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.338879:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.338926:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.346849:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.347889:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.362927:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.367043:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.367078:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.367100:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.367344:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15512 00000100:00100000:0.0:1746140869.367351:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573125248:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140869.367358:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.367366:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x8156357b7fdb6942 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f63b expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140869.367412:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575820928:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140869.367478:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140869.371940:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099496300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575821184:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140869.371958:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a519cc00/0x8156357b7fdb6949 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f642 expref: 11 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.371965:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a519cc00/0x8156357b7fdb6949 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f642 expref: 11 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.371985:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a519cc00, rc 0) 00000100:00100000:0.0:1746140869.372033:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573125376:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4487us (4931us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140869.372040:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15513 00000100:00100000:0.0:1746140869.375496:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.379041:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.388226:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573126016 00000100:00100000:0.0:1746140869.388233:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573126016 00010000:00010000:0.0:1746140869.388263:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec30000/0x8156357b7fdb6957 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f649 expref: 10 pid: 27790 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.388295:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7988 00000100:00100000:0.0:1746140869.388325:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573126016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.388337:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.388343:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec30000/0x8156357b7fdb6957 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f649 expref: 10 pid: 27790 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.388352:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec30000/0x8156357b7fdb6957 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f649 expref: 10 pid: 27790 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.388371:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec30000/0x8156357b7fdb6957 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f649 expref: 10 pid: 27790 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.388385:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008d152800) 00010000:00010000:0.0:1746140869.388401:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922600/0x8156357b7fdb696c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.388409:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922600/0x8156357b7fdb696c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.388415:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922600/0x8156357b7fdb696c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.388432:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.388473:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573126016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 171us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.388479:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7988 00000100:00100000:0.0:1746140869.392242:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.392285:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.392370:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.401212:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.403448:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15519 00000100:00100000:0.0:1746140869.403456:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573127168:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746140869.403474:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb69ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.403483:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d7ad600/0x8156357b7fdb68c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5d2 expref: 13 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.403488:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140869.403490:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140869.403492:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb69ab lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.403507:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d7ad600/0x8156357b7fdb68c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5d2 expref: 13 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.403515:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d7ad600/0x8156357b7fdb68c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5d2 expref: 13 pid: 4784 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.403523:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575822208:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140869.403563:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.403608:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.404758:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140869.410054:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.410073:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.410086:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.410110:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573128192 00000100:00100000:0.0:1746140869.410118:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573128192 00002000:00100000:0.0:1746140869.410160:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3a7:0x0] (1630208->2097151) req@ffff8801359b2680 x1830960573128192/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:285/0 lens 488/0 e 0 to 0 dl 1746140880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140869.410170:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b2680 with x1830960573128192 ext(1630208->2097151) 00010000:00010000:0.0:1746140869.410179:0:21377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800930e9a00/0x8156357b7fdb688c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f59a expref: 28 pid: 4186 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.410192:0:21377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800930e9a00/0x8156357b7fdb688c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f59a expref: 28 pid: 4186 timeout: 948 lvb_type: 0 00002000:00010000:0.0:1746140869.410199:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801359b2680 00000100:00100000:0.0:1746140869.410213:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573127680 00000100:00100000:0.0:1746140869.410215:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573127680 00002000:00100000:0.0:1746140869.410225:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3a8:0x0] (1765376->2097151) req@ffff88009f170000 x1830960573127680/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:285/0 lens 488/0 e 0 to 0 dl 1746140880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140869.410231:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170000 with x1830960573127680 ext(1765376->2097151) 00010000:00010000:0.0:1746140869.410236:0:21377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4923c00/0x8156357b7fdb68bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1765376->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5cb expref: 19 pid: 8460 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.410244:0:21377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4923c00/0x8156357b7fdb68bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1765376->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5cb expref: 19 pid: 8460 timeout: 948 lvb_type: 0 00002000:00010000:0.0:1746140869.410249:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f170000 00000100:00100000:0.0:1746140869.410257:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573127552 00000100:00100000:0.0:1746140869.410258:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573127552 00002000:00100000:0.0:1746140869.410269:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1605631) req@ffff88009f173b80 x1830960573127552/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:285/0 lens 488/0 e 0 to 0 dl 1746140880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140869.410275:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173b80 with x1830960573127552 ext(1048576->1605631) 00010000:00010000:0.0:1746140869.410281:0:21377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d7ad600/0x8156357b7fdb68c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5d2 expref: 14 pid: 4784 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.410289:0:21377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d7ad600/0x8156357b7fdb68c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5d2 expref: 14 pid: 4784 timeout: 948 lvb_type: 0 00002000:00010000:0.0:1746140869.410294:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f173b80 00000100:00100000:0.0:1746140869.410332:0:21377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1606 00000100:00100000:0.0:1746140869.410339:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573128192:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140869.410810:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1607 00000100:00100000:0.0:1746140869.410816:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573127680:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140869.411109:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.411146:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.411161:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573127808 00000100:00100000:0.0:1746140869.411164:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573127808 00010000:00010000:0.0:1746140869.411182:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb683f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f554 expref: 15 pid: 12255 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.411198:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573128064 00000100:00100000:0.0:1746140869.411200:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573128064 00010000:00010000:0.0:1746140869.411211:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a699600/0x8156357b7fdb6751 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f500 expref: 13 pid: 24958 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746140869.411225:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7989 00000100:00100000:0.0:1746140869.411230:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573127808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.411239:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.411258:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb683f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f554 expref: 15 pid: 12255 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.411268:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb683f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f554 expref: 15 pid: 12255 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.411290:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.411331:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573127808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 100us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.411337:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7989 00000100:00100000:0.0:1746140869.411351:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7990 00000100:00100000:0.0:1746140869.411356:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573128064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.411363:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.411369:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a699600/0x8156357b7fdb6751 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f500 expref: 13 pid: 24958 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746140869.411378:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a699600/0x8156357b7fdb6751 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f500 expref: 13 pid: 24958 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746140869.411402:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.411416:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573128064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.411421:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7990 00000100:00100000:0.0:1746140869.411481:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.411494:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573128448 00000100:00100000:0.0:1746140869.411497:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573128448 00010000:00010000:0.0:1746140869.411508:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094459200/0x8156357b7fdb6838 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f54d expref: 24 pid: 12255 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.411522:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7991 00000100:00100000:0.0:1746140869.411526:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573128448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.411532:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.411539:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094459200/0x8156357b7fdb6838 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f54d expref: 24 pid: 12255 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.411546:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094459200/0x8156357b7fdb6838 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f54d expref: 24 pid: 12255 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.411557:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.411559:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.411563:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e426600/0x8156357b7fdb69a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.411571:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426600/0x8156357b7fdb69a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.411586:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.411598:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573128448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.411603:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7991 00000100:00100000:0.0:1746140869.411638:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.411664:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.411673:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573128320 00000100:00100000:0.0:1746140869.411675:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573128320 00010000:00010000:0.0:1746140869.411685:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ac874600/0x8156357b7fdb68a8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5b6 expref: 21 pid: 4785 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746140869.411697:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7992 00000100:00100000:0.0:1746140869.411702:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573128320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.411709:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.411719:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ac874600/0x8156357b7fdb68a8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5b6 expref: 21 pid: 4785 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746140869.411727:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ac874600/0x8156357b7fdb68a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5b6 expref: 21 pid: 4785 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746140869.411738:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.411750:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573128320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.411755:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7992 00000100:00100000:0.0:1746140869.433515:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573127680:12345-192.168.204.16@tcp:4:cat.0 Request processed in 22697us (23439us total) trans 17179873811 rc 0/0 00000100:00100000:0.0:1746140869.433524:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1607 00002000:00100000:0.0:1746140869.433532:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a8:0x0] (1765376->2097151) req@ffff88009f170000 x1830960573127680/t17179873811(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:285/0 lens 488/448 e 0 to 0 dl 1746140880 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140869.433540:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170000 with x1830960573127680 ext(1765376->2097151) 00010000:00010000:0.0:1746140869.433547:0:21691:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4923c00/0x8156357b7fdb68bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1765376->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5cb expref: 20 pid: 8460 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.433556:0:21691:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4923c00/0x8156357b7fdb68bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1765376->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5cb expref: 20 pid: 8460 timeout: 948 lvb_type: 0 00002000:00010000:0.0:1746140869.433567:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f170000 00000100:00100000:0.0:1746140869.446694:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573129344 00000100:00100000:0.0:1746140869.446705:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573129344 00010000:00010000:0.0:1746140869.446742:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4923c00/0x8156357b7fdb68bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1765376->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5cb expref: 20 pid: 8460 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.446774:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573129472 00000100:00100000:0.0:1746140869.446776:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573129472 00010000:00010000:0.0:1746140869.446789:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801369cd800/0x8156357b7fdb6893 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->1761279] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5a1 expref: 30 pid: 4186 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.446805:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7999 00000100:00100000:0.0:1746140869.446811:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573129344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.446823:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.446845:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4923c00/0x8156357b7fdb68bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1765376->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5cb expref: 20 pid: 8460 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.446856:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4923c00/0x8156357b7fdb68bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1765376->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5cb expref: 20 pid: 8460 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.446878:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4923c00/0x8156357b7fdb68bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1765376->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f5cb expref: 20 pid: 8460 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.448315:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.448338:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573129344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1526us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.448348:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7999 00000100:00100000:0.0:1746140869.450421:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.454124:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.454153:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.454185:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.454409:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8003 00000100:00100000:0.0:1746140869.454416:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:1982:x1830960573130240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.454422:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.454425:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfb000/0x8156357b7fdb6870 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f57e expref: 271 pid: 20524 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.454440:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4dfb000/0x8156357b7fdb6870 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f57e expref: 271 pid: 20524 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.454451:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008d152800) 00010000:00010000:0.0:1746140869.454456:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfd4c00/0x8156357b7fdb69c7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.454464:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.454503:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:1982:x1830960573130240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.454508:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8003 00000001:00080000:0.0:1746140869.491166:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944608 is committed 00000004:00080000:0.0:1746140869.491178:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2450 committed 00000001:00080000:0.0:1746140869.491187:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944612 is committed 00000001:00080000:0.0:1746140869.491194:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944610 is committed 00000001:00080000:0.0:1746140869.491210:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944614 is committed 00000004:00080000:0.0:1746140869.491213:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2508 committed 00000004:00080000:0.0:1746140869.491218:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2459 committed 00000004:00080000:0.0:1746140869.491220:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2458 committed 00000004:00080000:0.0:1746140869.491222:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2457 committed 00000004:00080000:0.0:1746140869.491223:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2456 committed 00000004:00080000:0.0:1746140869.491225:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2507 committed 00000004:00080000:0.0:1746140869.491226:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2455 committed 00000004:00080000:0.0:1746140869.491228:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2506 committed 00000004:00080000:0.0:1746140869.491229:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2454 committed 00000004:00080000:0.0:1746140869.491230:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2505 committed 00000004:00080000:0.0:1746140869.491232:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2504 committed 00000004:00080000:0.0:1746140869.491233:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2503 committed 00000004:00080000:0.0:1746140869.491234:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2453 committed 00000004:00080000:0.0:1746140869.491235:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2452 committed 00000004:00080000:0.0:1746140869.491236:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2502 committed 00000004:00080000:0.0:1746140869.491237:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2501 committed 00000004:00080000:0.0:1746140869.491239:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2451 committed 00000001:00080000:0.0:1746140869.491247:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944611 is committed 00000100:00100000:0.0:1746140869.491350:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575824128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.491404:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.491429:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575824384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.491442:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.491457:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575824128 00000100:00100000:0.0:1746140869.491462:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575824128 00000100:00100000:0.0:1746140869.491488:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575824384 00000100:00100000:0.0:1746140869.491489:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575824384 00000100:00100000:0.0:1746140869.491498:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15523 00000100:00100000:0.0:1746140869.491503:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3311:x1830960575824128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.491684:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3311:x1830960575824128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (280us total) trans 17179873813 rc 0/0 00000100:00100000:0.0:1746140869.491691:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15523 00000100:00100000:0.0:1746140869.491701:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15524 00000100:00100000:0.0:1746140869.491705:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3313:x1830960575824384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.491769:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3313:x1830960575824384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (327us total) trans 17179873814 rc 0/0 00000100:00100000:0.0:1746140869.491774:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15524 00000004:00080000:0.0:1746140869.493558:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f171f80/2, rc 0, transno 17179873814 00000100:00100000:0.0:1746140869.493561:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575824384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.493566:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575824896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.493583:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.493598:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575825408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.493611:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.493620:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575825920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.493632:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.493640:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746140869.493643:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575825280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.493655:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.493663:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575825792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.493673:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.493691:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575824896 00000100:00100000:0.0:1746140869.493694:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575824896 00000100:00100000:0.0:1746140869.493708:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575825408 00000100:00100000:0.0:1746140869.493710:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575825408 00000100:00100000:0.0:1746140869.493719:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575825920 00000100:00100000:0.0:1746140869.493720:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575825920 00000100:00100000:0.0:1746140869.493730:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575825280 00000100:00100000:0.0:1746140869.493732:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575825280 00000100:00100000:0.0:1746140869.493740:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575825792 00000100:00100000:0.0:1746140869.493741:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575825792 00000100:00100000:0.0:1746140869.493748:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15530 00000100:00100000:0.0:1746140869.493752:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3313:x1830960575824896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.493841:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3313:x1830960575824896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (257us total) trans 17179873817 rc 0/0 00000100:00100000:0.0:1746140869.493846:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15530 00000100:00100000:0.0:1746140869.493855:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15531 00000100:00100000:0.0:1746140869.493859:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3313:x1830960575825408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.493935:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3313:x1830960575825408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (322us total) trans 21474841078 rc 0/0 00000100:00100000:0.0:1746140869.493939:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15531 00000100:00100000:0.0:1746140869.493948:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15532 00000100:00100000:0.0:1746140869.493952:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3313:x1830960575825920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.494016:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3313:x1830960575825920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (382us total) trans 21474841079 rc 0/0 00000100:00100000:0.0:1746140869.494021:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15532 00000100:00100000:0.0:1746140869.494029:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15533 00000100:00100000:0.0:1746140869.494033:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3313:x1830960575825280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.494106:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3313:x1830960575825280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (449us total) trans 21474841080 rc 0/0 00000100:00100000:0.0:1746140869.494111:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15533 00000100:00100000:0.0:1746140869.494119:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15534 00000100:00100000:0.0:1746140869.494123:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3313:x1830960575825792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.494352:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3313:x1830960575825792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 227us (676us total) trans 21474841081 rc 0/0 00000100:00100000:0.0:1746140869.494357:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15534 00000100:00100000:0.0:1746140869.494491:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00080000:0.0:1746140869.494520:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc08000/2, rc 0, transno 21474841080 00000100:00100000:0.0:1746140869.494524:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575825280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.494530:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099494380/2, rc 0, transno 21474841081 00000100:00100000:0.0:1746140869.494532:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575825792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.494537:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093349f80/2, rc 0, transno 21474841078 00000100:00100000:0.0:1746140869.494539:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575825408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.494544:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099495f80/2, rc 0, transno 21474841079 00000100:00100000:0.0:1746140869.494547:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575825920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.494554:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc37480/2, rc 0, transno 17179873817 00000100:00100000:0.0:1746140869.494556:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575824896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.499234:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.503000:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.503458:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.503473:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.503483:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.503495:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.503878:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.503898:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15540 00000100:00100000:0.0:1746140869.503904:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573130752:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140869.503938:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.503954:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f688 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140869.503977:0:8460:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fec6, atime: 0x6813fec5, ctime: 0x6813fec5, blocks: 0x821 00010000:00010000:0.0:1746140869.503991:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.503993:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.504001:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f688 expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.504015:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f688 expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.504024:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b5cc600, rc 0) 00000100:00100000:0.0:1746140869.504065:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573130752:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 161us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.504070:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15540 00000100:00100000:0.0:1746140869.504088:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15543 00000100:00100000:0.0:1746140869.504093:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573130880:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140869.504103:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.504111:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc400/0x8156357b7fdb69f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f68f expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140869.504122:0:8460:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fec6, atime: 0x6813fec6, ctime: 0x6813fec6, blocks: 0x81d 00010000:00010000:0.0:1746140869.504128:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.504130:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.504133:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc400/0x8156357b7fdb69f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f68f expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.504146:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc400/0x8156357b7fdb69f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f68f expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.504153:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b5cc400, rc 0) 00000100:00100000:0.0:1746140869.504987:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573130880:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 893us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.504993:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15543 00000100:00100000:0.0:1746140869.514777:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.515483:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.520456:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.522123:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573132032 00000100:00100000:0.0:1746140869.522135:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573132032 00000100:00100000:0.0:1746140869.522191:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7881 00000100:00100000:0.0:1746140869.522199:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573132032:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140869.522229:0:21691:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ecd9200/0x8156357b7fdb6a1b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.522242:0:21691:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.522244:0:21691:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.522248:0:21691:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ecd9200/0x8156357b7fdb6a1b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.522260:0:21691:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ecd9200/0x8156357b7fdb6a1b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140869.531341:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7885 00000100:00100000:0.0:1746140869.531357:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573132928:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140869.531391:0:8464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012db26c00/0x8156357b7fdb6a37 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.531400:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.531401:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.531408:0:8464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db26c00/0x8156357b7fdb6a37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.531420:0:8464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db26c00/0x8156357b7fdb6a37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.533436:0:8463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb6a0d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.533451:0:8463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb6a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.533459:0:8463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb6a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.533466:0:8463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a0400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140869.533470:0:8463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb6a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.533478:0:8463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb6a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.533495:0:8463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb6a0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.533502:0:8463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb6a0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140869.533576:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+17:1985:x1830960573131520:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 16165us (18805us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140869.533584:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7879 00000100:00100000:0.0:1746140869.579363:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.579396:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.579413:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.579427:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.579440:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.579510:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.580440:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15550 00000100:00100000:0.0:1746140869.580447:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573133952:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746140869.580678:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140869.580681:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140869.580683:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140869 -> 1746140870 00002000:00010000:0.0:1746140869.580685:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140869.580686:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140869.581606:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573133952:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 1158us (2163us total) trans 21474841086 rc 0/0 00000100:00100000:0.0:1746140869.581613:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15550 00000100:00100000:0.0:1746140869.582900:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.586772:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.610959:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575826560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.611003:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.611026:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575827072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.611042:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.611052:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575827584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.611067:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.611083:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575828096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.611102:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.611115:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746140869.611119:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575826432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.611132:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.611141:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575826944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.611153:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.611173:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575827456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.611187:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.611198:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575827968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.611208:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.611229:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575826560 00000100:00100000:0.0:1746140869.611235:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575826560 00000100:00100000:0.0:1746140869.611262:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575827072 00000100:00100000:0.0:1746140869.611264:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575827072 00000100:00100000:0.0:1746140869.611274:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575827584 00000100:00100000:0.0:1746140869.611276:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575827584 00000100:00100000:0.0:1746140869.611286:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575828096 00000100:00100000:0.0:1746140869.611288:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575828096 00000100:00100000:0.0:1746140869.611296:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575826432 00000100:00100000:0.0:1746140869.611297:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575826432 00000100:00100000:0.0:1746140869.611328:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575826944 00000100:00100000:0.0:1746140869.611330:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575826944 00000100:00100000:0.0:1746140869.611338:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575827456 00000100:00100000:0.0:1746140869.611339:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575827456 00000100:00100000:0.0:1746140869.611345:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575827968 00000100:00100000:0.0:1746140869.611346:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575827968 00000100:00100000:0.0:1746140869.611354:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15552 00000100:00100000:0.0:1746140869.611359:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3313:x1830960575826560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140869.613171:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140869.613174:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140869.613181:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140869.613183:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140869.613185:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140869.613205:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3313:x1830960575826560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1846us (2202us total) trans 17179873830 rc 0/0 00000100:00100000:0.0:1746140869.613210:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15552 00000004:00080000:0.0:1746140869.613261:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece1500/2, rc 0, transno 17179873825 00000100:00100000:0.0:1746140869.613264:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575826432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.613272:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8d500/2, rc 0, transno 17179873826 00000100:00100000:0.0:1746140869.613274:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575826944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.613282:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8ce00/2, rc 0, transno 21474841089 00000100:00100000:0.0:1746140869.613284:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575827456:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.613291:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8df80/2, rc 0, transno 21474841090 00000100:00100000:0.0:1746140869.613293:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575827968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.613300:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece3b80/2, rc 0, transno 17179873830 00000100:00100000:0.0:1746140869.613302:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575826560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.613336:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8f800/2, rc 0, transno 17179873824 00000100:00100000:0.0:1746140869.613339:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575827072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.613345:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8d180/2, rc 0, transno 21474841087 00000100:00100000:0.0:1746140869.613347:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575827584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140869.613354:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e8ea00/2, rc 0, transno 21474841088 00000100:00100000:0.0:1746140869.613356:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575828096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140869.614503:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.641755:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.649607:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.649660:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.649688:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.655709:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.658406:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140869.659446:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eacba00/0x8156357b7fdb6a92 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.659455:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eacba00/0x8156357b7fdb6a92 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140869.659474:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140869.659602:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eaca800/0x8156357b7fdb6a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6c7 expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.659632:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eacba00/0x8156357b7fdb6a92 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6c7 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.659639:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140869.660128:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140869.660131:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eacba00, rc 0) 00000100:00100000:0.0:1746140869.660157:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:31980:x1830960573135872:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9941us (10464us total) trans 8589944620 rc 0/0 00000100:00100000:0.0:1746140869.660163:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10415 00000100:00100000:0.0:1746140869.660743:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573136384 00000100:00100000:0.0:1746140869.660748:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573136384 00000100:00100000:0.0:1746140869.661027:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15570 00000100:00100000:0.0:1746140869.661033:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:31981:x1830960573136384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140869.661044:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.661056:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927c4a00/0x8156357b7fdb6abc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f6ce expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.661071:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.661073:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.661079:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927c4a00/0x8156357b7fdb6abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6ce expref: 23 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.661099:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927c4a00/0x8156357b7fdb6abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6ce expref: 23 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.661107:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927c4a00, rc 0) 00000100:00100000:0.0:1746140869.661137:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:31981:x1830960573136384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 104us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.661142:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15570 00000100:00100000:0.0:1746140869.661157:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573136640 00000100:00100000:0.0:1746140869.661159:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573136640 00000100:00100000:0.0:1746140869.661175:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10416 00000100:00100000:0.0:1746140869.661180:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:31977:x1830960573136640:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140869.661190:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.661199:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5c00/0x8156357b7fdb6ac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f6d5 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.662376:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662397:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662406:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662417:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662422:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662426:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662521:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7ad400/0x8156357b7fdb6ad8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662527:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7ad400/0x8156357b7fdb6ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662532:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7ad400/0x8156357b7fdb6ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140869.662539:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140869.662613:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662620:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662625:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662629:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927c5a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140869.662631:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662636:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662644:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140869.662647:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140869.662650:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662654:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5a00/0x8156357b7fdb6aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662661:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662665:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662669:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662672:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a1400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140869.662674:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662681:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662685:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e4b5800) 00010000:00010000:0.0:1746140869.662687:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140869.662688:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662692:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6ad1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140869.662722:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927c5c00/0x8156357b7fdb6ac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6d5 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.662731:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7ad400/0x8156357b7fdb6ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6d5 expref: 270 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.662736:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140869.662737:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140869.662740:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7ad400, rc 0) 00000100:00100000:0.0:1746140869.662765:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:31977:x1830960573136640:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1582us (1920us total) trans 8589944621 rc 0/0 00000100:00100000:0.0:1746140869.662772:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10416 00000100:00100000:0.0:1746140869.667794:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.673095:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.677286:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.679287:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.682810:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.686565:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.697858:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.704720:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.708574:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.709372:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.720085:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.727014:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.741911:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575830272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.741934:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.741945:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575830784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.741956:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.741965:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746140869.741968:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575830656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.741979:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.741986:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575831168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.742006:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140869.742024:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575830272 00000100:00100000:0.0:1746140869.742027:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575830272 00000100:00100000:0.0:1746140869.742043:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575830784 00000100:00100000:0.0:1746140869.742044:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575830784 00000100:00100000:0.0:1746140869.742051:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575830656 00000100:00100000:0.0:1746140869.742053:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575830656 00000100:00100000:0.0:1746140869.742058:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575831168 00000100:00100000:0.0:1746140869.742060:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575831168 00000100:00100000:0.0:1746140869.742067:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15585 00000100:00100000:0.0:1746140869.742071:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960575830272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140869.742168:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140869.742171:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140869.742173:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140869.742176:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140869.742177:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140869.742197:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3313:x1830960575830272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (262us total) trans 17179873832 rc 0/0 00000100:00100000:0.0:1746140869.742202:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15585 00000100:00100000:0.0:1746140869.742212:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15586 00000100:00100000:0.0:1746140869.742215:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960575830784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.742284:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3313:x1830960575830784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (326us total) trans 17179873833 rc 0/0 00000100:00100000:0.0:1746140869.742289:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15586 00000100:00100000:0.0:1746140869.742298:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15587 00000100:00100000:0.0:1746140869.742302:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960575830656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.742406:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3313:x1830960575830656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (425us total) trans 17179873834 rc 0/0 00000100:00100000:0.0:1746140869.742410:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15587 00000100:00100000:0.0:1746140869.742419:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15588 00000100:00100000:0.0:1746140869.742422:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960575831168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.742482:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3313:x1830960575831168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (476us total) trans 17179873835 rc 0/0 00000100:00100000:0.0:1746140869.742487:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15588 00000004:00080000:0.0:1746140869.742512:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929f2300/2, rc 0, transno 17179873834 00000100:00100000:0.0:1746140869.742516:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575830656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.742521:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929f3100/2, rc 0, transno 17179873835 00000100:00100000:0.0:1746140869.742524:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575831168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.742529:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929f1880/2, rc 0, transno 17179873832 00000100:00100000:0.0:1746140869.742532:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575830272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140869.742536:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929f2680/2, rc 0, transno 17179873833 00000100:00100000:0.0:1746140869.742539:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575830784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140869.746917:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.746944:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.747966:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4499 00000100:00100000:0.0:1746140869.747975:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:31982:x1830960573139456:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746140869.748051:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:31982:x1830960573139456:12345-192.168.204.16@tcp:49:cat.0 Request processed in 79us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.748055:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4499 00000100:00100000:0.0:1746140869.748066:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4500 00000100:00100000:0.0:1746140869.748070:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:31981:x1830960573139584:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746140869.748096:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:31981:x1830960573139584:12345-192.168.204.16@tcp:49:cat.0 Request processed in 25us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.748100:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4500 00000100:00100000:0.0:1746140869.756329:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.756605:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.757503:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.764189:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.764217:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.764237:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.764267:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573140480 00000100:00100000:0.0:1746140869.764268:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573140480 00010000:00010000:0.0:1746140869.764461:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb6a7d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6c0 expref: 17 pid: 8459 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.764491:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8010 00000100:00100000:0.0:1746140869.764496:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573140480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.764504:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.764511:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb6a7d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6c0 expref: 17 pid: 8459 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.764518:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb6a7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6c0 expref: 17 pid: 8459 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.764529:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb6a7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6c0 expref: 17 pid: 8459 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.764538:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.764551:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573140480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.764556:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8010 00000100:00100000:0.0:1746140869.771949:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.778217:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.781936:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573141120 00000100:00100000:0.0:1746140869.781940:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573141120 00000100:00100000:0.0:1746140869.781980:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15595 00000100:00100000:0.0:1746140869.781988:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573141120:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140869.782002:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.782016:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094899600/0x8156357b7fdb6b3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f729 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140869.782065:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575831808:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140869.782133:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140869.784926:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.785060:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.785098:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15596 00000100:00100000:0.0:1746140869.785110:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573141632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140869.785130:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.785145:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927c4000/0x8156357b7fdb6b41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f737 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.785166:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.785168:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.785176:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927c4000/0x8156357b7fdb6b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f737 expref: 22 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.785190:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927c4000/0x8156357b7fdb6b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f737 expref: 22 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.785410:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927c4000, rc 0) 00000100:00100000:0.0:1746140869.785443:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573141632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 338us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.785449:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15596 00000100:00100000:0.0:1746140869.786038:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.786082:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.795715:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.795748:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.795801:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.795833:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.803365:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.811720:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.818235:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.820694:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573142656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24571us (24885us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140869.820705:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7899 00002000:00100000:0.0:1746140869.820716:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135f96680 x1830960573142656/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:285/0 lens 488/440 e 0 to 0 dl 1746140880 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140869.820726:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f96680 with x1830960573142656 ext(3145728->4194303) 00002000:00010000:0.0:1746140869.820731:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135f96680 00000100:00100000:0.0:1746140869.828083:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.834635:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.838966:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.839088:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.839849:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.839862:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.839883:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.846514:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.847756:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573145472 00000100:00100000:0.0:1746140869.847763:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573145472 00000100:00100000:0.0:1746140869.847809:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15603 00000100:00100000:0.0:1746140869.847815:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:31980:x1830960573145472:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140869.847827:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140869.847914:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927c5c00/0x8156357b7fdb6b72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f761 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.847939:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f688 expref: 13 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.847947:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b407e800/0x8156357b7fdb6af4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6ea expref: 35 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.847953:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b407e000/0x8156357b7fdb6ae6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6dc expref: 23 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.847957:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.847959:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.847962:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927c5c00/0x8156357b7fdb6b72 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1048576->1863679] (req 1048576->1863679) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f761 expref: 23 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.847988:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b407e000/0x8156357b7fdb6ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6dc expref: 23 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.847997:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b407e000/0x8156357b7fdb6ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6dc expref: 23 pid: 4785 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.848007:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094786680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575832448:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140869.848494:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b407e800/0x8156357b7fdb6af4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6ea expref: 35 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.848502:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b407e800/0x8156357b7fdb6af4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6ea expref: 35 pid: 4785 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.848512:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094786a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575832576:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140869.848617:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f688 expref: 13 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140869.848626:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f688 expref: 13 pid: 8460 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746140869.848634:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094786d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575832704:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140869.848665:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746140869.856477:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.856508:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.856531:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573145984 00000100:00100000:0.0:1746140869.856539:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573145984 00010000:00010000:0.0:1746140869.856579:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b407e800/0x8156357b7fdb6af4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6ea expref: 36 pid: 4785 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.856605:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573146112 00000100:00100000:0.0:1746140869.856607:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573146112 00010000:00010000:0.0:1746140869.856617:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f688 expref: 14 pid: 8460 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746140869.856630:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8013 00000100:00100000:0.0:1746140869.856636:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573145984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.856649:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.856673:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b407e800/0x8156357b7fdb6af4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6ea expref: 36 pid: 4785 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.856684:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b407e800/0x8156357b7fdb6af4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6ea expref: 36 pid: 4785 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.856710:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.856750:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573145984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.856756:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8013 00000100:00100000:0.0:1746140869.856772:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8014 00000100:00100000:0.0:1746140869.856776:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573146112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.856783:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.856789:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f688 expref: 14 pid: 8460 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746140869.856796:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b5cc600/0x8156357b7fdb69ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f688 expref: 14 pid: 8460 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746140869.856807:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.856821:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573146112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.856826:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8014 00000100:00100000:0.0:1746140869.856880:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.856894:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573145856 00000100:00100000:0.0:1746140869.856897:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573145856 00010000:00010000:0.0:1746140869.856907:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b407e000/0x8156357b7fdb6ae6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6dc expref: 24 pid: 4785 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746140869.856921:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8015 00000100:00100000:0.0:1746140869.856926:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094787800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573145856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140869.856931:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140869.856937:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b407e000/0x8156357b7fdb6ae6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6dc expref: 24 pid: 4785 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.856945:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b407e000/0x8156357b7fdb6ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6dc expref: 24 pid: 4785 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746140869.856957:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.856959:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140869.856966:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927c5c00/0x8156357b7fdb6b72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1863679) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f761 expref: 24 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.856974:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927c5c00/0x8156357b7fdb6b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1863679) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f761 expref: 24 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140869.857002:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800927c5c00/0x8156357b7fdb6b72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1863679) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f761 expref: 24 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140869.857014:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094787b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575832832:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140869.857065:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140869.868063:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094787b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575832832:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140869.868088:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140869.868149:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094787800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573145856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11221us (11267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140869.868160:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8015 00000100:00100000:0.0:1746140869.873761:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.875259:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.881784:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.881842:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.887239:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.898002:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.898057:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.905486:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.905540:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140869.997889:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.002102:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.002961:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573148544 00000100:00100000:0.0:1746140870.002970:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573148544 00000100:00100000:0.0:1746140870.003044:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10422 00000100:00100000:0.0:1746140870.003053:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:31992:x1830960573148544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140870.003076:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140870.003093:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5131800/0x8156357b7fdb6bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f7a0 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140870.004819:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575833728:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140870.004843:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0c00/0x8156357b7fdb6bc6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f799 expref: 32 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.004858:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0c00, rc 0) 00000100:00100000:0.0:1746140870.005278:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:31987:x1830960573148288:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5072us (7399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.005287:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15610 00000100:00100000:0.0:1746140870.022277:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.022421:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.027829:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.035393:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.038758:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.042540:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.052392:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.053590:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573150592 00000100:00100000:0.0:1746140870.053598:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573150592 00000100:00100000:0.0:1746140870.053640:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 717 00000100:00100000:0.0:1746140870.053646:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:1982:x1830960573150592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140870.053657:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140870.054522:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b44800/0x8156357b7fdb6c13 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f7b5 expref: 274 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.054546:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140870.054550:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140870.054571:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:1982:x1830960573150592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 925us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.054577:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 717 00000100:00100000:0.0:1746140870.055093:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.057343:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.058081:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.058101:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573151360 00000100:00100000:0.0:1746140870.058104:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573151360 00000100:00100000:0.0:1746140870.058126:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4504 00000100:00100000:0.0:1746140870.058131:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:31987:x1830960573151360:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746140870.058286:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:31987:x1830960573151360:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 154us (204us total) trans 8589944629 rc 0/0 00000100:00100000:0.0:1746140870.058292:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4504 00000100:00100000:0.0:1746140870.075748:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.076347:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.082586:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.082620:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573152000 00000100:00100000:0.0:1746140870.082629:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573152000 00002000:00100000:0.0:1746140870.082672:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880135f96a00 x1830960573152000/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:286/0 lens 488/0 e 0 to 0 dl 1746140881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140870.082682:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f96a00 with x1830960573152000 ext(1048576->2097151) 00002000:00010000:0.0:1746140870.082688:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f96a00 00000100:00100000:0.0:1746140870.082709:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7912 00000100:00100000:0.0:1746140870.082716:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573152000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140870.100092:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.105001:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573152000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22271us (22415us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140870.105014:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7912 00002000:00100000:0.0:1746140870.105027:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880135f96a00 x1830960573152000/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:286/0 lens 488/440 e 0 to 0 dl 1746140881 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140870.105036:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f96a00 with x1830960573152000 ext(1048576->2097151) 00002000:00010000:0.0:1746140870.105041:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f96a00 00000100:00100000:0.0:1746140870.112184:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.117875:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.122577:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.122659:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.123245:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.131894:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.132232:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.133571:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.133590:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573153792 00000100:00100000:0.0:1746140870.133593:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573153792 00002000:00100000:0.0:1746140870.133611:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f2d7b80 x1830960573153792/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:286/0 lens 488/0 e 0 to 0 dl 1746140881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140870.133619:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2d7b80 with x1830960573153792 ext(1048576->2097151) 00002000:00010000:0.0:1746140870.133622:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2d7b80 00000100:00100000:0.0:1746140870.133708:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7914 00000100:00100000:0.0:1746140870.133713:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573153792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140870.150455:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.150481:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.150497:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.151522:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573153792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17807us (17950us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140870.151529:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7914 00002000:00100000:0.0:1746140870.151535:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f2d7b80 x1830960573153792/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:286/0 lens 488/440 e 0 to 0 dl 1746140881 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140870.151542:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2d7b80 with x1830960573153792 ext(1048576->2097151) 00002000:00010000:0.0:1746140870.151546:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2d7b80 00000100:00100000:0.0:1746140870.152356:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573154304 00000100:00100000:0.0:1746140870.152360:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573154304 00010000:00010000:0.0:1746140870.152387:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1dd800/0x8156357b7fdb6bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f7ae expref: 36 pid: 20960 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746140870.152410:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8025 00000100:00100000:0.0:1746140870.152415:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573154304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140870.152423:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140870.152437:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f1dd800/0x8156357b7fdb6bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f7ae expref: 36 pid: 20960 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746140870.152446:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f1dd800/0x8156357b7fdb6bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f7ae expref: 36 pid: 20960 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746140870.152460:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f1dd800/0x8156357b7fdb6bf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f7ae expref: 36 pid: 20960 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746140870.152478:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.152479:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.152485:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b407ee00/0x8156357b7fdb6c67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f7e6 expref: 23 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.152491:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b407ee00/0x8156357b7fdb6c67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f7e6 expref: 23 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.152510:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b407ee00/0x8156357b7fdb6c67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f7e6 expref: 23 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140870.152523:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc35180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575836032:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140870.152564:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140870.166858:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.166887:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.166916:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.171982:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.188140:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.203962:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.204017:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.204070:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.219458:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.223569:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.229661:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.232321:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.233128:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573156864 00000100:00100000:0.0:1746140870.233132:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573156864 00010000:00010000:0.0:1746140870.233147:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ece0a00/0x8156357b7fdb6b5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f74c expref: 28 pid: 32376 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746140870.236549:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.236602:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.238702:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.245412:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.245480:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.248590:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.259300:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.261442:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.264839:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.282232:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.285848:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.288703:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.291580:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.292973:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.293118:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.294557:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7923 00000100:00100000:0.0:1746140870.294569:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573159808:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140870.299660:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.306146:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.306975:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.311449:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.312797:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.318638:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.318654:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573161344 00000100:00100000:0.0:1746140870.318658:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573161344 00010000:00010000:0.0:1746140870.318675:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb69f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6a4 expref: 12 pid: 9872 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746140870.318704:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8032 00000100:00100000:0.0:1746140870.318709:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960573161344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140870.318717:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140870.318727:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb69f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6a4 expref: 12 pid: 9872 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.318740:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb69f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6a4 expref: 12 pid: 9872 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.318753:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb69f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f6a4 expref: 12 pid: 9872 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.319200:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140870.319434:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573161344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 723us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.319439:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8032 00000100:00100000:0.0:1746140870.319520:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.322852:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.323763:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.325268:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.330058:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.336064:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.344436:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.346993:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.348775:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.353534:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.354798:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.354821:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.354834:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.354849:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573163904 00000100:00100000:0.0:1746140870.354853:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573163904 00000100:00100000:0.0:1746140870.356074:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.356144:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.359870:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.364645:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.367137:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.369688:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.372418:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.373231:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15643 00000100:00100000:0.0:1746140870.373238:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573165312:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140870.373257:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5130e00/0x8156357b7fdb6da9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.373267:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6cc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4747264->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f825 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.373274:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edece00/0x8156357b7fdb6d4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f879 expref: 16 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140870.373281:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ece0000/0x8156357b7fdb6cc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f82c expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.373286:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.373287:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.373289:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5130e00/0x8156357b7fdb6da9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.373336:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ece0000/0x8156357b7fdb6cc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f82c expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.373348:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ece0000/0x8156357b7fdb6cc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f82c expref: 28 pid: 20960 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746140870.373355:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b458000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575840256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140870.373397:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edece00/0x8156357b7fdb6d4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f879 expref: 16 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140870.373408:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edece00/0x8156357b7fdb6d4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f879 expref: 16 pid: 8460 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746140870.373416:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b458380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575840384:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140870.373445:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4747264->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f825 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.373453:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4747264->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f825 expref: 19 pid: 20960 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746140870.373460:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b458700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575840512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140870.373489:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140870.376457:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575839488:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140870.376469:0:8458:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140870.377322:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573166080 00000100:00100000:0.0:1746140870.377326:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573166080 00010000:00010000:0.0:1746140870.377342:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eded000/0x8156357b7fdb6cd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f833 expref: 20 pid: 20960 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746140870.377359:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8038 00000100:00100000:0.0:1746140870.377364:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573166080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140870.377384:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140870.377394:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eded000/0x8156357b7fdb6cd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f833 expref: 20 pid: 20960 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.377402:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eded000/0x8156357b7fdb6cd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f833 expref: 20 pid: 20960 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.377414:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eded000/0x8156357b7fdb6cd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f833 expref: 20 pid: 20960 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.377427:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140870.377443:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573166080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.377448:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8038 00000100:00100000:0.0:1746140870.378414:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.378441:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.378461:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.378476:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.378487:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573165568 00000100:00100000:0.0:1746140870.378490:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573165568 00010000:00010000:0.0:1746140870.378501:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4b44c00/0x8156357b7fdb6cad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f810 expref: 19 pid: 8459 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746140870.379753:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.379766:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573165696 00000100:00100000:0.0:1746140870.379769:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573165696 00010000:00010000:0.0:1746140870.379783:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ece0c00/0x8156357b7fdb6d32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f864 expref: 16 pid: 4785 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746140870.379797:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8044 00000100:00100000:0.0:1746140870.379801:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573165696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140870.379807:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140870.379816:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ece0c00/0x8156357b7fdb6d32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f864 expref: 16 pid: 4785 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.379823:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ece0c00/0x8156357b7fdb6d32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f864 expref: 16 pid: 4785 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.379834:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ece0c00/0x8156357b7fdb6d32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f864 expref: 16 pid: 4785 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.379842:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140870.380098:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573165696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 295us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.380272:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8044 00000100:00100000:0.0:1746140870.380294:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8046 00000100:00100000:0.0:1746140870.380301:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573167104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140870.380322:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140870.380333:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ac874200/0x8156357b7fdb6ca6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f809 expref: 28 pid: 8458 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746140870.380341:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ac874200/0x8156357b7fdb6ca6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f809 expref: 28 pid: 8458 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746140870.380352:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ac874200/0x8156357b7fdb6ca6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f809 expref: 28 pid: 8458 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746140870.380361:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.380362:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.380365:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad4a600/0x8156357b7fdb6d94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.380380:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad4a600/0x8156357b7fdb6d94 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.380407:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140870.380424:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573167104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.380430:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8046 00000100:00100000:0.0:1746140870.380442:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8048 00000100:00100000:0.0:1746140870.380447:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573166592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140870.380453:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140870.380461:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb6d47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f86b expref: 15 pid: 8460 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.380470:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb6d47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f86b expref: 15 pid: 8460 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.380480:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb6d47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f86b expref: 15 pid: 8460 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746140870.380489:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.380490:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.380493:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4562a00/0x8156357b7fdb6d9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.380627:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4562a00/0x8156357b7fdb6d9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.380639:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140870.380649:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573166592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 203us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.380654:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8048 00000100:00100000:0.0:1746140870.380682:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b458000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575840256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140870.380691:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edece00/0x8156357b7fdb6d4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f879 expref: 13 pid: 8460 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746140870.380699:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b458380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575840384:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140870.380705:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6cc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4747264->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f825 expref: 17 pid: 20960 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746140870.380717:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b458700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575840512:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140870.380732:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5130e00/0x8156357b7fdb6da9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140870.380781:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.380792:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573167488 00000100:00100000:0.0:1746140870.380794:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573167488 00010000:00010000:0.0:1746140870.380803:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ece0000/0x8156357b7fdb6cc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f82c expref: 27 pid: 20960 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746140870.385634:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140870.386099:0:8458:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.386109:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.386129:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.386136:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.386143:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.386154:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eefea00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140870.386158:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.386166:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.386176:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140870.386182:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eefea00/0x8156357b7fdb6da2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140870.386229:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573165440:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13058us (13150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.386237:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15641 00000100:00100000:0.0:1746140870.388013:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.392133:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.392269:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.392295:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.392346:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.392789:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746140870.413329:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944629 is committed 00000001:00080000:0.0:1746140870.413341:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944638 is committed 00000001:00080000:0.0:1746140870.413346:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944637 is committed 00000001:00080000:0.0:1746140870.413387:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944641 is committed 00000004:00080000:0.0:1746140870.413394:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2532 committed 00000004:00080000:0.0:1746140870.413402:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2486 committed 00000004:00080000:0.0:1746140870.413407:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2485 committed 00000004:00080000:0.0:1746140870.413409:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2484 committed 00000004:00080000:0.0:1746140870.413410:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2483 committed 00000004:00080000:0.0:1746140870.413412:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2531 committed 00000004:00080000:0.0:1746140870.413413:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2482 committed 00000004:00080000:0.0:1746140870.413415:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2530 committed 00000004:00080000:0.0:1746140870.413416:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2481 committed 00000004:00080000:0.0:1746140870.413418:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2529 committed 00000004:00080000:0.0:1746140870.413422:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2528 committed 00000004:00080000:0.0:1746140870.413423:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2527 committed 00000004:00080000:0.0:1746140870.413425:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2480 committed 00000004:00080000:0.0:1746140870.413427:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2479 committed 00000004:00080000:0.0:1746140870.413428:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2526 committed 00000004:00080000:0.0:1746140870.413430:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2525 committed 00000004:00080000:0.0:1746140870.413432:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2478 committed 00000100:00100000:0.0:1746140870.413590:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575841280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140870.413638:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140870.413665:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575841792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140870.413680:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140870.413694:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746140870.413698:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b45b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575841664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140870.413715:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140870.413725:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575842176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140870.413739:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140870.413762:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575841280 00000100:00100000:0.0:1746140870.413769:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575841280 00000100:00100000:0.0:1746140870.413804:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575841792 00000100:00100000:0.0:1746140870.413807:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575841792 00000100:00100000:0.0:1746140870.413820:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575842176 00000100:00100000:0.0:1746140870.413822:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575842176 00000100:00100000:0.0:1746140870.413840:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15645 00000100:00100000:0.0:1746140870.413845:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3313:x1830960575841792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140870.413970:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15647 00000100:00100000:0.0:1746140870.413976:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3313:x1830960575842176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140870.414027:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3313:x1830960575841792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (346us total) trans 17179873845 rc 0/0 00000100:00100000:0.0:1746140870.414032:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15645 00000100:00100000:0.0:1746140870.414840:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575841536 00000100:00100000:0.0:1746140870.414843:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575841536 00000100:00100000:0.0:1746140870.415837:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15649 00000100:00100000:0.0:1746140870.415844:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960575841920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140870.417042:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3310:x1830960575841920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1197us (2839us total) trans 17179873848 rc 0/0 00000100:00100000:0.0:1746140870.417047:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15649 00000100:00100000:0.0:1746140870.417187:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3313:x1830960575842176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3212us (3447us total) trans 17179873851 rc 0/0 00000100:00100000:0.0:1746140870.417191:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15647 00000100:00100000:0.0:1746140870.417207:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575842304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140870.417224:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140870.417237:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575842816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140870.417252:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140870.417261:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575843328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140870.417274:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140870.417291:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b45b100/2, rc 0, transno 17179873844 00000100:00100000:0.0:1746140870.417295:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b45b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575841664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140870.417301:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b459500/2, rc 0, transno 17179873851 00000100:00100000:0.0:1746140870.417318:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575842176:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140870.417328:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b45a680/2, rc 0, transno 17179873846 00000100:00100000:0.0:1746140870.417331:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575841280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140870.417338:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b45b480/2, rc 0, transno 17179873845 00000100:00100000:0.0:1746140870.417340:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575841792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140870.417432:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746140870.417440:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575842688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140870.417472:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140870.417485:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575843200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140870.417504:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140870.417517:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b182680/2, rc 0, transno 21474841113 00000100:00100000:0.0:1746140870.417520:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575842304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140870.417526:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b183480/2, rc 0, transno 21474841114 00000100:00100000:0.0:1746140870.417528:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575842816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140870.417608:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00080000:0.0:1746140870.417825:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b183100/2, rc 0, transno 21474841117 00000100:00100000:0.0:1746140870.417829:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575842688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140870.421735:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.426196:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.426231:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.426253:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.426337:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140870.428002:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573169408 00000100:00100000:0.0:1746140870.428008:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573169408 00000100:00100000:0.0:1746140870.428037:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573169536 00000100:00100000:0.0:1746140870.428039:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573169536 00000100:00100000:0.0:1746140870.428076:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15666 00000100:00100000:0.0:1746140870.428082:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573169536:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140870.428089:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140870.428099:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5130400/0x8156357b7fdb6def lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f8cd expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140870.428111:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fec7, atime: 0x6813fec6, ctime: 0x6813fec7, blocks: 0x102b 00010000:00010000:0.0:1746140870.428119:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.428120:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140870.428124:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5130400/0x8156357b7fdb6def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8cd expref: 14 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140870.428134:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5130400/0x8156357b7fdb6def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8cd expref: 14 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140870.428141:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5130400, rc 0) 00000100:00100000:0.0:1746140870.428540:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573169536:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 456us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140870.428552:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15666 00000100:00100000:0.0:1746140871.442001:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.442046:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.442075:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.442100:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.442136:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.442174:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573170048 00000100:00100000:0.0:1746140871.442177:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573170048 00000100:00100000:0.0:1746140871.442214:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573170304 00000100:00100000:0.0:1746140871.442217:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573170304 00000100:00100000:0.0:1746140871.442233:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573170816 00000100:00100000:0.0:1746140871.442234:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573170816 00000100:00100000:0.0:1746140871.442429:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7928 00000100:00100000:0.0:1746140871.442437:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009950dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+16:1982:x1830960573169792:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746140871.442456:0:32429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5130c00/0x8156357b7fdb6dfd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.442464:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.442465:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.442468:0:32429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5130c00/0x8156357b7fdb6dfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.442479:0:32429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5130c00/0x8156357b7fdb6dfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140871.443925:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7930 00000100:00100000:0.0:1746140871.443933:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009950e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:28b972ba-4133-49d1-b679-ce80456803d9+17:1983:x1830960573170560:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746140871.443952:0:21690:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5130600/0x8156357b7fdb6e0b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.443960:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.443961:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.443964:0:21690:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5130600/0x8156357b7fdb6e0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.443977:0:21690:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5130600/0x8156357b7fdb6e0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140871.455722:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573171584 00000100:00100000:0.0:1746140871.455735:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573171584 00000100:00100000:0.0:1746140871.455825:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7934 00000100:00100000:0.0:1746140871.455833:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:28b972ba-4133-49d1-b679-ce80456803d9+20:1982:x1830960573171584:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746140871.455871:0:21694:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b630e00/0x8156357b7fdb6e27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21694 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.455885:0:21694:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.455887:0:21694:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.455893:0:21694:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b630e00/0x8156357b7fdb6e27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21694 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.455906:0:21694:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b630e00/0x8156357b7fdb6e27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21694 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.498779:0:21376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad4ae00/0x8156357b7fdb6e20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.498797:0:21376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad4ae00/0x8156357b7fdb6e20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.498804:0:21376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ad4ae00/0x8156357b7fdb6e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.498814:0:21376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad4ae00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140871.498817:0:21376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad4ae00/0x8156357b7fdb6e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.498824:0:21376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad4ae00/0x8156357b7fdb6e20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.498840:0:21376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ad4ae00/0x8156357b7fdb6e20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.498844:0:21376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad4ae00/0x8156357b7fdb6e20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140871.499019:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+16:1982:x1830960573171328:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 53296us (53577us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140871.499126:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7933 00000100:00100000:0.0:1746140871.514768:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.519393:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.532572:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.533220:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.537357:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.537414:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.537454:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.537470:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.537495:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.538537:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15668 00000100:00100000:0.0:1746140871.538547:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573173248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140871.538562:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140871.538575:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb6e7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f8f0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.538592:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.538594:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.538599:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb6e7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8f0 expref: 25 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140871.538611:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1a00/0x8156357b7fdb6e7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8f0 expref: 25 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140871.538620:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1a00, rc 0) 00000100:00100000:0.0:1746140871.538648:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573173248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140871.538654:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15668 00000100:00100000:0.0:1746140871.538690:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.538702:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573173632 00000100:00100000:0.0:1746140871.538705:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573173632 00000100:00100000:0.0:1746140871.538777:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.538786:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573173760 00000100:00100000:0.0:1746140871.538788:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573173760 00000100:00100000:0.0:1746140871.538800:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15671 00000100:00100000:0.0:1746140871.538804:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573173760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140871.538810:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140871.538818:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d45a00/0x8156357b7fdb6e90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f90c expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.538833:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.538834:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140871.538839:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d45a00/0x8156357b7fdb6e90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f90c expref: 26 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140871.538848:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d45a00/0x8156357b7fdb6e90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f90c expref: 26 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140871.538855:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d45a00, rc 0) 00000100:00100000:0.0:1746140871.538871:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573173760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140871.538877:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15671 00000100:00100000:0.0:1746140871.542519:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.542989:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.543004:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.543694:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.544173:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.544184:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.544234:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.544248:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.544261:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573175040 00000100:00100000:0.0:1746140871.544268:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573175040 00010000:00010000:0.0:1746140871.544288:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad4b600/0x8156357b7fdb6e51 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8d4 expref: 270 pid: 27790 timeout: 950 lvb_type: 0 00000100:00100000:0.0:1746140871.544318:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573175168 00000100:00100000:0.0:1746140871.544321:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573175168 00010000:00010000:0.0:1746140871.544331:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad4aa00/0x8156357b7fdb6dc5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8a3 expref: 10 pid: 27790 timeout: 950 lvb_type: 0 00000100:00100000:0.0:1746140871.544343:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8057 00000100:00100000:0.0:1746140871.544356:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1982:x1830960573175040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140871.544364:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140871.544368:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad4b600/0x8156357b7fdb6e51 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8d4 expref: 270 pid: 27790 timeout: 950 lvb_type: 0 00010000:00010000:0.0:1746140871.544377:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad4b600/0x8156357b7fdb6e51 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8d4 expref: 270 pid: 27790 timeout: 950 lvb_type: 0 00010000:00010000:0.0:1746140871.544392:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140871.544396:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6e9e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140871.544402:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6e9e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140871.544406:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140871.544421:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1982:x1830960573175040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140871.544426:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8057 00000100:00100000:0.0:1746140871.544435:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8058 00000100:00100000:0.0:1746140871.544439:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573175168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140871.544443:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140871.544447:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad4aa00/0x8156357b7fdb6dc5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8a3 expref: 10 pid: 27790 timeout: 950 lvb_type: 0 00010000:00010000:0.0:1746140871.544457:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad4aa00/0x8156357b7fdb6dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8a3 expref: 10 pid: 27790 timeout: 950 lvb_type: 0 00010000:00010000:0.0:1746140871.544466:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140871.544468:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6e9e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140871.544472:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6e9e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140871.544476:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140871.544485:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573175168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 46us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140871.544489:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8058 00000100:00100000:0.0:1746140871.544512:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.544524:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573174784 00000100:00100000:0.0:1746140871.544527:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573174784 00000100:00100000:0.0:1746140871.545054:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140871.546017:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6e9e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140871.546024:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6e9e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140871.546049:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140871.546743:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb6e97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8e2 expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.546760:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ece1e00/0x8156357b7fdb6e9e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8e2 expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.546766:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140871.546768:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140871.546770:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ece1e00, rc 0) 00000100:00100000:0.0:1746140871.547316:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009950fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32015:x1830960573172992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8344us (9889us total) trans 8589944646 rc 0/0 00000100:00100000:0.0:1746140871.547321:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10436 00000100:00100000:0.0:1746140871.548070:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.548842:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.553326:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.553569:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.553594:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.558428:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7938 00000100:00100000:0.0:1746140871.558440:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573176320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140871.559956:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.559988:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573176448 00000100:00100000:0.0:1746140871.559995:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573176448 00000100:00100000:0.0:1746140871.560033:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10439 00000100:00100000:0.0:1746140871.560040:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32015:x1830960573176448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140871.560061:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140871.560078:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7ad800/0x8156357b7fdb6ef9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f94b expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.560133:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7ad800/0x8156357b7fdb6ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f94b expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.560149:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7ad800/0x8156357b7fdb6ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f94b expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.560166:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140871.560168:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140871.560171:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7ad800, rc 0) 00000100:00100000:0.0:1746140871.560193:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32015:x1830960573176448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 155us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140871.560199:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10439 00000100:00100000:0.0:1746140871.572806:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.573208:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.573237:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.573279:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.576431:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573176064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19681us (22855us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140871.576439:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7937 00002000:00100000:0.0:1746140871.576447:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880136a8c000 x1830960573176064/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:287/0 lens 488/440 e 0 to 0 dl 1746140882 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.576455:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a8c000 with x1830960573176064 ext(1048576->2097151) 00002000:00010000:0.0:1746140871.576460:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a8c000 00000100:00100000:0.0:1746140871.576477:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573177216 00000100:00100000:0.0:1746140871.576481:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573177216 00002000:00100000:0.0:1746140871.576497:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880136a8d180 x1830960573177216/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:287/0 lens 488/0 e 0 to 0 dl 1746140882 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.576503:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a8d180 with x1830960573177216 ext(1048576->2097151) 00002000:00010000:0.0:1746140871.576506:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a8d180 00000100:00100000:0.0:1746140871.580254:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573176320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21816us (26658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140871.580263:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7938 00002000:00100000:0.0:1746140871.580271:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880136a8c380 x1830960573176320/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:287/0 lens 488/440 e 0 to 0 dl 1746140882 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.580280:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a8c380 with x1830960573176320 ext(1048576->2097151) 00002000:00010000:0.0:1746140871.580285:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a8c380 00000100:00100000:0.0:1746140871.580377:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.581323:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.593793:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.594381:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746140871.626035:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944646 is committed 00000001:00080000:0.0:1746140871.626048:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944647 is committed 00000001:00080000:0.0:1746140871.626062:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944648 is committed 00000004:00080000:0.0:1746140871.626067:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2540 committed 00000004:00080000:0.0:1746140871.626074:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2495 committed 00000004:00080000:0.0:1746140871.626080:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2494 committed 00000004:00080000:0.0:1746140871.626081:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2493 committed 00000004:00080000:0.0:1746140871.626083:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2492 committed 00000004:00080000:0.0:1746140871.626085:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2539 committed 00000004:00080000:0.0:1746140871.626086:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2491 committed 00000004:00080000:0.0:1746140871.626088:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2538 committed 00000004:00080000:0.0:1746140871.626089:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2490 committed 00000004:00080000:0.0:1746140871.626090:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2537 committed 00000004:00080000:0.0:1746140871.626092:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2536 committed 00000004:00080000:0.0:1746140871.626093:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2535 committed 00000004:00080000:0.0:1746140871.626094:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2489 committed 00000004:00080000:0.0:1746140871.626097:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2488 committed 00000004:00080000:0.0:1746140871.626099:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2534 committed 00000004:00080000:0.0:1746140871.626101:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2533 committed 00000004:00080000:0.0:1746140871.626103:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2487 committed 00000001:00080000:0.0:1746140871.626108:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944643 is committed 00000100:00100000:0.0:1746140871.626542:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575844224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140871.626565:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627429:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575844736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140871.627447:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627460:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575845504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627476:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627485:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575846016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627498:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627505:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746140871.627508:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575845376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627521:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627527:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575845888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627539:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627553:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575845760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627567:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627573:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575846272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627597:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627607:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746140871.627610:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575845632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627623:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627629:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575846144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627641:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.627655:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575845632 00000100:00100000:0.0:1746140871.627658:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575845632 00000100:00100000:0.0:1746140871.627670:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575846144 00000100:00100000:0.0:1746140871.627671:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575846144 00000100:00100000:0.0:1746140871.627678:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15683 00000100:00100000:0.0:1746140871.627682:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3311:x1830960575844224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140871.627755:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140871.627758:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.627760:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.627761:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.627763:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746140871.627783:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3311:x1830960575844224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (1218us total) trans 17179873855 rc 0/0 00000100:00100000:0.0:1746140871.627788:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15683 00000100:00100000:0.0:1746140871.627799:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15685 00000100:00100000:0.0:1746140871.627803:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3311:x1830960575845504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.627816:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15687 00000100:00100000:0.0:1746140871.628457:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3311:x1830960575845376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140871.628525:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140871.628527:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.628529:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.628531:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.628533:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746140871.628546:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960575845376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (1024us total) trans 21474841119 rc 0/0 00000100:00100000:0.0:1746140871.628554:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15687 00000100:00100000:0.0:1746140871.628561:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15689 00000100:00100000:0.0:1746140871.628565:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960575845760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.628636:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3313:x1830960575845760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1067us total) trans 21474841120 rc 0/0 00000100:00100000:0.0:1746140871.628640:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15689 00000100:00100000:0.0:1746140871.628649:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15690 00000100:00100000:0.0:1746140871.628653:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960575846272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.628720:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3313:x1830960575846272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1121us total) trans 21474841121 rc 0/0 00000100:00100000:0.0:1746140871.628725:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15690 00000100:00100000:0.0:1746140871.628734:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15691 00000100:00100000:0.0:1746140871.628738:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960575845632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140871.628806:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4747392 -> 4747392 00002000:00010000:0.0:1746140871.628808:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.628810:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.628812:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.628814:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5249 -> 5249 00000100:00100000:0.0:1746140871.628831:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3313:x1830960575845632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1206us total) trans 21474841122 rc 0/0 00000100:00100000:0.0:1746140871.628835:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15691 00000100:00100000:0.0:1746140871.628846:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15692 00000100:00100000:0.0:1746140871.628850:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960575846144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.628922:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3313:x1830960575846144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1279us total) trans 21474841123 rc 0/0 00000100:00100000:0.0:1746140871.628928:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15692 00000004:00080000:0.0:1746140871.629016:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece2d80/2, rc 0, transno 21474841122 00000100:00100000:0.0:1746140871.629025:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575845632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140871.629033:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e1c00/2, rc 0, transno 21474841123 00000100:00100000:0.0:1746140871.629036:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575846144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140871.629042:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece1880/2, rc 0, transno 21474841120 00000100:00100000:0.0:1746140871.629045:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575845760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140871.629050:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e0000/2, rc 0, transno 21474841121 00000100:00100000:0.0:1746140871.629053:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575846272:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140871.629156:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140871.629159:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.629161:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.629162:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140870 -> 1746140870 00002000:00010000:0.0:1746140871.629164:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140871.629182:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960575845504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1379us (1705us total) trans 21474841124 rc 0/0 00000100:00100000:0.0:1746140871.629187:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15685 00000004:00080000:0.0:1746140871.629208:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e4c700/2, rc 0, transno 21474841119 00000100:00100000:0.0:1746140871.629211:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575845376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140871.629218:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece2300/2, rc 0, transno 21474841124 00000100:00100000:0.0:1746140871.629220:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575845504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140871.629225:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e0700/2, rc 0, transno 21474841118 00000100:00100000:0.0:1746140871.629227:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575846016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140871.629237:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b459c00/2, rc 0, transno 17179873855 00000100:00100000:0.0:1746140871.629240:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575844224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140871.629247:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ade680/2, rc 0, transno 17179873856 00000100:00100000:0.0:1746140871.629250:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575844736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140871.629253:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746140871.629259:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575846400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.629281:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140871.629300:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575846400 00000100:00100000:0.0:1746140871.629335:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575846400 00000100:00100000:0.0:1746140871.629364:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15693 00000100:00100000:0.0:1746140871.629368:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960575846400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.629443:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3311:x1830960575846400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (162us total) trans 21474841125 rc 0/0 00000100:00100000:0.0:1746140871.629448:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15693 00000004:00080000:0.0:1746140871.629464:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ea8a80/2, rc 0, transno 21474841125 00000100:00100000:0.0:1746140871.629467:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575846400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.629477:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140871.629498:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b459880/2, rc 0, transno 17179873857 00000100:00100000:0.0:1746140871.629501:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575844352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140871.629508:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adfb80/2, rc 0, transno 17179873853 00000100:00100000:0.0:1746140871.629510:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575844864:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140871.629517:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b459f80/2, rc 0, transno 17179873854 00000100:00100000:0.0:1746140871.629519:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575844480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140871.629528:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575844992 00000100:00100000:0.0:1746140871.629530:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575844992 00000100:00100000:0.0:1746140871.629541:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15694 00000100:00100000:0.0:1746140871.629545:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3312:x1830960575844992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140871.629626:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3312:x1830960575844992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (147us total) trans 17179873858 rc 0/0 00000100:00100000:0.0:1746140871.629631:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15694 00000004:00080000:0.0:1746140871.629647:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f884000/2, rc 0, transno 17179873858 00000100:00100000:0.0:1746140871.629650:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575844992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140871.633329:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e0380/2, rc 0, transno 21474841126 00000100:00100000:0.0:1746140871.633344:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575845888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140871.633406:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573178368 00000100:00100000:0.0:1746140871.633411:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573178368 00000100:00100000:0.0:1746140871.633446:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4513 00000100:00100000:0.0:1746140871.633452:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32020:x1830960573178368:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746140871.634005:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32020:x1830960573178368:12345-192.168.204.16@tcp:49:cat.0 Request processed in 551us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140871.634012:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4513 00000100:00100000:0.0:1746140871.634157:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573178496 00000100:00100000:0.0:1746140871.634160:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573178496 00000100:00100000:0.0:1746140871.634177:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4514 00000100:00100000:0.0:1746140871.634182:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae18850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32021:x1830960573178496:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746140871.634223:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae18850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32021:x1830960573178496:12345-192.168.204.16@tcp:49:cat.0 Request processed in 40us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140871.634229:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4514 00000100:00100000:0.0:1746140871.643450:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.646162:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.651124:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.651162:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.651191:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.654787:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.659931:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.661794:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.665445:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575847040:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140871.665479:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f58fe00/0x8156357b7fdb6f23 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2871296->3145727] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f96e expref: 29 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140871.665507:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f58fe00, rc 0) 00000100:00100000:0.0:1746140871.665548:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:32017:x1830960573179904:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7752us (7865us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140871.665557:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15697 00000100:00100000:0.0:1746140871.666727:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.684075:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.684784:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.688599:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.694428:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.696878:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.701255:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.701384:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.701408:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.701431:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.702208:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.705270:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.709444:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573182592 00000100:00100000:0.0:1746140871.709454:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573182592 00002000:00100000:0.0:1746140871.709487:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2781184->2785279) req@ffff8800a55e2300 x1830960573182592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:287/0 lens 488/0 e 0 to 0 dl 1746140882 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.709497:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e2300 with x1830960573182592 ext(2781184->2785279) 00002000:00010000:0.0:1746140871.709501:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55e2300 00000100:00100000:0.0:1746140871.709518:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7951 00000100:00100000:0.0:1746140871.709524:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573182592:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140871.709700:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573182592:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 175us (333us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140871.709706:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7951 00002000:00100000:0.0:1746140871.709711:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2781184->2785279) req@ffff8800a55e2300 x1830960573182592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746140882 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.709718:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e2300 with x1830960573182592 ext(2781184->2785279) 00002000:00010000:0.0:1746140871.709720:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55e2300 00000100:00100000:0.0:1746140871.718584:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.719671:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.728135:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.729367:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.729380:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.729399:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.730629:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.730643:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573184128 00000100:00100000:0.0:1746140871.730647:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573184128 00002000:00100000:0.0:1746140871.730667:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (3833856->4194303) req@ffff88009b582680 x1830960573184128/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:287/0 lens 488/0 e 0 to 0 dl 1746140882 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.730678:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b582680 with x1830960573184128 ext(3833856->4194303) 00002000:00010000:0.0:1746140871.730682:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b582680 00000100:00100000:0.0:1746140871.730694:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7956 00000100:00100000:0.0:1746140871.730699:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573184128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140871.754429:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.755951:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.756578:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573184640 00000100:00100000:0.0:1746140871.756582:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573184640 00002000:00100000:0.0:1746140871.756600:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2785279) req@ffff88009f886300 x1830960573184640/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:287/0 lens 488/0 e 0 to 0 dl 1746140882 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.756606:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f886300 with x1830960573184640 ext(2097152->2785279) 00010000:00010000:0.0:1746140871.756611:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d7adc00/0x8156357b7fdb6f31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f97c expref: 36 pid: 12255 timeout: 950 lvb_type: 0 00010000:00010000:0.0:1746140871.756622:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d7adc00/0x8156357b7fdb6f31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f97c expref: 36 pid: 12255 timeout: 950 lvb_type: 0 00002000:00010000:0.0:1746140871.756627:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f886300 00000100:00100000:0.0:1746140871.756646:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1622 00000100:00100000:0.0:1746140871.756651:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573184640:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140871.764355:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.769651:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.772506:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.776554:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.780010:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.780047:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.780074:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.780380:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7960 00000100:00100000:0.0:1746140871.780388:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573186048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140871.799948:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.805794:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.813268:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.815234:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.815410:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.817391:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.820636:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.822367:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.830528:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.833832:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.848809:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.852194:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.852242:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.854423:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.856528:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.856553:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573189120 00000100:00100000:0.0:1746140871.856558:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573189120 00002000:00100000:0.0:1746140871.856588:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1294336->1298431) req@ffff88009008ea00 x1830960573189120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:287/0 lens 488/0 e 0 to 0 dl 1746140882 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.856597:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009008ea00 with x1830960573189120 ext(1294336->1298431) 00002000:00010000:0.0:1746140871.856601:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009008ea00 00000100:00100000:0.0:1746140871.856630:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7963 00000100:00100000:0.0:1746140871.856637:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009008ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573189120:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140871.856785:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009008ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573189120:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 147us (257us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140871.856791:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7963 00002000:00100000:0.0:1746140871.856797:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1294336->1298431) req@ffff88009008ea00 x1830960573189120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746140882 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140871.856805:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009008ea00 with x1830960573189120 ext(1294336->1298431) 00002000:00010000:0.0:1746140871.856807:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009008ea00 00000100:00100000:0.0:1746140871.860212:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.940301:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.946147:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.946735:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.957395:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.974179:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.979032:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.982880:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.984875:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.985425:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140871.993588:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.009443:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.017825:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.017870:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.017900:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.017925:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.017960:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.017982:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573192448 00000100:00100000:0.0:1746140872.017985:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573192448 00000100:00100000:0.0:1746140872.018275:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15710 00000100:00100000:0.0:1746140872.018283:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573192448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.018293:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.018334:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d0d8400/0x8156357b7fdb702d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829f9ec expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.018363:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.018365:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.018373:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d0d8400/0x8156357b7fdb702d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f9ec expref: 41 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.018387:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d0d8400/0x8156357b7fdb702d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f9ec expref: 41 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.018396:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d0d8400, rc 0) 00000100:00100000:0.0:1746140872.018435:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573192448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 154us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.018442:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15710 00000100:00100000:0.0:1746140872.038561:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.046237:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.046269:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.061595:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.061652:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.072381:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.097721:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.102036:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.113509:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.118184:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140872.118479:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140872.121975:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.123678:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.123723:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.126609:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.126629:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573195136 00000100:00100000:0.0:1746140872.126635:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573195136 00010000:00010000:0.0:1746140872.126663:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad4b400/0x8156357b7fdb6dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8aa expref: 13 pid: 20960 timeout: 951 lvb_type: 1 00000100:00100000:0.0:1746140872.126685:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573195264 00000100:00100000:0.0:1746140872.126687:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573195264 00010000:00010000:0.0:1746140872.126696:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad4be00/0x8156357b7fdb6eba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f91a expref: 31 pid: 24958 timeout: 951 lvb_type: 1 00000100:00100000:0.0:1746140872.126711:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8078 00000100:00100000:0.0:1746140872.126716:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+13:1983:x1830960573195136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.126725:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.126744:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad4b400/0x8156357b7fdb6dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8aa expref: 13 pid: 20960 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.126755:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad4b400/0x8156357b7fdb6dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8aa expref: 13 pid: 20960 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.126776:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad4b400/0x8156357b7fdb6dd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f8aa expref: 13 pid: 20960 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.126797:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140872.126820:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573195136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.126826:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8078 00000100:00100000:0.0:1746140872.126846:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8079 00000100:00100000:0.0:1746140872.126851:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573195264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.126857:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.126865:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad4be00/0x8156357b7fdb6eba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f91a expref: 31 pid: 24958 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.126872:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad4be00/0x8156357b7fdb6eba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f91a expref: 31 pid: 24958 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.126882:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad4be00/0x8156357b7fdb6eba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f91a expref: 31 pid: 24958 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.126890:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140872.126903:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573195264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.126908:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8079 00000100:00100000:0.0:1746140872.147882:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.154454:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.159084:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.159211:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.166781:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8082 00000100:00100000:0.0:1746140872.166788:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573196544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.166794:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.166803:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f58e600/0x8156357b7fdb705e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa01 expref: 41 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.166809:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f58e600/0x8156357b7fdb705e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa01 expref: 41 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.166819:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f58e600/0x8156357b7fdb705e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa01 expref: 41 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.166830:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.166832:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.166838:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308d5000/0x8156357b7fdb7073 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa16 expref: 40 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.166847:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308d5000/0x8156357b7fdb7073 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa16 expref: 39 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.166878:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308d5000/0x8156357b7fdb7073 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa16 expref: 39 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.166890:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b458700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575851520:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140872.166960:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.170658:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.170678:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.170780:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b458700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575851520:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140872.170795:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140872.170828:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573196544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4041us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.170836:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8082 00000100:00100000:0.0:1746140872.170860:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15718 00000100:00100000:0.0:1746140872.170865:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573196800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.170872:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.170881:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eecec00/0x8156357b7fdb7088 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa2b expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.170904:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b458700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575851904:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140872.170924:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.171997:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.172489:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573197056 00000100:00100000:0.0:1746140872.172495:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573197056 00002000:00100000:0.0:1746140872.172530:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3428352->3432447) req@ffff88009b458e00 x1830960573197056/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:288/0 lens 488/0 e 0 to 0 dl 1746140883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.172540:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b458e00 with x1830960573197056 ext(3428352->3432447) 00002000:00010000:0.0:1746140872.172544:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b458e00 00000100:00100000:0.0:1746140872.172561:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7974 00000100:00100000:0.0:1746140872.172567:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1983:x1830960573197056:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140872.172750:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1983:x1830960573197056:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 183us (754us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140872.172756:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7974 00002000:00100000:0.0:1746140872.172761:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3428352->3432447) req@ffff88009b458e00 x1830960573197056/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746140883 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.172769:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b458e00 with x1830960573197056 ext(3428352->3432447) 00002000:00010000:0.0:1746140872.172771:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b458e00 00000100:00100000:0.0:1746140872.172846:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.172894:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573197312 00000100:00100000:0.0:1746140872.172897:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573197312 00002000:00100000:0.0:1746140872.172911:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1282048->1286143) req@ffff88012b181500 x1830960573197312/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/0 e 0 to 0 dl 1746140883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.172918:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181500 with x1830960573197312 ext(1282048->1286143) 00002000:00010000:0.0:1746140872.172921:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b181500 00000100:00100000:0.0:1746140872.172933:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7975 00000100:00100000:0.0:1746140872.172938:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573197312:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140872.173009:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573197312:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 71us (163us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140872.173014:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7975 00002000:00100000:0.0:1746140872.173019:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1282048->1286143) req@ffff88012b181500 x1830960573197312/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746140883 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.173026:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181500 with x1830960573197312 ext(1282048->1286143) 00002000:00010000:0.0:1746140872.173029:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b181500 00002000:00010000:0.0:1746140872.176506:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime: 1746140870 -> 1746140872 00002000:00010000:0.0:1746140872.176512:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime: 1746140870 -> 1746140872 00002000:00010000:0.0:1746140872.176514:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime: 1746140870 -> 1746140872 00000100:00100000:0.0:1746140872.176535:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b458700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575851904:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140872.176563:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eecec00/0x8156357b7fdb7088 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa2b expref: 40 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.176578:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eecec00/0x8156357b7fdb7088 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa2b expref: 40 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.176592:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eecec00, rc 0) 00000100:00100000:0.0:1746140872.176641:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573196800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5774us (5960us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140872.176649:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15718 00000100:00100000:0.0:1746140872.180042:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.181562:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.181624:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.181639:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573197568 00000100:00100000:0.0:1746140872.181643:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573197568 00000100:00100000:0.0:1746140872.181662:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573197696 00000100:00100000:0.0:1746140872.181664:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573197696 00000100:00100000:0.0:1746140872.181677:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15720 00000100:00100000:0.0:1746140872.181682:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573197568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.181691:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.181701:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eecf800/0x8156357b7fdb7096 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa39 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.181732:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009950ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575852288:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140872.181764:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.181779:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15721 00000100:00100000:0.0:1746140872.181785:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573197696:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.181792:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.181801:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eecec00/0x8156357b7fdb709d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa40 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.181823:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009950c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575852416:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140872.181841:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.186123:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009950c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575852416:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140872.186152:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eecec00/0x8156357b7fdb709d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa40 expref: 40 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.186166:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eecec00/0x8156357b7fdb709d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa40 expref: 40 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.186178:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eecec00, rc 0) 00000100:00100000:0.0:1746140872.186213:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573197696:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4427us (4588us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140872.186221:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15721 00000100:00100000:0.0:1746140872.193584:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.193661:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.201154:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.201178:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573198464 00000100:00100000:0.0:1746140872.201184:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573198464 00002000:00100000:0.0:1746140872.201220:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4239360->4243455) req@ffff88009950d500 x1830960573198464/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:288/0 lens 488/0 e 0 to 0 dl 1746140883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.201230:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009950d500 with x1830960573198464 ext(4239360->4243455) 00002000:00010000:0.0:1746140872.201234:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009950d500 00000100:00100000:0.0:1746140872.201251:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7976 00000100:00100000:0.0:1746140872.201258:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009950d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573198464:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140872.201415:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009950d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573198464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 157us (513us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140872.201421:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7976 00002000:00100000:0.0:1746140872.201426:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4239360->4243455) req@ffff88009950d500 x1830960573198464/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746140883 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.201433:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009950d500 with x1830960573198464 ext(4239360->4243455) 00002000:00010000:0.0:1746140872.201436:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009950d500 00000100:00100000:0.0:1746140872.203020:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.203042:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573198720 00000100:00100000:0.0:1746140872.203047:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573198720 00000100:00100000:0.0:1746140872.203076:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10449 00000100:00100000:0.0:1746140872.203082:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009950ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32048:x1830960573198720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.203099:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.203116:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf400/0x8156357b7fdb70a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa47 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.203196:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.203208:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.203218:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.203229:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.203238:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.203242:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204216:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecec00/0x8156357b7fdb70b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204227:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecec00/0x8156357b7fdb70b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204233:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecec00/0x8156357b7fdb70b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140872.204241:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140872.204394:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204401:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204406:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204411:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eece000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140872.204414:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204419:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204429:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140872.204432:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140872.204436:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204440:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece000/0x8156357b7fdb70ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204453:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204457:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204461:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204465:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eecf800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140872.204467:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204472:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204477:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f3ee900) 00010000:00010000:0.0:1746140872.204479:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140872.204481:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204485:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf800/0x8156357b7fdb70b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.204524:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecf400/0x8156357b7fdb70a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa47 expref: 20 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.204540:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eecec00/0x8156357b7fdb70b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa47 expref: 19 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.204546:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140872.204548:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140872.204550:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eecec00, rc 0) 00000100:00100000:0.0:1746140872.204588:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009950ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:32048:x1830960573198720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1506us (1572us total) trans 8589944663 rc 0/0 00000100:00100000:0.0:1746140872.204595:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10449 00000100:00100000:0.0:1746140872.208057:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.208087:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.212220:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.226365:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.226398:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573199360 00000100:00100000:0.0:1746140872.226408:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573199360 00002000:00100000:0.0:1746140872.226448:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a0:0x0] (0->749567) req@ffff88009950f800 x1830960573199360/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/0 e 0 to 0 dl 1746140883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.226458:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009950f800 with x1830960573199360 ext(0->749567) 00002000:00010000:0.0:1746140872.226463:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009950f800 00000100:00100000:0.0:1746140872.227014:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573199616 00000100:00100000:0.0:1746140872.227018:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573199616 00002000:00100000:0.0:1746140872.227035:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1286144->2097151) req@ffff88009f885f80 x1830960573199616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/0 e 0 to 0 dl 1746140883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.227042:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f885f80 with x1830960573199616 ext(1286144->2097151) 00002000:00010000:0.0:1746140872.227046:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f885f80 00000100:00100000:0.0:1746140872.227060:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7978 00000100:00100000:0.0:1746140872.227065:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573199616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140872.238666:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573199616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11592us (11861us total) trans 0 rc 811008/811008 00000100:00100000:0.0:1746140872.238677:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7978 00002000:00100000:0.0:1746140872.238689:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1286144->2097151) req@ffff88009f885f80 x1830960573199616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/440 e 0 to 0 dl 1746140883 ref 1 fl Complete:/200/0 rc 811008/811008 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.238698:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f885f80 with x1830960573199616 ext(1286144->2097151) 00002000:00010000:0.0:1746140872.238704:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f885f80 00000001:00080000:0.0:1746140872.273049:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873858 is committed 00000001:00080000:0.0:1746140872.273090:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873811 is committed 00000001:00080000:0.0:1746140872.273109:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873779 is committed 00000001:00080000:0.0:1746140872.273120:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873840 is committed 00000001:00080000:0.0:1746140872.273141:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873812 is committed 00000001:00080000:0.0:1746140872.273179:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873862 is committed 00000001:00080000:0.0:1746140872.273185:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873861 is committed 00000001:00080000:0.0:1746140872.273208:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873823 is committed 00000001:00080000:0.0:1746140872.273243:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873859 is committed 00000100:00100000:0.0:1746140872.279584:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573200512 00000100:00100000:0.0:1746140872.279592:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573200512 00002000:00100000:0.0:1746140872.279629:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b893b80 x1830960573200512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/0 e 0 to 0 dl 1746140883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.279639:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893b80 with x1830960573200512 ext(2097152->3145727) 00002000:00010000:0.0:1746140872.279868:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b893b80 00000100:00100000:0.0:1746140872.279895:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7979 00000100:00100000:0.0:1746140872.279903:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573200512:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140872.293097:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.295683:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.310559:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.323944:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.323990:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.334920:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.349903:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.349926:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.349944:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.349967:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.349987:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573202048 00000100:00100000:0.0:1746140872.349996:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573202048 00000100:00100000:0.0:1746140872.350031:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573202304 00000100:00100000:0.0:1746140872.350033:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573202304 00000100:00100000:0.0:1746140872.350049:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15728 00000100:00100000:0.0:1746140872.350055:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1982:x1830960573202048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.350072:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.350086:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927c5400/0x8156357b7fdb7114 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa7f expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.350134:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e9a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575853696:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140872.350192:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15729 00000100:00100000:0.0:1746140872.350197:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573202304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.350204:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.350213:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927c4e00/0x8156357b7fdb711b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa86 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.350253:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e9a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575853824:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140872.350278:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573202560 00000100:00100000:0.0:1746140872.350281:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573202560 00000100:00100000:0.0:1746140872.350327:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10451 00000100:00100000:0.0:1746140872.350343:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:32054:x1830960573202560:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140872.350354:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.350366:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099657a00/0x8156357b7fdb7122 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa8d expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.350465:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350476:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350485:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350498:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350503:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350507:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350608:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ff000/0x8156357b7fdb7137 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350621:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ff000/0x8156357b7fdb7137 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350626:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ff000/0x8156357b7fdb7137 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:0.0:1746140872.350635:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140872.350709:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350715:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350720:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350725:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136209e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140872.350729:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350735:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350746:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140872.350749:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140872.350752:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350757:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136209e00/0x8156357b7fdb7129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350772:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350780:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350785:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350789:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ae9e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140872.350791:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350796:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350802:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f66a800) 00010000:00010000:0.0:1746140872.350804:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140872.350806:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350811:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ae9e00/0x8156357b7fdb7130 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140872.350844:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099657a00/0x8156357b7fdb7122 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa8d expref: 281 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.350855:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ff000/0x8156357b7fdb7137 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa8d expref: 280 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.350862:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140872.350864:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140872.350866:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ff000, rc 0) 00000100:00100000:0.0:1746140872.350888:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:32054:x1830960573202560:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 555us (996us total) trans 8589944665 rc 0/0 00000100:00100000:0.0:1746140872.350894:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10451 00000100:00100000:0.0:1746140872.351822:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008eef3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.352698:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.354201:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.354286:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.354345:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573202688 00000100:00100000:0.0:1746140872.354352:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573202688 00000100:00100000:0.0:1746140872.354385:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573202816 00000100:00100000:0.0:1746140872.354387:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573202816 00000100:00100000:0.0:1746140872.354401:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15730 00000100:00100000:0.0:1746140872.354407:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573202688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.354421:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.354436:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b5fee00/0x8156357b7fdb7145 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa94 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.354454:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.354456:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.354464:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5fee00/0x8156357b7fdb7145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa94 expref: 16 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.354479:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b5fee00/0x8156357b7fdb7145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa94 expref: 16 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.354490:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5fee00, rc 0) 00000100:00100000:0.0:1746140872.354521:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573202688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 114us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.354526:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15730 00000100:00100000:0.0:1746140872.354539:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15731 00000100:00100000:0.0:1746140872.354544:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573202816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.354600:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.354609:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b5ffa00/0x8156357b7fdb714c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fa9b expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.354619:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.354621:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.354625:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b5ffa00/0x8156357b7fdb714c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa9b expref: 23 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.354634:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b5ffa00/0x8156357b7fdb714c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa9b expref: 23 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.354642:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ffa00, rc 0) 00000100:00100000:0.0:1746140872.354656:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1983:x1830960573202816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 112us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.354661:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15731 00002000:00010000:0.0:1746140872.354698:0:4784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime: 1746140872 -> 1746140873 00000100:00100000:0.0:1746140872.354717:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e9a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575853696:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140872.354739:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927c5400/0x8156357b7fdb7114 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa7f expref: 15 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.354747:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927c5400/0x8156357b7fdb7114 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa7f expref: 15 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.354756:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927c5400, rc 0) 00000100:00100000:0.0:1746140872.354773:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573202048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4719us (4846us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140872.354778:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15728 00000100:00100000:0.0:1746140872.354811:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.360881:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.365098:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.365148:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.372279:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.373102:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.382391:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.393495:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.394734:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.397958:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.402445:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.404842:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.404886:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.409136:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.409651:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.409718:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.415205:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.415285:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.416809:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.419092:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.419266:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.419491:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.420229:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.420242:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573206784 00000100:00100000:0.0:1746140872.420245:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573206784 00010000:00010000:0.0:1746140872.420259:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5fee00/0x8156357b7fdb7145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa94 expref: 17 pid: 32376 timeout: 951 lvb_type: 1 00000100:00100000:0.0:1746140872.420272:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8094 00000100:00100000:0.0:1746140872.420276:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1984:x1830960573206784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.420283:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.420295:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b5fee00/0x8156357b7fdb7145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa94 expref: 17 pid: 32376 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.420317:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b5fee00/0x8156357b7fdb7145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa94 expref: 17 pid: 32376 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.420329:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b5fee00/0x8156357b7fdb7145 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa94 expref: 17 pid: 32376 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.420356:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140872.420370:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573206784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.420375:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8094 00000100:00100000:0.0:1746140872.425547:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960573206656:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5834us (6054us total) trans 17179873864 rc 0/0 00000100:00100000:0.0:1746140872.425555:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1628 00002000:00100000:0.0:1746140872.425563:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1286143) req@ffff880135f95500 x1830960573206656/t17179873864(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/448 e 0 to 0 dl 1746140883 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.425572:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f95500 with x1830960573206656 ext(1048576->1286143) 00010000:00010000:0.0:1746140872.425578:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b7c00/0x8156357b7fdb707a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa1d expref: 9 pid: 12255 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.425590:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b1b7c00/0x8156357b7fdb707a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fa1d expref: 9 pid: 12255 timeout: 951 lvb_type: 0 00002000:00010000:0.0:1746140872.425596:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135f95500 00000100:00100000:0.0:1746140872.428396:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.432129:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.432172:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.433516:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.437130:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.437572:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.453613:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.455513:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.460685:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.466112:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.479832:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.482418:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.486631:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.489740:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960575856640:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140872.489759:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140872.489805:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573209600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2975us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.489814:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8101 00000100:00100000:0.0:1746140872.490968:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.513408:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.516734:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573210368 00000100:00100000:0.0:1746140872.516745:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573210368 00002000:00100000:0.0:1746140872.516786:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f887100 x1830960573210368/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:288/0 lens 488/0 e 0 to 0 dl 1746140883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.516797:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f887100 with x1830960573210368 ext(3145728->4194303) 00002000:00010000:0.0:1746140872.516803:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f887100 00000100:00100000:0.0:1746140872.516829:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7993 00000100:00100000:0.0:1746140872.516836:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960573210368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140872.536913:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1983:x1830960573210368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20068us (20238us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140872.536924:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7993 00002000:00100000:0.0:1746140872.536934:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f887100 x1830960573210368/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:288/0 lens 488/440 e 0 to 0 dl 1746140883 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.537043:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f887100 with x1830960573210368 ext(3145728->4194303) 00002000:00010000:0.0:1746140872.537049:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f887100 00000100:00100000:0.0:1746140872.549275:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.549859:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.555227:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.561821:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.564096:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.564805:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.625432:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.630467:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.630510:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.630540:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.630556:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.631080:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746140872.634261:0:4782:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime: 1746140872 -> 1746140873 00002000:00010000:0.0:1746140872.634270:0:4782:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140872 -> 1746140873 00002000:00010000:0.0:1746140872.634272:0:4782:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime: 1746140872 -> 1746140873 00000100:00100000:0.0:1746140872.634293:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575857152:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140872.634352:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b1cd200/0x8156357b7fdb7248 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb27 expref: 12 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.634363:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b1cd200/0x8156357b7fdb7248 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb27 expref: 12 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.634379:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1cd200, rc 0) 00000100:00100000:0.0:1746140872.634409:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1982:x1830960573213824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2416us (2516us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140872.634416:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15747 00000100:00100000:0.0:1746140872.634599:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.634623:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573213952 00000100:00100000:0.0:1746140872.634627:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573213952 00010000:00010000:0.0:1746140872.634648:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1b6400/0x8156357b7fdb7161 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fab0 expref: 13 pid: 4785 timeout: 951 lvb_type: 1 00000100:00100000:0.0:1746140872.634668:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8102 00000100:00100000:0.0:1746140872.634674:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573213952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.634684:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.634697:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b1b6400/0x8156357b7fdb7161 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fab0 expref: 13 pid: 4785 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.634711:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b1b6400/0x8156357b7fdb7161 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fab0 expref: 13 pid: 4785 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746140872.634726:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140872.634740:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573213952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.634745:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8102 00000100:00100000:0.0:1746140872.636804:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.638557:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573214208 00000100:00100000:0.0:1746140872.638562:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573214208 00010000:00010000:0.0:1746140872.638582:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdb7153 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829faa2 expref: 16 pid: 8459 timeout: 951 lvb_type: 0 00000100:00100000:0.0:1746140872.638615:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8103 00000100:00100000:0.0:1746140872.638621:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573214208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.638630:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.638651:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdb7153 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829faa2 expref: 16 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.638661:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdb7153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829faa2 expref: 16 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.638677:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdb7153 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829faa2 expref: 16 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.638687:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.638688:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.638694:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228e00/0x8156357b7fdb722c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 135168->872447) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb04 expref: 15 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.638701:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5228e00/0x8156357b7fdb722c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 135168->872447) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb04 expref: 15 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.638721:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5228e00/0x8156357b7fdb722c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 135168->872447) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb04 expref: 15 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.638731:0:9847:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5228e00/0x8156357b7fdb722c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 135168->872447) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb04 expref: 15 pid: 4785 timeout: 951 lvb_type: 0 00000100:00100000:0.0:1746140872.638741:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099496a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575857408:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140872.638910:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008eef33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.641136:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.649026:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.655681:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.657820:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.663778:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.666391:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573215360 00000100:00100000:0.0:1746140872.666394:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573215360 00010000:00010000:0.0:1746140872.666409:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed99000/0x8156357b7fdb71ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fae1 expref: 22 pid: 8459 timeout: 951 lvb_type: 0 00000100:00100000:0.0:1746140872.666434:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8105 00000100:00100000:0.0:1746140872.666438:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573215360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.666447:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.666454:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed99000/0x8156357b7fdb71ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fae1 expref: 22 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.666461:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed99000/0x8156357b7fdb71ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fae1 expref: 22 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.666471:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed99000/0x8156357b7fdb71ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fae1 expref: 22 pid: 8459 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746140872.666491:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.666494:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.666500:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0600/0x8156357b7fdb7256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb35 expref: 10 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.666507:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0600/0x8156357b7fdb7256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb35 expref: 10 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.666541:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0600/0x8156357b7fdb7256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb35 expref: 10 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.666551:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009950c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960575857792:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140872.666595:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008eef3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.669603:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.671984:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.676767:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.677805:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.678900:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.678971:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.698663:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.700920:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.719470:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.719526:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.728853:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.733196:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.748170:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.755499:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.771159:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.779264:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.783297:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.788570:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.791435:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.797492:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.801904:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.808234:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.808271:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.808357:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.808540:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8007 00000100:00100000:0.0:1746140872.808547:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573219968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140872.808962:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.808991:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.809224:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.809240:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.809254:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573220480 00000100:00100000:0.0:1746140872.809258:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573220480 00000100:00100000:0.0:1746140872.809282:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573220608 00000100:00100000:0.0:1746140872.809284:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573220608 00000100:00100000:0.0:1746140872.809295:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573220736 00000100:00100000:0.0:1746140872.809296:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573220736 00000100:00100000:0.0:1746140872.809365:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15754 00000100:00100000:0.0:1746140872.809371:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960573220480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.809381:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.809398:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed43200/0x8156357b7fdb72bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fb66 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.809417:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.809419:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.809427:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed43200/0x8156357b7fdb72bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb66 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.809441:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed43200/0x8156357b7fdb72bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb66 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.809451:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43200, rc 0) 00000100:00100000:0.0:1746140872.809498:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573220480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 127us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.809504:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15754 00000100:00100000:0.0:1746140872.809520:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15755 00000100:00100000:0.0:1746140872.809524:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573220608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140872.809530:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.809540:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed42c00/0x8156357b7fdb72c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fb6d expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.809581:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094786300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575858816:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140872.809634:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008eef3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.809688:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.812385:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746140872.812876:0:4782:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140872 -> 1746140873 00000100:00100000:0.0:1746140872.812897:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094786300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575858816:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140872.812922:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42c00/0x8156357b7fdb72c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb6d expref: 24 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.812934:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42c00/0x8156357b7fdb72c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb6d expref: 24 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140872.813106:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42c00, rc 0) 00000100:00100000:0.0:1746140872.813138:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573220608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3612us (3913us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140872.813145:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15755 00000100:00100000:0.0:1746140872.819156:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.828812:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.828866:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.835261:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.835817:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.841155:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.847612:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.854893:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.855656:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.860694:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.864578:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.875531:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.880476:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.880798:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.880836:0:14739:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573223552 00000100:00100000:0.0:1746140872.880842:0:14739:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573223552 00000100:00100000:0.0:1746140872.880877:0:14739:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00100000:0.0:1746140872.880884:0:14739:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d247991d-e844-4b62-b954-6487bd25e6e9+15:1985:x1830960573223552:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746140872.880929:0:14739:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d247991d-e844-4b62-b954-6487bd25e6e9+15:1985:x1830960573223552:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.880935:0:14739:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00100000:0.0:1746140872.880986:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.885058:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8014 00000100:00100000:0.0:1746140872.885072:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573224960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140872.885125:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8015 00000100:00100000:0.0:1746140872.885128:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573225216:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140872.885239:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573225216:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 108us (975us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140872.885244:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8015 00002000:00100000:0.0:1746140872.885250:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1638400->1642495) req@ffff8801359b2300 x1830960573225216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746140883 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.885258:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b2300 with x1830960573225216 ext(1638400->1642495) 00002000:00010000:0.0:1746140872.885263:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b2300 00000100:00100000:0.0:1746140872.895667:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.901153:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.901697:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.905181:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.905218:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.905838:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.909445:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.909527:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.912625:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.912667:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.915297:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.916956:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.917028:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.920340:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.920380:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.920868:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.924041:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.930691:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.934082:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.934176:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.934220:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4533 00000100:00100000:0.0:1746140872.934228:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+27:7722:x1830960573228672:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746140872.934635:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:7722:x1830960573228672:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 408us (563us total) trans 8589944683 rc 0/0 00000100:00100000:0.0:1746140872.934641:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4533 00000100:00100000:0.0:1746140872.936218:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.936263:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.938943:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.938972:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.938996:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.939018:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.939051:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.939373:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.939457:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15773 00000100:00100000:0.0:1746140872.939465:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573229440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140872.939472:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140872.939481:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a09600/0x8156357b7fdb737c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fbf9 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.939505:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575861760:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140872.939528:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008eef3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140872.943902:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.946636:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140872.946995:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdb739f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.947003:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdb739f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140872.947020:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 8941696 00010000:00010000:0.0:1746140872.947152:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec30400/0x8156357b7fdb7398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc0e expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.947179:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdb739f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc0e expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.947193:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88012bf7f700) 00010000:00010000:0.0:1746140872.947196:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140872.947198:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e595800, rc 0) 00000100:00100000:0.0:1746140872.947298:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:32083:x1830960573229952:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3247us (3405us total) trans 8589944685 rc 0/0 00000100:00100000:0.0:1746140872.947340:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10460 00000100:00100000:0.0:1746140872.949141:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.951182:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.952979:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.953010:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.953032:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.957387:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.959770:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.959878:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.959908:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.960038:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.960229:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.960262:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.962073:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575862528:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140872.962084:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.962150:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f884700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575863424:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140872.962156:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575863680:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140872.962172:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573231872 00000100:00100000:0.0:1746140872.962176:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573231872 00002000:00100000:0.0:1746140872.962205:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1114111) req@ffff88009abdf480 x1830960573231872/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/0 e 0 to 0 dl 1746140883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.962214:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf480 with x1830960573231872 ext(1048576->1114111) 00010000:00010000:0.0:1746140872.962220:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a0bf600/0x8156357b7fdb731a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fba5 expref: 11 pid: 4782 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140872.962229:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a0bf600/0x8156357b7fdb731a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fba5 expref: 11 pid: 4782 timeout: 952 lvb_type: 0 00002000:00010000:0.0:1746140872.962235:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abdf480 00000100:00100000:0.0:1746140872.962249:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1637 00000100:00100000:0.0:1746140872.962255:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1982:x1830960573231872:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140872.963685:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.964942:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960573231872:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2687us (2798us total) trans 21474841134 rc 0/0 00000100:00100000:0.0:1746140872.964949:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1637 00002000:00100000:0.0:1746140872.964957:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1114111) req@ffff88009abdf480 x1830960573231872/t21474841134(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:288/0 lens 488/448 e 0 to 0 dl 1746140883 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140872.964966:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf480 with x1830960573231872 ext(1048576->1114111) 00010000:00010000:0.0:1746140872.964971:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a0bf600/0x8156357b7fdb731a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fba5 expref: 13 pid: 4782 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140872.964979:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a0bf600/0x8156357b7fdb731a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fba5 expref: 13 pid: 4782 timeout: 952 lvb_type: 0 00002000:00010000:0.0:1746140872.964985:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abdf480 00000100:00100000:0.0:1746140872.966397:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.966949:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.967108:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.968155:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573232384 00000100:00100000:0.0:1746140872.968158:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573232384 00010000:00010000:0.0:1746140872.968172:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b1cdc00/0x8156357b7fdb7225 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb0b expref: 14 pid: 8459 timeout: 952 lvb_type: 1 00000100:00100000:0.0:1746140872.968186:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573232640 00000100:00100000:0.0:1746140872.968187:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573232640 00010000:00010000:0.0:1746140872.968193:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b1cda00/0x8156357b7fdb72d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb7b expref: 22 pid: 8459 timeout: 952 lvb_type: 1 00000100:00100000:0.0:1746140872.968203:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573233152 00000100:00100000:0.0:1746140872.968205:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573233152 00010000:00010000:0.0:1746140872.968209:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ffba00/0x8156357b7fdb7272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb51 expref: 15 pid: 32376 timeout: 952 lvb_type: 0 00000100:00100000:0.0:1746140872.968218:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8124 00000100:00100000:0.0:1746140872.968222:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573232640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.968226:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.968236:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b1cda00/0x8156357b7fdb72d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb7b expref: 22 pid: 8459 timeout: 952 lvb_type: 1 00010000:00010000:0.0:1746140872.968241:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b1cda00/0x8156357b7fdb72d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb7b expref: 22 pid: 8459 timeout: 952 lvb_type: 1 00010000:00010000:0.0:1746140872.968252:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b1cda00/0x8156357b7fdb72d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb7b expref: 22 pid: 8459 timeout: 952 lvb_type: 1 00010000:00010000:0.0:1746140872.968268:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140872.968284:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573232640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.968287:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8124 00010000:00010000:0.0:1746140872.968510:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.968516:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.968525:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.968529:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.968532:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.968535:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e594a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140872.968537:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.968543:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.968549:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.968552:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e594a00/0x8156357b7fdb73e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140872.968581:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573231488:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 8330us (8703us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.968585:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15780 00000100:00100000:0.0:1746140872.969123:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.969145:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.969170:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.969188:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.969358:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8128 00000100:00100000:0.0:1746140872.969364:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573233408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140872.969371:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140872.969378:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b311e00/0x8156357b7fdb726b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb4a expref: 12 pid: 32376 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140872.969386:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b311e00/0x8156357b7fdb726b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb4a expref: 12 pid: 32376 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140872.969400:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b311e00/0x8156357b7fdb726b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fb4a expref: 12 pid: 32376 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140872.969408:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.969409:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140872.969411:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0bea00/0x8156357b7fdb7408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.969417:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0bea00/0x8156357b7fdb7408 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140872.969429:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140872.969441:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573233408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140872.969446:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8128 00000100:00100000:0.0:1746140872.979184:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.979251:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.981400:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.985472:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960575864064:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140872.985495:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b67480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960575864192:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140872.985502:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b65180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960575864320:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140872.985508:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960575864448:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140872.985514:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960575864576:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140872.985541:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec31e00/0x8156357b7fdb740f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140872.985959:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140872.985975:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573234176 00000100:00100000:0.0:1746140872.985978:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573234176 00010000:00010000:0.0:1746140872.986212:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f58e400/0x8156357b7fdb6f15 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829f960 expref: 285 pid: 14741 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140872.988071:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec31e00/0x8156357b7fdb740f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140872.988078:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec31e00/0x8156357b7fdb740f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000040:00080000:0.0:1746140872.989088:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3248, 88 off274472 00000004:00080000:0.0:1746140872.989095:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852064790289ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989505:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3297, 88 off278968 00000004:00080000:0.0:1746140872.989510:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852065205624ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140872.989529:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3298, 88 off279056 00000004:00080000:0.0:1746140872.989532:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852065227046ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140872.989540:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3249, 88 off274560 00000004:00080000:0.0:1746140872.989543:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852065237874ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989548:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3250, 88 off274648 00000004:00080000:0.0:1746140872.989550:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852065245646ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989867:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3299, 88 off279144 00000004:00080000:0.0:1746140872.989871:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852065566047ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140872.989893:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3300, 88 off279232 00000004:00080000:0.0:1746140872.989896:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852065590814ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140872.989901:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3301, 88 off279320 00000004:00080000:0.0:1746140872.989903:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852065598746ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140872.989911:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3251, 88 off274736 00000004:00080000:0.0:1746140872.989913:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852065608676ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989930:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3302, 88 off279408 00000004:00080000:0.0:1746140872.989933:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852065627826ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140872.989939:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3252, 88 off274824 00000004:00080000:0.0:1746140872.989941:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852065636422ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989947:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3303, 88 off279496 00000004:00080000:0.0:1746140872.989949:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852065644099ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140872.989954:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3253, 88 off274912 00000004:00080000:0.0:1746140872.989957:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852065651924ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989962:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3254, 88 off275000 00000004:00080000:0.0:1746140872.989964:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852065659461ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989970:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3255, 88 off275088 00000004:00080000:0.0:1746140872.989972:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852065667452ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989978:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3256, 88 off275176 00000004:00080000:0.0:1746140872.989980:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852065674919ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140872.989985:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3304, 88 off279584 00000004:00080000:0.0:1746140872.989987:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852065682281ns, next at 809142599738ns, rc = 0 00000001:00080000:0.0:1746140873.010708:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944687 is committed 00000004:00080000:0.0:1746140873.010714:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2548 committed 00000004:00080000:0.0:1746140873.011015:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2504 committed 00000004:00080000:0.0:1746140873.011021:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2503 committed 00000004:00080000:0.0:1746140873.011023:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2502 committed 00000004:00080000:0.0:1746140873.011024:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2501 committed 00000004:00080000:0.0:1746140873.011026:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2547 committed 00000004:00080000:0.0:1746140873.011027:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2500 committed 00000004:00080000:0.0:1746140873.011028:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2546 committed 00000004:00080000:0.0:1746140873.011029:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2499 committed 00000004:00080000:0.0:1746140873.011032:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2545 committed 00000004:00080000:0.0:1746140873.011033:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2544 committed 00000004:00080000:0.0:1746140873.011034:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2543 committed 00000004:00080000:0.0:1746140873.011036:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2498 committed 00000004:00080000:0.0:1746140873.011038:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2497 committed 00000004:00080000:0.0:1746140873.011039:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2542 committed 00000004:00080000:0.0:1746140873.011045:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2541 committed 00000004:00080000:0.0:1746140873.011047:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2496 committed 00000001:00080000:0.0:1746140873.011058:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944683 is committed 00000001:00080000:0.0:1746140873.011067:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944665 is committed 00000001:00080000:0.0:1746140873.011081:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944673 is committed 00000001:00080000:0.0:1746140873.011099:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944678 is committed 00000001:00080000:0.0:1746140873.011122:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944684 is committed 00000100:00100000:0.0:1746140873.011599:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575864832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.011643:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.011661:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575865472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.011676:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.011692:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575865984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.011707:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.011719:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575866368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.011733:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.011764:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575865344 00000100:00100000:0.0:1746140873.011767:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575865344 00000100:00100000:0.0:1746140873.011852:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575865472 00000100:00100000:0.0:1746140873.011855:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575865472 00000100:00100000:0.0:1746140873.011864:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575864960 00000100:00100000:0.0:1746140873.011865:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575864960 00000100:00100000:0.0:1746140873.011872:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575865984 00000100:00100000:0.0:1746140873.011874:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575865984 00000100:00100000:0.0:1746140873.011958:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575866112 00000100:00100000:0.0:1746140873.011960:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575866112 00000100:00100000:0.0:1746140873.011967:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575865728 00000100:00100000:0.0:1746140873.011969:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575865728 00000100:00100000:0.0:1746140873.011974:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575866624 00000100:00100000:0.0:1746140873.011976:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575866624 00000100:00100000:0.0:1746140873.012547:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15786 00000100:00100000:0.0:1746140873.012553:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3311:x1830960575865344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.012721:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3311:x1830960575865344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (1101us total) trans 21474841137 rc 0/0 00000100:00100000:0.0:1746140873.012727:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15786 00000100:00100000:0.0:1746140873.012739:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15789 00000100:00100000:0.0:1746140873.012743:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3313:x1830960575865600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.012873:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3313:x1830960575865600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (1147us total) trans 21474841138 rc 0/0 00000100:00100000:0.0:1746140873.012878:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15789 00000100:00100000:0.0:1746140873.012887:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15792 00000100:00100000:0.0:1746140873.012891:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3313:x1830960575866496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.012954:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3313:x1830960575866496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1175us total) trans 17179873872 rc 0/0 00000100:00100000:0.0:1746140873.012959:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15792 00000100:00100000:0.0:1746140873.013592:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15794 00000100:00100000:0.0:1746140873.013608:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3310:x1830960575865216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.013653:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15796 00000100:00100000:0.0:1746140873.013658:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3310:x1830960575865088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.013765:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3310:x1830960575865088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (1882us total) trans 17179873874 rc 0/0 00000100:00100000:0.0:1746140873.013774:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15796 00000100:00100000:0.0:1746140873.014102:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.014399:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3310:x1830960575865216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 792us (2552us total) trans 21474841143 rc 0/0 00000100:00100000:0.0:1746140873.014404:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15794 00000004:00080000:0.0:1746140873.015127:0:14789:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 1 in flight, 64 done 00000100:00100000:0.0:1746140873.017614:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575866240 00000100:00100000:0.0:1746140873.017620:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575866240 00000100:00100000:0.0:1746140873.017649:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15800 00000100:00100000:0.0:1746140873.017654:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3311:x1830960575866240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.018680:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3311:x1830960575866240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1025us (1196us total) trans 17179873876 rc 0/0 00000100:00100000:0.0:1746140873.018687:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15800 00000100:00100000:0.0:1746140873.021125:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.021158:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.021185:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.021199:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.021210:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.021233:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.021420:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15804 00000100:00100000:0.0:1746140873.021427:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573234944:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140873.021435:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140873.021444:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb7439 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fc46 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140873.021460:0:8460:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fec9, atime: 0x6813fec9, ctime: 0x6813fec9, blocks: 0x807 00010000:00010000:0.0:1746140873.021469:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.021471:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.021475:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb7439 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc46 expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140873.021487:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb7439 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc46 expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140873.021493:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093beba00, rc 0) 00000100:00100000:0.0:1746140873.021510:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573234944:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.021515:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15804 00000100:00100000:0.0:1746140873.021529:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15806 00000100:00100000:0.0:1746140873.021534:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573235456:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140873.021539:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140873.021546:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bebe00/0x8156357b7fdb7447 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fc62 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140873.021558:0:8460:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4747392, mtime: 0x6813fec9, atime: 0x6813fec9, ctime: 0x6813fec9, blocks: 0x1483 00010000:00010000:0.0:1746140873.021565:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.021566:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.021570:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bebe00/0x8156357b7fdb7447 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc62 expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140873.021578:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bebe00/0x8156357b7fdb7447 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc62 expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140873.021588:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bebe00, rc 0) 00000100:00100000:0.0:1746140873.021602:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573235456:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 69us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.021607:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15806 00000100:00100000:0.0:1746140873.028517:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.029851:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.030470:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.030500:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.033486:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.066746:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.070472:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.070533:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.071190:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.071694:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.071717:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.071738:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.075129:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.077156:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746140873.095882:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944689 is committed 00000004:00080000:0.0:1746140873.095893:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2556 committed 00000004:00080000:0.0:1746140873.095907:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2513 committed 00000004:00080000:0.0:1746140873.095911:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2512 committed 00000004:00080000:0.0:1746140873.095914:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2511 committed 00000004:00080000:0.0:1746140873.095915:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2510 committed 00000004:00080000:0.0:1746140873.095917:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2555 committed 00000004:00080000:0.0:1746140873.095918:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2509 committed 00000004:00080000:0.0:1746140873.095920:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2554 committed 00000004:00080000:0.0:1746140873.095922:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2508 committed 00000004:00080000:0.0:1746140873.095923:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2553 committed 00000004:00080000:0.0:1746140873.095924:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2552 committed 00000004:00080000:0.0:1746140873.095926:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2551 committed 00000004:00080000:0.0:1746140873.095927:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2507 committed 00000004:00080000:0.0:1746140873.095930:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2506 committed 00000004:00080000:0.0:1746140873.095931:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2550 committed 00000004:00080000:0.0:1746140873.095933:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2549 committed 00000004:00080000:0.0:1746140873.095934:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2505 committed 00000100:00100000:0.0:1746140873.095982:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575867008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.096053:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.096086:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575867520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.096099:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.096108:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575868032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.096122:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.096134:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575868544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.096146:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.096258:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575868416 00000100:00100000:0.0:1746140873.096261:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575868416 00000100:00100000:0.0:1746140873.096273:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15815 00000100:00100000:0.0:1746140873.096277:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+18:3310:x1830960575867264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.096341:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15818 00000100:00100000:0.0:1746140873.096346:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3312:x1830960575868032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.096391:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15820 00000100:00100000:0.0:1746140873.096395:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3312:x1830960575868544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.096467:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3312:x1830960575868544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (320us total) trans 21474841149 rc 0/0 00000100:00100000:0.0:1746140873.096473:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15820 00000100:00100000:0.0:1746140873.096482:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15822 00000100:00100000:0.0:1746140873.096486:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3311:x1830960575867392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.096564:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3311:x1830960575867392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (380us total) trans 17179873881 rc 0/0 00000100:00100000:0.0:1746140873.096570:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15822 00000100:00100000:0.0:1746140873.096654:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575867136 00000100:00100000:0.0:1746140873.096657:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575867136 00000100:00100000:0.0:1746140873.096671:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15826 00000100:00100000:0.0:1746140873.096675:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3313:x1830960575867136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140873.096771:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140873.096774:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096775:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096777:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096779:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746140873.096795:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3312:x1830960575868032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 448us (671us total) trans 21474841153 rc 0/0 00000100:00100000:0.0:1746140873.096799:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15818 00002000:00010000:0.0:1746140873.096828:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140873.096830:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096831:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096833:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096834:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:0.0:1746140873.096847:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3313:x1830960575867136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (214us total) trans 17179873884 rc 0/0 00000100:00100000:0.0:1746140873.096852:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15826 00002000:00010000:0.0:1746140873.096921:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140873.096924:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096926:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096928:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.096929:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140873.096951:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960575867264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 674us (869us total) trans 17179873885 rc 0/0 00000100:00100000:0.0:1746140873.096957:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15815 00000100:00100000:0.0:1746140873.097731:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.101825:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.122126:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.122296:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.126053:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.126989:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.130964:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.136119:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.136251:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.137062:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8029 00000100:00100000:0.0:1746140873.138726:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1983:x1830960573240960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140873.148232:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.153477:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1983:x1830960573240960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16406us (17223us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140873.153486:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8029 00002000:00100000:0.0:1746140873.153496:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880135698a80 x1830960573240960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:289/0 lens 488/440 e 0 to 0 dl 1746140884 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140873.153504:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698a80 with x1830960573240960 ext(0->1048575) 00002000:00010000:0.0:1746140873.154075:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135698a80 00000100:00100000:0.0:1746140873.159211:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.161718:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.165244:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.165962:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.172765:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.189380:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.195106:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.207074:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.207144:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.213385:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.219208:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.219461:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15838 00000100:00100000:0.0:1746140873.219469:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32093:x1830960573243648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140873.219487:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140873.219503:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9400/0x8156357b7fdb754a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fccb expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.219528:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.219529:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.219536:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9400/0x8156357b7fdb754a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fccb expref: 13 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.219550:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9400/0x8156357b7fdb754a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fccb expref: 13 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.219560:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2e9400, rc 0) 00000100:00100000:0.0:1746140873.227475:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.227512:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.227549:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.241498:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.241534:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.241555:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.241588:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.245873:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10474 00000100:00100000:0.0:1746140873.245888:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:32096:x1830960573245568:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140873.245908:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140873.245924:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdb756d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fce7 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.245975:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e9e00/0x8156357b7fdb7574 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.245986:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e9e00/0x8156357b7fdb7574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.245995:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e9e00/0x8156357b7fdb7574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.246004:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8800/0x8156357b7fdb757b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.246009:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8800/0x8156357b7fdb757b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.246018:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8800/0x8156357b7fdb757b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.248455:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8600/0x8156357b7fdb7582 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.248474:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a476ea00/0x8156357b7fdb7512 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc9a expref: 270 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.248481:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5216400/0x8156357b7fdb7566 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140873.248486:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8600/0x8156357b7fdb7582 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.248503:0:14743:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5216400/0x8156357b7fdb7566 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140873.248529:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a476ea00/0x8156357b7fdb7512 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc9a expref: 270 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.248541:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a476ea00/0x8156357b7fdb7512 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc9a expref: 270 pid: 14743 timeout: 952 lvb_type: 0 00000100:00100000:0.0:1746140873.248554:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f170700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575869696:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140873.248630:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140873.250785:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.250820:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.258658:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573245952 00000100:00100000:0.0:1746140873.258668:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573245952 00010000:00010000:0.0:1746140873.258699:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a476ea00/0x8156357b7fdb7512 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc9a expref: 272 pid: 14743 timeout: 952 lvb_type: 0 00000100:00100000:0.0:1746140873.258728:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8141 00000100:00100000:0.0:1746140873.258734:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1985:x1830960573245952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140873.258747:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140873.258757:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a476ea00/0x8156357b7fdb7512 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc9a expref: 272 pid: 14743 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140873.258768:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a476ea00/0x8156357b7fdb7512 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc9a expref: 272 pid: 14743 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140873.258788:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a476ea00/0x8156357b7fdb7512 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc9a expref: 272 pid: 14743 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140873.259003:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140873.259009:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8600/0x8156357b7fdb7582 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.259016:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8600/0x8156357b7fdb7582 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.259021:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8600/0x8156357b7fdb7582 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140873.259030:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140873.259062:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:1985:x1830960573245952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 327us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.259068:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8141 00000100:00100000:0.0:1746140873.274446:0:20524:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573246208 00000100:00100000:0.0:1746140873.274455:0:20524:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573246208 00000100:00100000:0.0:1746140873.274492:0:20524:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10476 00000100:00100000:0.0:1746140873.274499:0:20524:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32092:x1830960573246208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140873.274517:0:20524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140873.274537:0:20524:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8400/0x8156357b7fdb7590 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fcf5 expref: -99 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.274592:0:20524:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8400/0x8156357b7fdb7590 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcf5 expref: 272 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.274603:0:20524:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8400/0x8156357b7fdb7590 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcf5 expref: 272 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.274745:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140873.274748:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140873.274753:0:20524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b8be00/0x8156357b7fdb7589 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcee expref: 8 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.274759:0:20524:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2e8400, rc 0) 00000100:00100000:0.0:1746140873.274798:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32092:x1830960573246208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 299us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.274805:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10476 00000100:00100000:0.0:1746140873.278670:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575870080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.279119:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15842 00000100:00100000:0.0:1746140873.279124:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3313:x1830960575870592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.279210:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3313:x1830960575870592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (450us total) trans 17179873889 rc 0/0 00000100:00100000:0.0:1746140873.279217:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15842 00000100:00100000:0.0:1746140873.279228:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15843 00000100:00100000:0.0:1746140873.279231:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3313:x1830960575871104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.279299:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3313:x1830960575871104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (516us total) trans 17179873890 rc 0/0 00000100:00100000:0.0:1746140873.279331:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15843 00000100:00100000:0.0:1746140873.279341:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15845 00000100:00100000:0.0:1746140873.279344:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3313:x1830960575870464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140873.279411:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140873.279413:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.279415:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.279417:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.279418:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746140873.279431:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3313:x1830960575870464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (599us total) trans 21474841158 rc 0/0 00000100:00100000:0.0:1746140873.279435:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15845 00000100:00100000:0.0:1746140873.279442:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15848 00000100:00100000:0.0:1746140873.279446:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3313:x1830960575872000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.279901:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3313:x1830960575872000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 454us (994us total) trans 21474841159 rc 0/0 00000100:00100000:0.0:1746140873.280797:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15848 00000100:00100000:0.0:1746140873.280810:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15852 00000100:00100000:0.0:1746140873.280816:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3311:x1830960575871872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140873.281133:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3311:x1830960575871872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 318us (1639us total) trans 21474841163 rc 0/0 00000100:00100000:0.0:1746140873.281238:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15852 00000100:00100000:0.0:1746140873.281265:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.281288:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575870720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.281333:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140873.281356:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575870080 00000100:00100000:0.0:1746140873.281360:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575870080 00000100:00100000:0.0:1746140873.281377:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575870720 00000100:00100000:0.0:1746140873.281378:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575870720 00000100:00100000:0.0:1746140873.281387:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15855 00000100:00100000:0.0:1746140873.281391:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3310:x1830960575870080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140873.281466:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140873.281468:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.281469:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.281471:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140873.281473:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:0.0:1746140873.281493:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960575870080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (227us total) trans 17179873894 rc 0/0 00000100:00100000:0.0:1746140873.281498:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15855 00000004:00080000:0.0:1746140873.281613:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba7480/2, rc 0, transno 21474841158 00000100:00100000:0.0:1746140873.281618:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575870464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140873.281627:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172a00/2, rc 0, transno 17179873891 00000100:00100000:0.0:1746140873.281630:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575870976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140873.281636:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba6a00/2, rc 0, transno 21474841164 00000100:00100000:0.0:1746140873.281822:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575871488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140873.281834:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba6d80/2, rc 0, transno 21474841159 00000100:00100000:0.0:1746140873.281837:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575872000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140873.281845:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba5880/2, rc 0, transno 21474841157 00000100:00100000:0.0:1746140873.281847:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575871616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140873.281854:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172300/2, rc 0, transno 17179873889 00000100:00100000:0.0:1746140873.281857:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575870592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140873.281862:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172680/2, rc 0, transno 17179873890 00000100:00100000:0.0:1746140873.281864:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575871104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140873.281869:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f171180/2, rc 0, transno 17179873888 00000100:00100000:0.0:1746140873.281872:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575869952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140873.284387:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.284431:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.294642:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.297620:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.304155:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.310488:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.310631:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.310662:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.310693:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.311445:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.311459:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.311491:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.311508:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573248640 00000100:00100000:0.0:1746140873.311512:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573248640 00010000:00010000:0.0:1746140873.311532:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdb7520 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fca1 expref: 28 pid: 4785 timeout: 952 lvb_type: 0 00000100:00100000:0.0:1746140873.311553:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573248768 00000100:00100000:0.0:1746140873.311556:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573248768 00010000:00010000:0.0:1746140873.311564:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec31e00/0x8156357b7fdb752e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcaf expref: 15 pid: 8460 timeout: 952 lvb_type: 0 00000100:00100000:0.0:1746140873.311574:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573248896 00000100:00100000:0.0:1746140873.311575:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573248896 00010000:00010000:0.0:1746140873.311583:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec30600/0x8156357b7fdb742b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc4d expref: 11 pid: 8458 timeout: 952 lvb_type: 1 00000100:00100000:0.0:1746140873.311594:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8143 00000100:00100000:0.0:1746140873.311599:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1983:x1830960573248640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140873.311609:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140873.311626:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdb7520 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fca1 expref: 28 pid: 4785 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140873.311636:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdb7520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fca1 expref: 28 pid: 4785 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140873.311658:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140873.311697:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1983:x1830960573248640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.311702:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8143 00000100:00100000:0.0:1746140873.311718:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8144 00000100:00100000:0.0:1746140873.311722:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573248768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140873.311732:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140873.311738:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec31e00/0x8156357b7fdb752e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcaf expref: 15 pid: 8460 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140873.311746:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec31e00/0x8156357b7fdb752e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcaf expref: 15 pid: 8460 timeout: 952 lvb_type: 0 00010000:00010000:0.0:1746140873.311754:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140873.311765:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573248768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 43us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.311770:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8144 00000100:00100000:0.0:1746140873.311778:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8145 00000100:00100000:0.0:1746140873.311782:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573248896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140873.311788:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140873.311792:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec30600/0x8156357b7fdb742b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc4d expref: 11 pid: 8458 timeout: 952 lvb_type: 1 00010000:00010000:0.0:1746140873.311801:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec30600/0x8156357b7fdb742b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc4d expref: 11 pid: 8458 timeout: 952 lvb_type: 1 00010000:00010000:0.0:1746140873.311811:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.311813:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.311820:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4824000/0x8156357b7fdb75ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1347584->2060287) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fd11 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.311829:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4824000/0x8156357b7fdb75ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1347584->2060287) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fd11 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.311858:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4824000/0x8156357b7fdb75ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1347584->2060287) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fd11 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140873.311869:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575872768:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140873.311921:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140873.311946:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573249152 00000100:00100000:0.0:1746140873.311950:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573249152 00000100:00100000:0.0:1746140873.311972:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4539 00000100:00100000:0.0:1746140873.311976:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32096:x1830960573249152:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:0.0:1746140873.312148:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32096:x1830960573249152:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 170us (654us total) trans 8589944697 rc 0/0 00000100:00100000:0.0:1746140873.312154:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4539 00000100:00100000:0.0:1746140873.313947:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575872768:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140873.313966:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140873.313995:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573248896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2210us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.314004:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8145 00010000:00010000:0.0:1746140873.317594:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdb7520 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fca1 expref: 29 pid: 4785 timeout: 952 lvb_type: 0 00000100:00100000:0.0:1746140873.317612:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960575872384:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140873.317626:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec31e00/0x8156357b7fdb752e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcaf expref: 14 pid: 8460 timeout: 952 lvb_type: 0 00000100:00100000:0.0:1746140873.317639:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960575872512:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140873.317650:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec30600/0x8156357b7fdb742b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc4d expref: 10 pid: 8458 timeout: 952 lvb_type: 1 00000100:00100000:0.0:1746140873.317657:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960575872640:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140873.317684:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4824000/0x8156357b7fdb75ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1347584->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fd11 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.317701:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4824000, rc 0) 00000100:00100000:0.0:1746140873.317745:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:32095:x1830960573247488:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 13364us (13604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.317752:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15859 00000100:00100000:0.0:1746140873.323932:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.323999:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.324542:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.328800:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.328823:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573249792 00000100:00100000:0.0:1746140873.328832:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573249792 00010000:00010000:0.0:1746140873.328865:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bebe00/0x8156357b7fdb7447 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc62 expref: 11 pid: 8460 timeout: 952 lvb_type: 1 00000100:00100000:0.0:1746140873.328886:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8146 00000100:00100000:0.0:1746140873.328892:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573249792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140873.328902:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140873.329778:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bebe00/0x8156357b7fdb7447 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc62 expref: 11 pid: 8460 timeout: 952 lvb_type: 1 00010000:00010000:0.0:1746140873.329789:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bebe00/0x8156357b7fdb7447 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc62 expref: 11 pid: 8460 timeout: 952 lvb_type: 1 00010000:00010000:0.0:1746140873.329810:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bebe00/0x8156357b7fdb7447 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fc62 expref: 11 pid: 8460 timeout: 952 lvb_type: 1 00010000:00010000:0.0:1746140873.329839:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140873.329863:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573249792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 970us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.329868:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8146 00000100:00100000:0.0:1746140873.333620:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.334049:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.334147:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.337384:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.337439:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.337453:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573250688 00000100:00100000:0.0:1746140873.337459:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573250688 00002000:00100000:0.0:1746140873.337484:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009ec81180 x1830960573250688/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:289/0 lens 488/0 e 0 to 0 dl 1746140884 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140873.337492:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec81180 with x1830960573250688 ext(2097152->3145727) 00002000:00010000:0.0:1746140873.337496:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec81180 00000100:00100000:0.0:1746140873.337520:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8046 00000100:00100000:0.0:1746140873.337524:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573250688:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140873.339970:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575873280:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140873.339983:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140873.340013:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573249920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5522us (6404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.340023:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8148 00000100:00100000:0.0:1746140873.342429:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573251200 00000100:00100000:0.0:1746140873.342438:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573251200 00000100:00100000:0.0:1746140873.342490:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4540 00000100:00100000:0.0:1746140873.342497:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32095:x1830960573251200:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746140873.342868:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32095:x1830960573251200:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 371us (460us total) trans 8589944698 rc 0/0 00000100:00100000:0.0:1746140873.342874:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4540 00000100:00100000:0.0:1746140873.350155:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.350883:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.351996:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.356742:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.356791:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.360232:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.364096:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.369686:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.372111:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.373156:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.375932:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.375985:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.379879:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.386958:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.391938:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.391999:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.392448:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.400261:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.404543:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.408234:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.410035:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.410075:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.421603:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.421717:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.429856:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.435252:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.468817:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.486629:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.490509:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.493049:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.493096:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.497355:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.500901:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.504574:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.550857:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.553874:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.555633:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.555721:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.555750:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573258624 00000100:00100000:0.0:1746140873.555753:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573258624 00000100:00100000:0.0:1746140873.555771:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573258496 00000100:00100000:0.0:1746140873.555773:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573258496 00000100:00100000:0.0:1746140873.555785:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15872 00000100:00100000:0.0:1746140873.555790:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573258624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140873.555799:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140873.555809:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb767e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fd8f expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140873.555847:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575875584:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140873.555905:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140873.562464:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.574403:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573258880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11313us (11943us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140873.574415:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8057 00002000:00100000:0.0:1746140873.574426:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8800a51cea00 x1830960573258880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:289/0 lens 488/440 e 0 to 0 dl 1746140884 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140873.574435:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cea00 with x1830960573258880 ext(0->1048575) 00002000:00010000:0.0:1746140873.574440:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cea00 00000100:00100000:0.0:1746140873.588761:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.590516:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.592694:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.604031:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.606066:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.610998:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.611043:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.628432:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.628484:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.630510:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.631746:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.634060:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.635895:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.635922:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.636464:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.637837:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.641802:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.647491:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.647855:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.658715:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.658759:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.659178:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15879 00000100:00100000:0.0:1746140873.659184:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573264000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140873.659199:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140873.659216:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4540a00/0x8156357b7fdb76bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fdc0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140873.659236:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.659238:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140873.659245:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4540a00/0x8156357b7fdb76bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fdc0 expref: 29 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140873.659259:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4540a00/0x8156357b7fdb76bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fdc0 expref: 29 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140873.659270:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4540a00, rc 0) 00000100:00100000:0.0:1746140873.659349:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1983:x1830960573264000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 164us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140873.659355:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15879 00000100:00100000:0.0:1746140873.666616:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.671625:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.674812:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.674919:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.674955:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8070 00000100:00100000:0.0:1746140873.674962:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573264768:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140873.676226:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.699464:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.722535:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.730658:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.733165:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.737608:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.739615:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.742507:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.744110:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.764226:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.766641:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.781842:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.783864:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.790765:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.793857:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.797889:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.805107:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.805148:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.810648:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573268480 00000100:00100000:0.0:1746140873.810656:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573268480 00002000:00100000:0.0:1746140873.810692:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1200128->1204223) req@ffff880093131c00 x1830960573268480/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:289/0 lens 488/0 e 0 to 0 dl 1746140884 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140873.810708:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131c00 with x1830960573268480 ext(1200128->1204223) 00002000:00010000:0.0:1746140873.810712:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093131c00 00000100:00100000:0.0:1746140873.810739:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8076 00000100:00100000:0.0:1746140873.810746:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573268480:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140873.810908:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573268480:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 162us (298us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140873.810915:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8076 00002000:00100000:0.0:1746140873.810920:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1200128->1204223) req@ffff880093131c00 x1830960573268480/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746140884 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140873.810926:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131c00 with x1830960573268480 ext(1200128->1204223) 00002000:00010000:0.0:1746140873.810929:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093131c00 00000100:00100000:0.0:1746140873.830654:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.843961:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.874053:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.899649:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.902092:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.902145:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.904437:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.904608:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.905025:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15886 00000100:00100000:0.0:1746140873.905040:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573270528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140873.905056:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140873.905069:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fcbbc00/0x8156357b7fdb7781 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fe0d expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140873.905114:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575878400:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140873.905185:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140873.905695:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575878528:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140873.905767:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140873.911207:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.914300:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.920828:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.939995:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.943250:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.950424:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.956993:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.963005:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140873.968554:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.024468:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.028762:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.030206:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.031809:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.037394:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.038681:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.038716:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.038738:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.039360:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.044578:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.047005:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.050803:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.053908:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.055591:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.057768:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.060205:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.061870:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.064907:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.069590:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.071982:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.092576:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.097393:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.102876:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.104840:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.104883:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.118376:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.118478:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.120767:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.123378:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.123432:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.127867:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.128767:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.129005:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.129220:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.129497:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573278464 00000100:00100000:0.0:1746140874.129500:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573278464 00010000:00010000:0.0:1746140874.129694:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009299b200/0x8156357b7fdb7876 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe7d expref: 32 pid: 12255 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.129712:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8177 00000100:00100000:0.0:1746140874.129718:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573278464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.129725:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.129736:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009299b200/0x8156357b7fdb7876 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe7d expref: 32 pid: 12255 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.129744:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009299b200/0x8156357b7fdb7876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe7d expref: 32 pid: 12255 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.129756:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009299b200/0x8156357b7fdb7876 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe7d expref: 32 pid: 12255 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.129775:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.129778:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.129784:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb787d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe84 expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.129791:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb787d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe84 expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.130026:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb787d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe84 expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140874.130036:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f886d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960575880832:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140874.133437:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.139695:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.143875:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140874.144998:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140874.148477:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.150983:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.164185:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.171170:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.187663:0:14739:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575881344 00000100:00100000:0.0:1746140874.187671:0:14739:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575881344 00000100:00100000:0.0:1746140874.187712:0:14739:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1746140874.187719:0:14739:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009953a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3311:x1830960575881344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140874.188246:0:14739:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009953a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3311:x1830960575881344:12345-0@lo:400:kworker.0 Request processed in 527us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.188253:0:14739:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1746140874.188824:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.188846:0:20524:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575881600 00000100:00100000:0.0:1746140874.188849:0:20524:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575881600 00000100:00100000:0.0:1746140874.188868:0:20524:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1746140874.188872:0:20524:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1830960575881600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140874.188893:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1830960575881600:12345-0@lo:400:kworker.0 Request processed in 21us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.188897:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1746140874.188918:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1830960575881600:0@lo:400:kworker.0 00000100:00100000:0.0:1746140874.192557:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.195011:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.195466:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.195540:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.195575:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.197448:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.197513:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.263936:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.267804:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.279638:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.282144:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.285064:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.285625:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.292048:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.295378:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.295401:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.295435:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.302720:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.347792:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.350657:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.350756:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.353118:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.353158:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.359550:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573284992 00000100:00100000:0.0:1746140874.359560:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573284992 00000100:00100000:0.0:1746140874.360443:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15905 00000100:00100000:0.0:1746140874.360456:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:32154:x1830960573284992:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140874.360484:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140874.360539:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eaca600/0x8156357b7fdb793a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829fedf expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.360571:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb78fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1032192->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829febc expref: 15 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.360578:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140874.360581:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140874.360584:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eaca600/0x8156357b7fdb793a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fedf expref: 23 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.360613:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb78fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1032192->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829febc expref: 15 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.360624:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb78fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1032192->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829febc expref: 15 pid: 8459 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.360635:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960575883648:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140874.360730:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140874.363169:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573285120 00000100:00100000:0.0:1746140874.363175:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573285120 00002000:00100000:0.0:1746140874.363208:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (1032192->1048575) req@ffff8800a6bace00 x1830960573285120/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:290/0 lens 16872/0 e 0 to 0 dl 1746140885 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.363217:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bace00 with x1830960573285120 ext(1032192->1048575) 00010000:00010000:0.0:1746140874.363223:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb78fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1032192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829febc expref: 16 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.363234:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb78fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1032192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829febc expref: 16 pid: 8459 timeout: 953 lvb_type: 0 00002000:00010000:0.0:1746140874.363246:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6bace00 00000100:00100000:0.0:1746140874.363271:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1655 00000100:00100000:0.0:1746140874.363277:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573285120:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140874.364881:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573285120:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1598us (1792us total) trans 21474841168 rc 0/0 00000100:00100000:0.0:1746140874.364891:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1655 00002000:00100000:0.0:1746140874.364899:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (1032192->1048575) req@ffff8800a6bace00 x1830960573285120/t21474841168(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:290/0 lens 16872/448 e 0 to 0 dl 1746140885 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.364908:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bace00 with x1830960573285120 ext(1032192->1048575) 00010000:00010000:0.0:1746140874.364914:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb78fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1032192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829febc expref: 18 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.364926:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb78fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1032192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829febc expref: 18 pid: 8459 timeout: 953 lvb_type: 0 00002000:00010000:0.0:1746140874.364932:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6bace00 00000100:00100000:0.0:1746140874.367116:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.371106:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.389765:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.392913:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.402798:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.405111:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.407760:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.408292:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.408682:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573286528 00000100:00100000:0.0:1746140874.408686:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573286528 00010000:00010000:0.0:1746140874.408699:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb760e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fd5e expref: 28 pid: 32377 timeout: 953 lvb_type: 1 00000100:00100000:0.0:1746140874.408728:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8191 00000100:00100000:0.0:1746140874.408733:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573286528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.408900:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.408910:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb760e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fd5e expref: 28 pid: 32377 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.408918:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb760e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fd5e expref: 28 pid: 32377 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.408930:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbe00/0x8156357b7fdb760e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fd5e expref: 28 pid: 32377 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.409041:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.409043:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.409050:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a40ae00/0x8156357b7fdb7948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feed expref: 31 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.409058:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a40ae00/0x8156357b7fdb7948 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feed expref: 31 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.409083:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a40ae00/0x8156357b7fdb7948 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feed expref: 31 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140874.409094:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575884416:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140874.409512:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140874.411083:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.413030:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.419025:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.419233:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.423343:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.437161:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.437612:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.437944:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.439705:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.448490:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.449729:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.453387:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573289984 00000100:00100000:0.0:1746140874.453391:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573289984 00000100:00100000:0.0:1746140874.453421:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4557 00000100:00100000:0.0:1746140874.453426:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:32150:x1830960573289984:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746140874.453612:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:32150:x1830960573289984:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 186us (912us total) trans 8589944732 rc 0/0 00000100:00100000:0.0:1746140874.453618:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4557 00000100:00100000:0.0:1746140874.453641:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573289728 00000100:00100000:0.0:1746140874.453643:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573289728 00002000:00100000:0.0:1746140874.453662:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->3719167) req@ffff880093131f80 x1830960573289728/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:290/0 lens 488/0 e 0 to 0 dl 1746140885 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.453671:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131f80 with x1830960573289728 ext(3145728->3719167) 00002000:00010000:0.0:1746140874.453675:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093131f80 00000100:00100000:0.0:1746140874.453687:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8099 00000100:00100000:0.0:1746140874.453691:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573289728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140874.459579:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.462000:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.472397:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.472491:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.474497:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.476934:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.488727:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.492880:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.499653:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573291648:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6516us (6766us total) trans 17179873906 rc 0/0 00000100:00100000:0.0:1746140874.499665:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1658 00002000:00100000:0.0:1746140874.499677:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3719168->4194303) req@ffff880094452300 x1830960573291648/t17179873906(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:290/0 lens 488/448 e 0 to 0 dl 1746140885 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.499686:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094452300 with x1830960573291648 ext(3719168->4194303) 00010000:00010000:0.0:1746140874.499694:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a40ae00/0x8156357b7fdb7948 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feed expref: 34 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.499705:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a40ae00/0x8156357b7fdb7948 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feed expref: 34 pid: 8459 timeout: 953 lvb_type: 0 00002000:00010000:0.0:1746140874.499710:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094452300 00000100:00100000:0.0:1746140874.504675:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.514104:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.514142:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.514184:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.523351:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.529093:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.529135:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.537696:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573293440 00000100:00100000:0.0:1746140874.537706:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573293440 00002000:00100000:0.0:1746140874.537750:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4751359) req@ffff88009ec80700 x1830960573293440/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:290/0 lens 488/0 e 0 to 0 dl 1746140885 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.537759:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec80700 with x1830960573293440 ext(4194304->4751359) 00002000:00010000:0.0:1746140874.537764:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec80700 00000100:00100000:0.0:1746140874.537797:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8105 00000100:00100000:0.0:1746140874.537805:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573293440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140874.552446:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.601072:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.604134:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.604618:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.606895:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.611984:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140874.613078:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb787d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe84 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.613088:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb787d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe84 expref: 29 pid: 12255 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.613281:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575886848:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140874.613364:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140874.615230:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.615335:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.622165:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.670969:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.679177:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.698543:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.708345:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.708399:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.709946:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.709976:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.711081:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.722259:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.722382:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.724816:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.725230:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573296768 00000100:00100000:0.0:1746140874.725236:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573296768 00010000:00010000:0.0:1746140874.725257:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3bb200/0x8156357b7fdb79aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4722688->4751359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff33 expref: 26 pid: 24958 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.725544:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8202 00000100:00100000:0.0:1746140874.725552:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573296768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.725564:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.725585:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a3bb200/0x8156357b7fdb79aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4722688->4751359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff33 expref: 26 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.725595:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a3bb200/0x8156357b7fdb79aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4722688->4751359) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff33 expref: 26 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.725613:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a3bb200/0x8156357b7fdb79aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4722688->4751359) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff33 expref: 26 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.725635:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.725654:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573296768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.725661:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8202 00000100:00100000:0.0:1746140874.726493:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573296896 00000100:00100000:0.0:1746140874.726498:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573296896 00002000:00100000:0.0:1746140874.726527:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1601536->2097151) req@ffff880093130000 x1830960573296896/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:290/0 lens 488/0 e 0 to 0 dl 1746140885 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.726541:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130000 with x1830960573296896 ext(1601536->2097151) 00010000:00010000:0.0:1746140874.726548:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee81c00/0x8156357b7fdb79db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff48 expref: 28 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.726557:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee81c00/0x8156357b7fdb79db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff48 expref: 28 pid: 8459 timeout: 953 lvb_type: 0 00002000:00010000:0.0:1746140874.726563:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093130000 00000100:00100000:0.0:1746140874.726590:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1659 00000100:00100000:0.0:1746140874.726596:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573296896:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140874.729225:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.734962:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573297280 00000100:00100000:0.0:1746140874.734966:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573297280 00010000:00010000:0.0:1746140874.734999:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee81c00/0x8156357b7fdb79db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff48 expref: 30 pid: 8459 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.735030:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8204 00000100:00100000:0.0:1746140874.735037:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1982:x1830960573297280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.735048:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.735072:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee81c00/0x8156357b7fdb79db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff48 expref: 30 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.735135:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee81c00/0x8156357b7fdb79db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff48 expref: 30 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.735158:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee81c00/0x8156357b7fdb79db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff48 expref: 30 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.735181:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.735183:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.735189:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.735198:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.735226:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140874.735237:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575887872:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140874.735281:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140874.738527:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.741724:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.746705:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573297664:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8006us (8179us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140874.746715:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8109 00002000:00100000:0.0:1746140874.746725:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009ab6d500 x1830960573297664/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:290/0 lens 488/440 e 0 to 0 dl 1746140885 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.746739:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6d500 with x1830960573297664 ext(1048576->2097151) 00002000:00010000:0.0:1746140874.746744:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab6d500 00000100:00100000:0.0:1746140874.747522:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.747556:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.748920:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.750547:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.752715:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.753417:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.761896:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573299584 00000100:00100000:0.0:1746140874.761905:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573299584 00010000:00010000:0.0:1746140874.761936:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee81600/0x8156357b7fdb79e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff4f expref: 30 pid: 8459 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.761962:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8207 00000100:00100000:0.0:1746140874.761969:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573299584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.761981:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.761999:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee81600/0x8156357b7fdb79e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff4f expref: 30 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.762010:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee81600/0x8156357b7fdb79e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff4f expref: 30 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.762031:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee81600/0x8156357b7fdb79e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff4f expref: 30 pid: 8459 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.762058:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.762060:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.762070:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f61a00/0x8156357b7fdb7a7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff95 expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.762078:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f61a00/0x8156357b7fdb7a7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff95 expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.762108:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f61a00/0x8156357b7fdb7a7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff95 expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140874.762120:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575888512:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140874.762438:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140874.766762:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.779123:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.784251:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.784758:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573300480 00000100:00100000:0.0:1746140874.784761:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573300480 00000100:00100000:0.0:1746140874.784793:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15928 00000100:00100000:0.0:1746140874.784798:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573300480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140874.784805:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140874.784813:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb7aad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e829ffaa expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.784824:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.784825:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.784829:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb7aad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffaa expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.784844:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb7aad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffaa expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.784852:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a3bb200, rc 0) 00000100:00100000:0.0:1746140874.784868:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573300480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.784873:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15928 00000100:00100000:0.0:1746140874.785185:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.785220:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.787588:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.787797:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.788415:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.788431:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573301504 00000100:00100000:0.0:1746140874.788434:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573301504 00002000:00100000:0.0:1746140874.788451:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2191360->3239935) req@ffff880099494a80 x1830960573301504/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:290/0 lens 488/0 e 0 to 0 dl 1746140885 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.788457:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494a80 with x1830960573301504 ext(2191360->3239935) 00002000:00010000:0.0:1746140874.788460:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099494a80 00000100:00100000:0.0:1746140874.788475:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8114 00000100:00100000:0.0:1746140874.788480:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573301504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140874.797043:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.802088:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.802268:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.802284:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.805590:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573300992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17425us (18000us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140874.805602:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8112 00002000:00100000:0.0:1746140874.805616:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3657727) req@ffff880099494700 x1830960573300992/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:290/0 lens 504/440 e 0 to 0 dl 1746140885 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.805625:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494700 with x1830960573300992 ext(2097152->3657727) 00010000:00010000:0.0:1746140874.805635:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb7a44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff80 expref: 27 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.805647:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb7a44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff80 expref: 27 pid: 24958 timeout: 953 lvb_type: 0 00002000:00010000:0.0:1746140874.805654:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099494700 00000100:00100000:0.0:1746140874.813012:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.814232:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.817857:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.819710:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573303296 00000100:00100000:0.0:1746140874.819714:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573303296 00002000:00100000:0.0:1746140874.819947:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009ec82a00 x1830960573303296/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:290/0 lens 488/0 e 0 to 0 dl 1746140885 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.819954:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec82a00 with x1830960573303296 ext(3145728->4194303) 00002000:00010000:0.0:1746140874.819957:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec82a00 00000100:00100000:0.0:1746140874.819974:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8119 00000100:00100000:0.0:1746140874.819980:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573303296:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140874.823737:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.825852:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.827982:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573303296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8000us (8342us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140874.827990:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8119 00002000:00100000:0.0:1746140874.827996:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009ec82a00 x1830960573303296/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:290/0 lens 488/440 e 0 to 0 dl 1746140885 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140874.828003:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec82a00 with x1830960573303296 ext(3145728->4194303) 00002000:00010000:0.0:1746140874.828007:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec82a00 00000100:00100000:0.0:1746140874.832126:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.832167:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.835930:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.837086:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.845806:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.848834:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.848863:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.859552:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.862685:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.863692:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.868121:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.869076:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.869105:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.869139:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.870773:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.870792:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573307392 00000100:00100000:0.0:1746140874.870796:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573307392 00000100:00100000:0.0:1746140874.870834:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4563 00000100:00100000:0.0:1746140874.870840:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+31:31971:x1830960573307392:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746140874.870986:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+32:31971:x1830960573307392:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 147us (216us total) trans 8589944743 rc 0/0 00000100:00100000:0.0:1746140874.870991:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4563 00000100:00100000:0.0:1746140874.871147:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.874899:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.875280:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8211 00000100:00100000:0.0:1746140874.875299:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573307648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.875331:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.875338:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f121c00/0x8156357b7fdb78a0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe99 expref: 32 pid: 14743 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.875350:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f121c00/0x8156357b7fdb78a0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe99 expref: 32 pid: 14743 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.875370:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f121c00/0x8156357b7fdb78a0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe99 expref: 32 pid: 14743 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.875381:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140874.875385:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbc800/0x8156357b7fdb7b16 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140874.875394:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbc800/0x8156357b7fdb7b16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140874.875399:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbc800/0x8156357b7fdb7b16 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140874.875424:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.875461:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573307648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 174us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.875468:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8211 00000100:00100000:0.0:1746140874.877640:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.877790:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.878755:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.878778:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.878787:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.878802:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.878811:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573308032 00000100:00100000:0.0:1746140874.878815:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573308032 00000100:00100000:0.0:1746140874.879007:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573308160 00000100:00100000:0.0:1746140874.879010:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573308160 00000100:00100000:0.0:1746140874.881765:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.881812:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.884148:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.884601:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.887167:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.891425:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.891463:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.891491:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.891504:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.891528:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.891542:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573309824 00000100:00100000:0.0:1746140874.891550:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573309824 00000100:00100000:0.0:1746140874.892047:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15952 00000100:00100000:0.0:1746140874.892055:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573309696:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140874.892071:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009396fc00/0x8156357b7fdb7b9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892081:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892123:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d2a600/0x8156357b7fdb7b32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a001a expref: 12 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.892129:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb7aa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffa3 expref: 33 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.892134:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.892136:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.892138:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009396fc00/0x8156357b7fdb7b9b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892154:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb7aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffa3 expref: 33 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.892162:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb7aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffa3 expref: 33 pid: 24958 timeout: 953 lvb_type: 1 00000100:00100000:0.0:1746140874.892170:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575890944:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140874.892197:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d2a600/0x8156357b7fdb7b32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a001a expref: 12 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.892204:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d2a600/0x8156357b7fdb7b32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a001a expref: 12 pid: 4784 timeout: 953 lvb_type: 1 00000100:00100000:0.0:1746140874.892217:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575891072:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140874.892238:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892245:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 35 pid: 12255 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.892252:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099497b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575891328:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140874.892264:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140874.892331:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.892347:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573310208 00000100:00100000:0.0:1746140874.892350:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573310208 00000100:00100000:0.0:1746140874.892368:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15954 00000100:00100000:0.0:1746140874.892372:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573310208:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140874.892387:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892396:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbde00/0x8156357b7fdb7ae5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe2 expref: 35 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892402:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d2ae00/0x8156357b7fdb7b47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0036 expref: 13 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.892408:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd400/0x8156357b7fdb7aec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe9 expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892413:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.892414:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.892417:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892430:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd400/0x8156357b7fdb7aec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe9 expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892437:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd400/0x8156357b7fdb7aec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe9 expref: 33 pid: 24958 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.892444:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575891840:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140874.892464:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d2ae00/0x8156357b7fdb7b47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0036 expref: 13 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.892471:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d2ae00/0x8156357b7fdb7b47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0036 expref: 13 pid: 32377 timeout: 953 lvb_type: 1 00000100:00100000:0.0:1746140874.892478:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099494e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575891968:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140874.892492:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbde00/0x8156357b7fdb7ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe2 expref: 35 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.892498:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbde00/0x8156357b7fdb7ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe2 expref: 35 pid: 24958 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.892509:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099497480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575892096:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140874.892520:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140874.893913:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.896624:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575891840:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140874.896652:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099494e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575891968:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140874.896675:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.896689:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.896700:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.896899:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.897175:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8214 00000100:00100000:0.0:1746140874.897181:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1982:x1830960573311232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.897188:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.897202:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f61400/0x8156357b7fdb7b40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0028 expref: 13 pid: 24958 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.897209:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f61400/0x8156357b7fdb7b40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0028 expref: 13 pid: 24958 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.897220:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f61400/0x8156357b7fdb7b40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0028 expref: 13 pid: 24958 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.897232:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.897249:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960573311232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.897255:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8214 00000100:00100000:0.0:1746140874.897270:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8215 00000100:00100000:0.0:1746140874.897274:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573311104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.897280:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.897298:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcbdc00/0x8156357b7fdb7ac9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffc6 expref: 27 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.897322:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcbdc00/0x8156357b7fdb7ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffc6 expref: 27 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.897334:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbdc00/0x8156357b7fdb7ac9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffc6 expref: 27 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.897341:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.897552:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573311104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 277us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.897556:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8215 00000100:00100000:0.0:1746140874.899846:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.899867:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573311488 00000100:00100000:0.0:1746140874.899872:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573311488 00010000:00010000:0.0:1746140874.899898:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a40a400/0x8156357b7fdb78d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feae expref: 26 pid: 8459 timeout: 953 lvb_type: 1 00000100:00100000:0.0:1746140874.899919:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8217 00000100:00100000:0.0:1746140874.900408:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573311488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.900422:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.900442:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a40a400/0x8156357b7fdb78d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feae expref: 26 pid: 8459 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.900453:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a40a400/0x8156357b7fdb78d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feae expref: 26 pid: 8459 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.900471:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a40a400/0x8156357b7fdb78d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829feae expref: 26 pid: 8459 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.900483:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.900528:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573311488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 123us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.900534:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8217 00000100:00100000:0.0:1746140874.901196:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573311872 00000100:00100000:0.0:1746140874.901200:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573311872 00010000:00010000:0.0:1746140874.901213:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eaca600/0x8156357b7fdb793a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fedf expref: 25 pid: 8459 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.901228:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573312000 00000100:00100000:0.0:1746140874.901230:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573312000 00010000:00010000:0.0:1746140874.901240:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d2ac00/0x8156357b7fdb7b39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0021 expref: 13 pid: 32377 timeout: 953 lvb_type: 1 00000100:00100000:0.0:1746140874.901258:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8220 00000100:00100000:0.0:1746140874.901263:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1983:x1830960573311744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.901268:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.901276:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb7972 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fefb expref: 19 pid: 8459 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.901299:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb7972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fefb expref: 19 pid: 8459 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.901329:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a40aa00/0x8156357b7fdb7972 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fefb expref: 19 pid: 8459 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.901356:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.901372:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573311744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.901378:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8220 00000100:00100000:0.0:1746140874.901415:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573312256 00000100:00100000:0.0:1746140874.901418:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573312256 00010000:00010000:0.0:1746140874.901429:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f61a00/0x8156357b7fdb7a7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff95 expref: 36 pid: 24958 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.901441:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573310720 00000100:00100000:0.0:1746140874.901443:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573310720 00010000:00010000:0.0:1746140874.901450:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d2b800/0x8156357b7fdb7afa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fff7 expref: 18 pid: 32377 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.901461:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8223 00000100:00100000:0.0:1746140874.901465:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573310720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.901470:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.901479:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d2b800/0x8156357b7fdb7afa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fff7 expref: 18 pid: 32377 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901492:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d2b800/0x8156357b7fdb7afa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fff7 expref: 18 pid: 32377 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901501:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d2b800/0x8156357b7fdb7afa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fff7 expref: 18 pid: 32377 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901509:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.901525:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573310720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.901530:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8223 00000100:00100000:0.0:1746140874.901539:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573312384 00000100:00100000:0.0:1746140874.901541:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573312384 00010000:00010000:0.0:1746140874.901549:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094899200/0x8156357b7fdb788b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fe92 expref: 17 pid: 4784 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.901560:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573310464 00000100:00100000:0.0:1746140874.901562:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573310464 00010000:00010000:0.0:1746140874.901568:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb7aad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffaa expref: 33 pid: 12255 timeout: 953 lvb_type: 1 00000100:00100000:0.0:1746140874.901579:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8225 00000100:00100000:0.0:1746140874.901582:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1984:x1830960573310464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.901587:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.901594:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb7aad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffaa expref: 33 pid: 12255 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.901605:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb7aad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffaa expref: 33 pid: 12255 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.901614:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb7aad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffaa expref: 33 pid: 12255 timeout: 953 lvb_type: 1 00010000:00010000:0.0:1746140874.901620:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.901622:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.901624:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f60a00/0x8156357b7fdb7b8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.901630:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f60a00/0x8156357b7fdb7b8d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.901641:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.901654:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573310464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.901660:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8225 00000100:00100000:0.0:1746140874.901696:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099497480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575892096:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140874.901712:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140874.901738:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.901748:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573312128 00000100:00100000:0.0:1746140874.901749:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573312128 00010000:00010000:0.0:1746140874.901758:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 35 pid: 12255 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.901770:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8227 00000100:00100000:0.0:1746140874.901774:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573312128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.901779:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.901786:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 35 pid: 12255 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901793:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 35 pid: 12255 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901803:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee80800/0x8156357b7fdb7a4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ff79 expref: 35 pid: 12255 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901810:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.901811:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.901814:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009396fc00/0x8156357b7fdb7b9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.901819:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009396fc00/0x8156357b7fdb7b9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.901838:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.901855:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573312128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.901860:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8227 00000100:00100000:0.0:1746140874.901869:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573312512 00000100:00100000:0.0:1746140874.901872:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573312512 00010000:00010000:0.0:1746140874.901879:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd400/0x8156357b7fdb7aec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe9 expref: 32 pid: 24958 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.901890:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8228 00000100:00100000:0.0:1746140874.901894:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573312512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.901899:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.901906:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd400/0x8156357b7fdb7aec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe9 expref: 32 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901913:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd400/0x8156357b7fdb7aec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe9 expref: 32 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901922:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd400/0x8156357b7fdb7aec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ffe9 expref: 32 pid: 24958 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.901929:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.902934:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573312512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1038us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.902939:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8228 00010000:00010000:0.0:1746140874.902962:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.902972:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.902984:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.902993:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.902998:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.903003:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009396ee00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140874.903005:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.903011:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.903024:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.903029:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7ba9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140874.903053:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573310208:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 10681us (10722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.903059:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15954 00000100:00100000:0.0:1746140874.908195:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140874.908528:0:20960:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4825800/0x8156357b7fdb7b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908539:0:20960:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4825800/0x8156357b7fdb7b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908555:0:20960:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4825800/0x8156357b7fdb7b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908565:0:20960:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4825800/0x8156357b7fdb7b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908573:0:20960:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4825800/0x8156357b7fdb7b86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908578:0:20960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4825800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140874.908582:0:20960:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4825800/0x8156357b7fdb7b86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908588:0:20960:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4825800/0x8156357b7fdb7b86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908596:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.908597:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.908602:0:20960:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f60600/0x8156357b7fdb7bb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4747264->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0059 expref: 17 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908608:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f60600/0x8156357b7fdb7bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4747264->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0059 expref: 17 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140874.908639:0:20960:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f60600/0x8156357b7fdb7bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4747264->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0059 expref: 17 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140874.908650:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575892608:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140874.908725:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140874.910881:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15959 00000100:00100000:0.0:1746140874.910888:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1984:x1830960573313152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140874.910895:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140874.910903:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7bcc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0067 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140874.910915:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fecb, atime: 0x6813feca, ctime: 0x6813fecb, blocks: 0x821 00010000:00010000:0.0:1746140874.910924:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.910925:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.910929:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7bcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0067 expref: 35 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.910938:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009396ee00/0x8156357b7fdb7bcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0067 expref: 35 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.910945:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009396ee00, rc 0) 00000100:00100000:0.0:1746140874.910962:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1984:x1830960573313152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 76us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.910967:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15959 00000100:00100000:0.0:1746140874.910980:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15961 00000100:00100000:0.0:1746140874.910984:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1984:x1830960573313536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140874.910990:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140874.910997:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009396e600/0x8156357b7fdb7bda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a007c expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140874.911006:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fecb, atime: 0x6813fecb, ctime: 0x6813fecb, blocks: 0x102b 00010000:00010000:0.0:1746140874.911078:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.911080:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140874.911087:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009396e600/0x8156357b7fdb7bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a007c expref: 34 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.911096:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009396e600/0x8156357b7fdb7bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a007c expref: 34 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140874.911103:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009396e600, rc 0) 00000100:00100000:0.0:1746140874.911119:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1984:x1830960573313536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 134us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.911124:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15961 00000100:00100000:0.0:1746140874.911496:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.914602:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.914632:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.914681:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.914696:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573314560 00000100:00100000:0.0:1746140874.914698:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573314560 00000100:00100000:0.0:1746140874.914721:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4564 00000100:00100000:0.0:1746140874.914727:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+291:7723:x1830960573314560:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746140874.914977:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:7723:x1830960573314560:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 249us (293us total) trans 8589944746 rc 0/0 00000100:00100000:0.0:1746140874.914983:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4564 00000100:00100000:0.0:1746140874.915017:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.915067:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.915079:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573314688 00000100:00100000:0.0:1746140874.915082:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573314688 00010000:00010000:0.0:1746140874.915092:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8400/0x8156357b7fdb7590 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcf5 expref: 292 pid: 20524 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.915107:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573314816 00000100:00100000:0.0:1746140874.915109:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573314816 00010000:00010000:0.0:1746140874.915116:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5216400/0x8156357b7fdb7566 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fce0 expref: 293 pid: 27790 timeout: 953 lvb_type: 0 00000100:00100000:0.0:1746140874.915133:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8232 00000100:00100000:0.0:1746140874.915138:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+293:1983:x1830960573314688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.915144:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.915148:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8400/0x8156357b7fdb7590 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcf5 expref: 293 pid: 20524 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.915155:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8400/0x8156357b7fdb7590 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcf5 expref: 293 pid: 20524 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.915166:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8400/0x8156357b7fdb7590 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fcf5 expref: 293 pid: 20524 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.915176:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140874.915180:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbd000/0x8156357b7fdb7be1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140874.915185:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.915199:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:1983:x1830960573314688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.915262:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8232 00000100:00100000:0.0:1746140874.915357:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.915395:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.915453:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8234 00000100:00100000:0.0:1746140874.915459:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:1984:x1830960573314304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140874.915465:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140874.915469:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb76ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fdd5 expref: 290 pid: 14743 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.915477:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb76ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fdd5 expref: 290 pid: 14743 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.915612:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb76ee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e829fdd5 expref: 290 pid: 14743 timeout: 953 lvb_type: 0 00010000:00010000:0.0:1746140874.915639:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140874.915642:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcbd000/0x8156357b7fdb7be1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140874.915648:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140874.915662:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:1984:x1830960573314304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 204us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140874.915668:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8234 00000100:00100000:0.0:1746140874.919453:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573315328 00000100:00100000:0.0:1746140874.919461:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573315328 00000100:00100000:0.0:1746140874.919490:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4565 00000100:00100000:0.0:1746140874.919496:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:32174:x1830960573315328:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746140874.919971:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:32174:x1830960573315328:12345-192.168.204.16@tcp:35:cat.0 Request processed in 474us (584us total) trans 8589944748 rc 0/0 00000100:00100000:0.0:1746140874.920216:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4565 00000100:00100000:0.0:1746140874.937183:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575893760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140874.937203:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.937215:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575894272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140874.937227:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.937238:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746140874.937241:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575893632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140874.937253:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.938632:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575894144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140874.938664:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.938680:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575894784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140874.938694:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.938703:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575895296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140874.938715:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.938722:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746140874.938726:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575894656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140874.938737:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.938743:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575895168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140874.938753:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140874.938770:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575893632 00000100:00100000:0.0:1746140874.938773:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575893632 00000100:00100000:0.0:1746140874.938786:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575894144 00000100:00100000:0.0:1746140874.938788:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575894144 00000100:00100000:0.0:1746140874.938793:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575894784 00000100:00100000:0.0:1746140874.938795:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575894784 00000100:00100000:0.0:1746140874.938801:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575895296 00000100:00100000:0.0:1746140874.938802:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575895296 00000100:00100000:0.0:1746140874.938807:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575894656 00000100:00100000:0.0:1746140874.938809:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575894656 00000100:00100000:0.0:1746140874.938814:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575895168 00000100:00100000:0.0:1746140874.938815:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575895168 00000100:00100000:0.0:1746140874.938821:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15963 00000100:00100000:0.0:1746140874.938825:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3311:x1830960575893760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140874.938897:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140874.938898:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140874.938900:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140874.938901:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140874.938902:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140874.938920:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960575893760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1717us total) trans 17179873912 rc 0/0 00000100:00100000:0.0:1746140874.939451:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15963 00000100:00100000:0.0:1746140874.939461:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575895424 00000100:00100000:0.0:1746140874.939463:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575895424 00000100:00100000:0.0:1746140874.939472:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15964 00000100:00100000:0.0:1746140874.939476:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3313:x1830960575894016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140874.939580:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3313:x1830960575894016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (2366us total) trans 17179873913 rc 0/0 00000100:00100000:0.0:1746140874.939587:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15964 00000100:00100000:0.0:1746140874.939596:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15968 00000100:00100000:0.0:1746140874.939599:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3311:x1830960575894144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140874.939622:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15969 00000100:00100000:0.0:1746140874.939626:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3311:x1830960575894784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140874.939713:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4747392 -> 4747392 00002000:00010000:0.0:1746140874.939715:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140874.939717:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140874.939718:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140874.939719:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5251 -> 5251 00000100:00100000:0.0:1746140874.939737:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3311:x1830960575894784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (1042us total) trans 21474841172 rc 0/0 00000100:00100000:0.0:1746140874.939742:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15969 00000100:00100000:0.0:1746140874.939751:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15971 00000100:00100000:0.0:1746140874.939754:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3311:x1830960575894656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140874.939820:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140874.939822:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140874 -> 1746140874 00002000:00010000:0.0:1746140874.939823:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140874.939825:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140874 -> 1746140874 00002000:00010000:0.0:1746140874.939827:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140874.939844:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3311:x1830960575894656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1105us total) trans 21474841174 rc 0/0 00000100:00100000:0.0:1746140874.939848:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15971 00000100:00100000:0.0:1746140874.939856:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15973 00000100:00100000:0.0:1746140874.939860:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3312:x1830960575894528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140874.939921:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140874.939924:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140874.939926:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140874.939928:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140874.939929:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746140874.939951:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3312:x1830960575894528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (931us total) trans 21474841175 rc 0/0 00000100:00100000:0.0:1746140874.939956:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15973 00000100:00100000:0.0:1746140874.939965:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15974 00000100:00100000:0.0:1746140874.939969:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3312:x1830960575895424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140874.940043:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3312:x1830960575895424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1048us total) trans 21474841176 rc 0/0 00000100:00100000:0.0:1746140874.940048:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15974 00000100:00100000:0.0:1746140874.941008:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+41:3311:x1830960575895168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1207us (2253us total) trans 21474841180 rc 0/0 00000100:00100000:0.0:1746140874.941013:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15972 00000004:00080000:0.0:1746140874.941032:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baea00/2, rc 0, transno 21474841174 00000100:00100000:0.0:1746140874.941035:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575894656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140874.941040:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bac700/2, rc 0, transno 21474841180 00000100:00100000:0.0:1746140874.941043:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575895168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140874.941047:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baf800/2, rc 0, transno 21474841172 00000100:00100000:0.0:1746140874.941049:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575894784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140874.941054:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bad180/2, rc 0, transno 21474841173 00000100:00100000:0.0:1746140874.941055:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575895296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140874.941061:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cdf80/2, rc 0, transno 17179873915 00000100:00100000:0.0:1746140874.941063:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575893632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140874.941081:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f24c000/2, rc 0, transno 17179873912 00000100:00100000:0.0:1746140874.941084:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575893760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140874.941091:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f24ca80/2, rc 0, transno 17179873917 00000100:00100000:0.0:1746140874.941093:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575894272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140874.941198:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f24c380/2, rc 0, transno 17179873918 00000100:00100000:0.0:1746140874.941202:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575894144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140874.943527:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.972990:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.975398:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.979566:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.982919:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.985953:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.986028:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140874.992002:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746140875.001594:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944748 is committed 00000001:00080000:0.0:1746140875.001605:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944750 is committed 00000004:00080000:0.0:1746140875.001608:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2580 committed 00000004:00080000:0.0:1746140875.001614:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2540 committed 00000004:00080000:0.0:1746140875.001628:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2539 committed 00000004:00080000:0.0:1746140875.001629:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2538 committed 00000004:00080000:0.0:1746140875.001631:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2537 committed 00000004:00080000:0.0:1746140875.001632:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2579 committed 00000004:00080000:0.0:1746140875.001633:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2536 committed 00000004:00080000:0.0:1746140875.001634:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2578 committed 00000004:00080000:0.0:1746140875.001636:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2535 committed 00000004:00080000:0.0:1746140875.001637:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2577 committed 00000004:00080000:0.0:1746140875.001638:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2576 committed 00000004:00080000:0.0:1746140875.001640:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2575 committed 00000004:00080000:0.0:1746140875.001642:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2534 committed 00000004:00080000:0.0:1746140875.001644:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2533 committed 00000004:00080000:0.0:1746140875.001645:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2574 committed 00000004:00080000:0.0:1746140875.001647:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2573 committed 00000004:00080000:0.0:1746140875.001648:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2532 committed 00000100:00100000:0.0:1746140875.001778:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575896192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140875.001819:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140875.001841:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575896704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140875.001852:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140875.001954:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575896192 00000100:00100000:0.0:1746140875.001959:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575896192 00000100:00100000:0.0:1746140875.001987:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575896320 00000100:00100000:0.0:1746140875.001988:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575896320 00000100:00100000:0.0:1746140875.001997:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575896448 00000100:00100000:0.0:1746140875.001998:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575896448 00000100:00100000:0.0:1746140875.002010:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15985 00000100:00100000:0.0:1746140875.002015:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3310:x1830960575896064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140875.002165:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140875.002168:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140875.002170:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140874 -> 1746140874 00002000:00010000:0.0:1746140875.002172:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140875.002173:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140875.002192:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3310:x1830960575896064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (360us total) trans 17179873919 rc 0/0 00000100:00100000:0.0:1746140875.002198:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15985 00000100:00100000:0.0:1746140875.002208:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15989 00000100:00100000:0.0:1746140875.002211:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3312:x1830960575896832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140875.002296:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3312:x1830960575896832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (390us total) trans 17179873920 rc 0/0 00000100:00100000:0.0:1746140875.002301:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15989 00000100:00100000:0.0:1746140875.002326:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15990 00000100:00100000:0.0:1746140875.002330:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3312:x1830960575896448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140875.002406:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3312:x1830960575896448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (489us total) trans 17179873921 rc 0/0 00000100:00100000:0.0:1746140875.002411:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15990 00000100:00100000:0.0:1746140875.002420:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575897216 00000100:00100000:0.0:1746140875.002422:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575897216 00000100:00100000:0.0:1746140875.002431:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575897472 00000100:00100000:0.0:1746140875.002432:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575897472 00000100:00100000:0.0:1746140875.002438:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575897728 00000100:00100000:0.0:1746140875.002439:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575897728 00000100:00100000:0.0:1746140875.002444:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575897088 00000100:00100000:0.0:1746140875.002446:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575897088 00000100:00100000:0.0:1746140875.002454:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15992 00000100:00100000:0.0:1746140875.002457:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3311:x1830960575897216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140875.002534:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140875.002536:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140874 -> 1746140874 00002000:00010000:0.0:1746140875.002538:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140875.002539:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140874 -> 1746140874 00002000:00010000:0.0:1746140875.002541:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140875.002844:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3311:x1830960575897216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 387us (479us total) trans 21474841181 rc 0/0 00000100:00100000:0.0:1746140875.002851:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15992 00000100:00100000:0.0:1746140875.002858:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575897600 00000100:00100000:0.0:1746140875.002861:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575897600 00000100:00100000:0.0:1746140875.002871:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15993 00000100:00100000:0.0:1746140875.002874:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960575897472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140875.002959:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3313:x1830960575897472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (581us total) trans 21474841182 rc 0/0 00000100:00100000:0.0:1746140875.002964:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15993 00000100:00100000:0.0:1746140875.003144:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15996 00000100:00100000:0.0:1746140875.003149:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3311:x1830960575897088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140875.003490:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140875.003493:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140875.003494:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140873 -> 1746140873 00002000:00010000:0.0:1746140875.003496:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140875.003498:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746140875.003518:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3311:x1830960575897088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 370us (1094us total) trans 21474841187 rc 0/0 00000100:00100000:0.0:1746140875.003523:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15996 00000100:00100000:0.0:1746140875.003947:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3311:x1830960575896704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1907us (2092us total) trans 17179873924 rc 0/0 00000100:00100000:0.0:1746140875.003952:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15987 00002000:00010000:0.0:1746140875.004026:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140875.004028:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140875.004030:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140874 -> 1746140874 00002000:00010000:0.0:1746140875.004031:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140875 -> 1746140875 00002000:00010000:0.0:1746140875.004619:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:0.0:1746140875.004641:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:3311:x1830960575896192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2622us (2822us total) trans 17179873925 rc 0/0 00000100:00100000:0.0:1746140875.004649:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15986 00000100:00100000:0.0:1746140875.004678:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.005211:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573318144 00000100:00100000:0.0:1746140875.005215:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573318144 00000100:00100000:0.0:1746140875.005228:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573318272 00000100:00100000:0.0:1746140875.005229:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573318272 00000100:00100000:0.0:1746140875.005237:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573318400 00000100:00100000:0.0:1746140875.005239:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573318400 00000100:00100000:0.0:1746140875.005335:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573318528 00000100:00100000:0.0:1746140875.005338:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573318528 00000100:00100000:0.0:1746140875.005351:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16005 00000100:00100000:0.0:1746140875.005355:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573318272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140875.005359:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140875.005364:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009396fa00/0x8156357b7fdb7ca5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a00f3 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.005371:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.005372:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.005376:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009396fa00/0x8156357b7fdb7ca5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a00f3 expref: 38 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.005385:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009396fa00/0x8156357b7fdb7ca5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a00f3 expref: 38 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.005391:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009396fa00, rc 0) 00000100:00100000:0.0:1746140875.005407:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573318272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.005411:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16005 00000100:00100000:0.0:1746140875.005422:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16006 00000100:00100000:0.0:1746140875.005427:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573318400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140875.005432:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140875.005438:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009396e000/0x8156357b7fdb7cac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a00fa expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.005446:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.005447:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.005450:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009396e000/0x8156357b7fdb7cac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a00fa expref: 27 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.005457:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009396e000/0x8156357b7fdb7cac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a00fa expref: 27 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.005463:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009396e000, rc 0) 00000100:00100000:0.0:1746140875.005476:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573318400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.005480:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16006 00000100:00100000:0.0:1746140875.005489:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16007 00000100:00100000:0.0:1746140875.005493:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573318528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140875.005498:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140875.005502:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009396e800/0x8156357b7fdb7cb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0101 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.005510:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.005511:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.005514:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009396e800/0x8156357b7fdb7cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0101 expref: 27 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.005522:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009396e800/0x8156357b7fdb7cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0101 expref: 27 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.005528:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009396e800, rc 0) 00000100:00100000:0.0:1746140875.005539:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573318528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 47us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.005544:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16007 00000100:00100000:0.0:1746140875.005781:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.006232:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.006265:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.009280:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.015248:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.015302:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.015363:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.015397:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.015421:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573319680 00000100:00100000:0.0:1746140875.015430:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573319680 00002000:00100000:0.0:1746140875.015472:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092612300 x1830960573319680/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:291/0 lens 504/0 e 0 to 0 dl 1746140886 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140875.015483:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612300 with x1830960573319680 ext(1048576->2097151) 00002000:00010000:0.0:1746140875.015489:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612300 00000100:00100000:0.0:1746140875.015516:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573320192 00000100:00100000:0.0:1746140875.015520:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573320192 00002000:00100000:0.0:1746140875.015532:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880092611f80 x1830960573320192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:291/0 lens 488/0 e 0 to 0 dl 1746140886 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140875.015543:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611f80 with x1830960573320192 ext(1048576->2097151) 00002000:00010000:0.0:1746140875.015546:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092611f80 00000100:00100000:0.0:1746140875.015560:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8131 00000100:00100000:0.0:1746140875.015567:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573319424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140875.029807:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.048007:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.048048:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.048074:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.048105:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.050167:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.081377:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.095118:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.141573:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.147926:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.150139:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.162450:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.177115:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.181388:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.192033:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.197807:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.199622:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.201266:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.201446:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.201638:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8140 00000100:00100000:0.0:1746140875.201646:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1982:x1830960573324416:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140875.205252:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.205349:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.219681:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.219781:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.221406:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.226910:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.227023:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.229138:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.229468:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.236538:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.237546:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.242536:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.243926:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.247703:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.259991:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.263070:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.263185:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.263205:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.263214:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.263225:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.263241:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.263255:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573327232 00000100:00100000:0.0:1746140875.263258:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573327232 00010000:00010000:0.0:1746140875.263274:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4824a00/0x8156357b7fdb7c04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a009f expref: 10 pid: 4186 timeout: 954 lvb_type: 1 00000100:00100000:0.0:1746140875.263327:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573328256 00000100:00100000:0.0:1746140875.263330:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573328256 00010000:00010000:0.0:1746140875.263338:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d2b600/0x8156357b7fdb7bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a006e expref: 34 pid: 4785 timeout: 954 lvb_type: 1 00000100:00100000:0.0:1746140875.263348:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8250 00000100:00100000:0.0:1746140875.263353:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573327232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140875.263360:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140875.263378:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4824a00/0x8156357b7fdb7c04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a009f expref: 10 pid: 4186 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.263386:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4824a00/0x8156357b7fdb7c04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a009f expref: 10 pid: 4186 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.263421:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4824a00/0x8156357b7fdb7c04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a009f expref: 10 pid: 4186 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.263433:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140875.263455:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573327232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.263459:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8250 00000100:00100000:0.0:1746140875.263468:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8252 00000100:00100000:0.0:1746140875.263471:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573328256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140875.263476:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140875.263480:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d2b600/0x8156357b7fdb7bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a006e expref: 35 pid: 4785 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.263489:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d2b600/0x8156357b7fdb7bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a006e expref: 35 pid: 4785 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.263496:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d2b600/0x8156357b7fdb7bc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a006e expref: 35 pid: 4785 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.263500:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.263501:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.263506:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013103a800/0x8156357b7fdb7d5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a014e expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.263511:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013103a800/0x8156357b7fdb7d5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a014e expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.263529:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013103a800/0x8156357b7fdb7d5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a014e expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140875.263536:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc36d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960575900672:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140875.263569:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140875.263631:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.263647:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573328512 00000100:00100000:0.0:1746140875.263650:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573328512 00002000:00100000:0.0:1746140875.263664:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009fc34380 x1830960573328512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:291/0 lens 488/0 e 0 to 0 dl 1746140886 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140875.263672:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34380 with x1830960573328512 ext(3145728->4194303) 00002000:00010000:0.0:1746140875.263676:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc34380 00000100:00100000:0.0:1746140875.263694:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8146 00000100:00100000:0.0:1746140875.263700:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1983:x1830960573328512:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140875.267229:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc36d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960575900672:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140875.267262:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140875.267326:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573328256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3851us (4081us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.267337:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8252 00000100:00100000:0.0:1746140875.267520:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.283530:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.283598:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.291392:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.295463:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.295526:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.304257:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.304686:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.304717:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16017 00000100:00100000:0.0:1746140875.304724:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1985:x1830960573330048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140875.304741:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140875.304758:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdaf200/0x8156357b7fdb7d77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0163 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140875.304802:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093135880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575901312:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140875.304884:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140875.308786:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.308839:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.313171:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.315671:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.316692:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.318200:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573331200 00000100:00100000:0.0:1746140875.318204:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573331200 00000100:00100000:0.0:1746140875.318536:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16022 00000100:00100000:0.0:1746140875.318543:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573331200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140875.318556:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140875.318569:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdae000/0x8156357b7fdb7db6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a018d expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140875.318614:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960575901696:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140875.319350:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00002000:00010000:0.0:1746140875.320659:0:8459:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime: 1746140875 -> 1746140876 00002000:00010000:0.0:1746140875.320664:0:8459:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140875 -> 1746140876 00002000:00010000:0.0:1746140875.320666:0:8459:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime: 1746140875 -> 1746140876 00000100:00100000:0.0:1746140875.320691:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960575901696:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140875.320717:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fdae000/0x8156357b7fdb7db6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a018d expref: 27 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.320730:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdae000/0x8156357b7fdb7db6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a018d expref: 27 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.320756:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdae000, rc 0) 00000100:00100000:0.0:1746140875.320804:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573331200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2259us (3064us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140875.320813:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16022 00000100:00100000:0.0:1746140875.327365:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.327404:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.327447:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.327520:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573331968 00000100:00100000:0.0:1746140875.327523:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573331968 00002000:00100000:0.0:1746140875.327542:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1073152->2097151) req@ffff880093135c00 x1830960573331968/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:291/0 lens 488/0 e 0 to 0 dl 1746140886 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140875.327549:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135c00 with x1830960573331968 ext(1073152->2097151) 00002000:00010000:0.0:1746140875.327552:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135c00 00000100:00100000:0.0:1746140875.327565:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8151 00000100:00100000:0.0:1746140875.327571:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573331712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140875.345387:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.349103:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.376495:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.402571:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.414042:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.449527:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.453509:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.454342:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.455026:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.458975:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.462831:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.469863:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.475776:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.478956:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.515033:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.532095:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.532149:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.536175:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.536217:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.536469:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.536510:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.536533:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573336192 00000100:00100000:0.0:1746140875.536543:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573336192 00000100:00100000:0.0:1746140875.536631:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573336448 00000100:00100000:0.0:1746140875.536634:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573336448 00000100:00100000:0.0:1746140875.536702:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16028 00000100:00100000:0.0:1746140875.536708:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573336320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140875.536725:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140875.536740:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9f9600/0x8156357b7fdb7e65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a01d3 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140875.536785:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575902848:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140875.536856:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140875.542152:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.544457:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.546286:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.546346:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.546559:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.548808:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575903488:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140875.548839:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090719c00/0x8156357b7fdb7e88 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a01ef expref: 27 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.548853:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090719c00/0x8156357b7fdb7e88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a01ef expref: 27 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.548867:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090719c00, rc 0) 00000100:00100000:0.0:1746140875.548903:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573336960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2133us (2555us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140875.548911:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16031 00000100:00100000:0.0:1746140875.549070:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575903744:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140875.549084:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013103a600/0x8156357b7fdb7e8f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a01f6 expref: 41 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.549092:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013103a600/0x8156357b7fdb7e8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a01f6 expref: 41 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140875.549100:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013103a600, rc 0) 00000100:00100000:0.0:1746140875.549118:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573337088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2135us (2559us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140875.549123:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16033 00000100:00100000:0.0:1746140875.551443:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.555387:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.557539:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.557582:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.560874:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.561115:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573337728 00000100:00100000:0.0:1746140875.561121:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573337728 00010000:00010000:0.0:1746140875.561145:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec30400/0x8156357b7fdb7bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0091 expref: 9 pid: 32376 timeout: 954 lvb_type: 1 00000100:00100000:0.0:1746140875.561177:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8260 00000100:00100000:0.0:1746140875.561184:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573337728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140875.561197:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140875.561220:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec30400/0x8156357b7fdb7bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0091 expref: 9 pid: 32376 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.561229:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec30400/0x8156357b7fdb7bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0091 expref: 9 pid: 32376 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.561247:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec30400/0x8156357b7fdb7bfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0091 expref: 9 pid: 32376 timeout: 954 lvb_type: 1 00010000:00010000:0.0:1746140875.561258:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140875.561268:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573337728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.561285:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8260 00000100:00100000:0.0:1746140875.562092:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.562124:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.563150:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.569083:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.571608:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.571695:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.577750:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.577851:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.581227:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.592795:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.596629:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140875.598667:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013103ae00/0x8156357b7fdb7de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a01a2 expref: 33 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.598678:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140875.598680:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140875.598684:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a37600/0x8156357b7fdb7eab lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0212 expref: 39 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.598716:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013103ae00/0x8156357b7fdb7de7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a01a2 expref: 33 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.598728:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013103ae00/0x8156357b7fdb7de7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a01a2 expref: 33 pid: 8459 timeout: 954 lvb_type: 0 00000100:00100000:0.0:1746140875.598741:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575905024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140875.599434:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140875.600340:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.601819:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.618987:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.619042:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.623201:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.623294:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.628677:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.628722:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.628787:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.647414:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.654913:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.657256:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.657297:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.657349:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.659603:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16041 00000100:00100000:0.0:1746140875.659614:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:32211:x1830960573342720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140875.659627:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140875.659642:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9f8a00/0x8156357b7fdb7eea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0235 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.659663:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.659669:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a36e00/0x8156357b7fdb7edc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3796992->4112383] (req 3796992->4112383) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0227 expref: 37 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.659675:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140875.659678:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9f8a00/0x8156357b7fdb7eea lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0235 expref: 40 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.659711:0:8459:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a36e00/0x8156357b7fdb7edc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3796992->4112383] (req 3796992->4112383) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0227 expref: 37 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.659721:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9f8a00/0x8156357b7fdb7eea lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0235 expref: 40 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.659730:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9f8a00, rc 0) 00000100:00100000:0.0:1746140875.659775:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:32211:x1830960573342720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 164us (2426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.659782:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16041 00000100:00100000:0.0:1746140875.662958:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.669718:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.676404:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.679790:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.679836:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.679883:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.680355:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573344000 00000100:00100000:0.0:1746140875.680358:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573344000 00000100:00100000:0.0:1746140875.680385:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16042 00000100:00100000:0.0:1746140875.680390:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+38:32210:x1830960573344000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140875.680398:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140875.680413:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9f9c00/0x8156357b7fdb7ef1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a023c expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.680432:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140875.680437:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9f9c00/0x8156357b7fdb7ef1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a023c expref: 39 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.680448:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9f9c00/0x8156357b7fdb7ef1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a023c expref: 39 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.680457:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9f9c00, rc 0) 00000100:00100000:0.0:1746140875.680493:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+39:32210:x1830960573344000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 102us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.680498:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16042 00000100:00100000:0.0:1746140875.687916:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.689719:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.694110:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.701481:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.708723:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.717460:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.717519:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.720657:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.727761:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.735879:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.738741:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.740957:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.741008:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.741328:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4576 00000100:00100000:0.0:1746140875.741335:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:32216:x1830960573346560:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746140875.741558:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:32216:x1830960573346560:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 224us (606us total) trans 8589944772 rc 0/0 00000100:00100000:0.0:1746140875.741564:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4576 00000100:00100000:0.0:1746140875.746546:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.796466:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.869665:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.878006:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.882593:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.887048:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.890589:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.897129:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.900784:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.900830:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.902172:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573348480 00000100:00100000:0.0:1746140875.902177:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573348480 00010000:00010000:0.0:1746140875.902195:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090718e00/0x8156357b7fdb7e9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->602111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0204 expref: 31 pid: 8459 timeout: 954 lvb_type: 0 00000100:00100000:0.0:1746140875.902224:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8270 00000100:00100000:0.0:1746140875.902229:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573348480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140875.902238:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140875.902252:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090718e00/0x8156357b7fdb7e9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->602111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0204 expref: 31 pid: 8459 timeout: 954 lvb_type: 0 00010000:00010000:0.0:1746140875.902262:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090718e00/0x8156357b7fdb7e9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->602111) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0204 expref: 31 pid: 8459 timeout: 954 lvb_type: 0 00010000:00010000:0.0:1746140875.902287:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090718e00/0x8156357b7fdb7e9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->602111) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0204 expref: 31 pid: 8459 timeout: 954 lvb_type: 0 00010000:00010000:0.0:1746140875.902301:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.902302:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.902324:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ef60800/0x8156357b7fdb7fae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0289 expref: 25 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.902332:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef60800/0x8156357b7fdb7fae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0289 expref: 25 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.902350:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ef60800/0x8156357b7fdb7fae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0289 expref: 25 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140875.902363:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575906944:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140875.902412:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140875.902754:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960575906816:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140875.902764:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140875.902917:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573348224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1733us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140875.902924:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8269 00000100:00100000:0.0:1746140875.905540:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.905829:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.910803:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.916596:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.917954:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.921713:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.924186:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.924841:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.937997:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.943931:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.943980:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.954661:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.954763:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.956695:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573351552 00000100:00100000:0.0:1746140875.956699:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573351552 00010000:00010000:0.0:1746140875.956715:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090718c00/0x8156357b7fdb7ea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a020b expref: 30 pid: 8459 timeout: 955 lvb_type: 0 00000100:00100000:0.0:1746140875.956739:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8275 00000100:00100000:0.0:1746140875.956744:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573351552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140875.956751:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140875.956761:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090718c00/0x8156357b7fdb7ea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a020b expref: 30 pid: 8459 timeout: 955 lvb_type: 0 00010000:00010000:0.0:1746140875.956769:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090718c00/0x8156357b7fdb7ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a020b expref: 30 pid: 8459 timeout: 955 lvb_type: 0 00010000:00010000:0.0:1746140875.956783:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090718c00/0x8156357b7fdb7ea4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a020b expref: 30 pid: 8459 timeout: 955 lvb_type: 0 00010000:00010000:0.0:1746140875.956797:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.956799:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140875.956805:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a36600/0x8156357b7fdb7fca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a02a5 expref: 28 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.956813:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a36600/0x8156357b7fdb7fca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a02a5 expref: 28 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140875.957075:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a36600/0x8156357b7fdb7fca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a02a5 expref: 28 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140875.957087:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575907968:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140875.957143:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140875.958946:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.959037:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.959834:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.959866:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.959898:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.965154:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.968472:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.969731:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.972842:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.972869:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.972903:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.973793:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8178 00000100:00100000:0.0:1746140875.974725:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573353728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140875.975000:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.984790:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.984974:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573353728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10253us (12069us total) trans 0 rc 196608/196608 00000100:00100000:0.0:1746140875.984982:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8178 00002000:00100000:0.0:1746140875.984987:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1245183) req@ffff8801359b1880 x1830960573353728/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:291/0 lens 488/440 e 0 to 0 dl 1746140886 ref 1 fl Complete:/200/0 rc 196608/196608 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140875.984994:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b1880 with x1830960573353728 ext(1048576->1245183) 00002000:00010000:0.0:1746140875.984997:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b1880 00000100:00100000:0.0:1746140875.988736:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.989927:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140875.999795:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.015382:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.016090:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.023215:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.023247:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.023286:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.024892:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.039616:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.047104:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.047141:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.047164:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.050284:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.050348:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.053977:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.054770:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.054808:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.056572:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573358080 00000100:00100000:0.0:1746140876.056576:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573358080 00002000:00100000:0.0:1746140876.056604:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a7:0x0] (1257472->1261567) req@ffff880094adce00 x1830960573358080/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:292/0 lens 488/0 e 0 to 0 dl 1746140887 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.056612:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adce00 with x1830960573358080 ext(1257472->1261567) 00002000:00010000:0.0:1746140876.056616:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094adce00 00000100:00100000:0.0:1746140876.056639:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8187 00000100:00100000:0.0:1746140876.056646:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+41:1985:x1830960573358080:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140876.056822:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+41:1985:x1830960573358080:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 177us (303us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140876.056828:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8187 00002000:00100000:0.0:1746140876.056833:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a7:0x0] (1257472->1261567) req@ffff880094adce00 x1830960573358080/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:292/0 lens 488/4536 e 0 to 0 dl 1746140887 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.056841:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adce00 with x1830960573358080 ext(1257472->1261567) 00002000:00010000:0.0:1746140876.056844:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094adce00 00000100:00100000:0.0:1746140876.057608:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.058415:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.063342:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.063380:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140876.063738:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140876.101231:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.150222:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.154459:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.157060:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.162096:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.166234:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.172503:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.177805:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.179426:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.183724:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.203441:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.207710:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573361792:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3994us (4276us total) trans 21474841196 rc 0/0 00000100:00100000:0.0:1746140876.207716:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1685 00002000:00100000:0.0:1746140876.207721:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2195455) req@ffff88009f2c0000 x1830960573361792/t21474841196(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:292/0 lens 488/448 e 0 to 0 dl 1746140887 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.207728:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0000 with x1830960573361792 ext(2097152->2195455) 00010000:00010000:0.0:1746140876.207735:0:21691:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a36c00/0x8156357b7fdb8087 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a030e expref: 33 pid: 8460 timeout: 955 lvb_type: 0 00010000:00010000:0.0:1746140876.207749:0:21691:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a36c00/0x8156357b7fdb8087 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a030e expref: 33 pid: 8460 timeout: 955 lvb_type: 0 00002000:00010000:0.0:1746140876.207754:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c0000 00000100:00100000:0.0:1746140876.213192:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.213246:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.217279:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.217403:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573362432 00000100:00100000:0.0:1746140876.217410:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573362432 00002000:00100000:0.0:1746140876.217444:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3010560->3014655) req@ffff88009f2c1f80 x1830960573362432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:292/0 lens 488/0 e 0 to 0 dl 1746140887 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.217452:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1f80 with x1830960573362432 ext(3010560->3014655) 00002000:00010000:0.0:1746140876.217456:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1f80 00000100:00100000:0.0:1746140876.217887:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8191 00000100:00100000:0.0:1746140876.217895:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573362432:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140876.218145:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573362432:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 250us (867us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140876.218152:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8191 00002000:00100000:0.0:1746140876.218157:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3010560->3014655) req@ffff88009f2c1f80 x1830960573362432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:292/0 lens 488/4536 e 0 to 0 dl 1746140887 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.218164:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1f80 with x1830960573362432 ext(3010560->3014655) 00002000:00010000:0.0:1746140876.218167:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1f80 00000100:00100000:0.0:1746140876.219065:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.219882:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.233993:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.237678:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.259204:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.259258:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.270977:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573363584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11355us (11712us total) trans 0 rc 1028096/1028096 00000100:00100000:0.0:1746140876.270987:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8195 00002000:00100000:0.0:1746140876.270998:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3166208->4194303) req@ffff88009b891500 x1830960573363584/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:292/0 lens 488/440 e 0 to 0 dl 1746140887 ref 1 fl Complete:/200/0 rc 1028096/1028096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.271008:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891500 with x1830960573363584 ext(3166208->4194303) 00002000:00010000:0.0:1746140876.271014:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891500 00000100:00100000:0.0:1746140876.277466:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.278769:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.282008:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.282672:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.282723:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.289092:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.293213:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.298816:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.305441:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.305478:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.329768:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.333112:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.338608:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.344365:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.347984:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.348067:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.348238:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8199 00000100:00100000:0.0:1746140876.348245:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573366656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140876.381399:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.394946:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.395001:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.402299:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.420975:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.421054:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.426894:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.426945:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.435925:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.455946:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.456033:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.478180:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.496588:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.497795:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.501656:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.501707:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.502597:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.511269:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.511344:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.517979:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.520341:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573371264 00000100:00100000:0.0:1746140876.520347:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573371264 00010000:00010000:0.0:1746140876.520364:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f768200/0x8156357b7fdb818a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0385 expref: 30 pid: 12255 timeout: 955 lvb_type: 1 00000100:00100000:0.0:1746140876.520394:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8293 00000100:00100000:0.0:1746140876.520400:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573371264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140876.520407:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140876.520415:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f768200/0x8156357b7fdb818a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0385 expref: 30 pid: 12255 timeout: 955 lvb_type: 1 00010000:00010000:0.0:1746140876.520423:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f768200/0x8156357b7fdb818a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0385 expref: 30 pid: 12255 timeout: 955 lvb_type: 1 00010000:00010000:0.0:1746140876.520435:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f768200/0x8156357b7fdb818a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0385 expref: 30 pid: 12255 timeout: 955 lvb_type: 1 00010000:00010000:0.0:1746140876.520448:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140876.520449:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140876.520455:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee72800/0x8156357b7fdb819f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a039a expref: 33 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.520462:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee72800/0x8156357b7fdb819f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a039a expref: 33 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.520489:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee72800/0x8156357b7fdb819f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a039a expref: 33 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140876.520500:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575912832:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140876.520724:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140876.524340:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.525929:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.528852:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.534183:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.613462:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.618799:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573372672 00000100:00100000:0.0:1746140876.618802:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573372672 00000100:00100000:0.0:1746140876.618834:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 752 00000100:00100000:0.0:1746140876.618839:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+294:1983:x1830960573372672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140876.618848:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140876.618869:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdb81c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a03a8 expref: 294 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.618887:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140876.618891:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140876.618912:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+293:1983:x1830960573372672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140876.618917:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 752 00000100:00100000:0.0:1746140876.623630:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.628040:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.637132:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.641865:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.647688:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.665021:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.665587:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.665626:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.668881:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.680581:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.687382:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.710647:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.715909:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.717772:0:20524:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10542 00000100:00100000:0.0:1746140876.717785:0:20524:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+33:32273:x1830960573375744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140876.717811:0:20524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140876.717831:0:20524:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013103a800/0x8156357b7fdb8239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a03e0 expref: -99 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.717943:0:20524:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.717957:0:20524:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.717968:0:20524:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.717982:0:20524:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.717989:0:20524:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.717995:0:20524:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718118:0:20524:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b800/0x8156357b7fdb824e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718125:0:20524:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b800/0x8156357b7fdb824e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718134:0:20524:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b800/0x8156357b7fdb824e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00000004:00200000:0.0:1746140876.718143:0:20524:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140876.718237:0:20524:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718244:0:20524:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718259:0:20524:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718265:0:20524:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013103be00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140876.718270:0:20524:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718275:0:20524:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718286:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140876.718289:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140876.718293:0:20524:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718298:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013103be00/0x8156357b7fdb8240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718336:0:20524:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718342:0:20524:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718350:0:20524:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718355:0:20524:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013103b000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140876.718357:0:20524:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718362:0:20524:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718368:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b5f0100) 00010000:00010000:0.0:1746140876.718370:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140876.718372:0:20524:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718376:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b000/0x8156357b7fdb8247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140876.718411:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013103a800/0x8156357b7fdb8239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a03e0 expref: 36 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.718422:0:20524:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013103b800/0x8156357b7fdb824e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a03e0 expref: 35 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.718428:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140876.718429:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140876.718432:0:20524:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013103b800, rc 0) 00000100:00100000:0.0:1746140876.718484:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+35:32273:x1830960573375744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 703us (2585us total) trans 8589944803 rc 0/0 00000100:00100000:0.0:1746140876.718491:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10542 00000100:00100000:0.0:1746140876.724025:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.724071:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.724108:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.724152:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.725543:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.727957:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.729276:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.730781:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.730808:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.730835:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.730847:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.730877:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.730892:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573377536 00000100:00100000:0.0:1746140876.730895:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573377536 00002000:00100000:0.0:1746140876.730921:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a2:0x0] (1130496->1134591) req@ffff880135699500 x1830960573377536/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:292/0 lens 488/0 e 0 to 0 dl 1746140887 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.730930:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699500 with x1830960573377536 ext(1130496->1134591) 00002000:00010000:0.0:1746140876.730934:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135699500 00000100:00100000:0.0:1746140876.730946:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573377792 00000100:00100000:0.0:1746140876.730948:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573377792 00002000:00100000:0.0:1746140876.730960:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880135698700 x1830960573377792/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:292/0 lens 488/0 e 0 to 0 dl 1746140887 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.730967:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698700 with x1830960573377792 ext(2097152->3145727) 00002000:00010000:0.0:1746140876.730970:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135698700 00000100:00100000:0.0:1746140876.730977:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573378048 00000100:00100000:0.0:1746140876.730979:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573378048 00002000:00100000:0.0:1746140876.730986:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88013569b800 x1830960573378048/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:292/0 lens 488/0 e 0 to 0 dl 1746140887 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.730997:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b800 with x1830960573378048 ext(3145728->4194303) 00002000:00010000:0.0:1746140876.731000:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569b800 00000100:00100000:0.0:1746140876.731007:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8212 00000100:00100000:0.0:1746140876.731011:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573377536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140876.731155:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573377536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 142us (346us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140876.731161:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8212 00002000:00100000:0.0:1746140876.731166:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a2:0x0] (1130496->1134591) req@ffff880135699500 x1830960573377536/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:292/0 lens 488/4536 e 0 to 0 dl 1746140887 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140876.731172:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699500 with x1830960573377536 ext(1130496->1134591) 00002000:00010000:0.0:1746140876.731175:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135699500 00000100:00100000:0.0:1746140876.731188:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8213 00000100:00100000:0.0:1746140876.731193:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1983:x1830960573377792:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140876.750505:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.753779:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.758800:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.767696:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.772683:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.777656:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.778375:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.785856:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.790345:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.790467:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.790487:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573380352 00000100:00100000:0.0:1746140876.790495:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573380352 00000100:00100000:0.0:1746140876.790522:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573380480 00000100:00100000:0.0:1746140876.790524:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573380480 00000100:00100000:0.0:1746140876.790538:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16095 00000100:00100000:0.0:1746140876.790543:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573380352:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140876.790558:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140876.790571:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb82b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a042d expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.790590:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140876.790592:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140876.790600:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb82b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a042d expref: 9 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140876.790616:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb82b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a042d expref: 9 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140876.790627:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdafc00, rc 0) 00000100:00100000:0.0:1746140876.790647:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573380352:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 104us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140876.790652:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16095 00000100:00100000:0.0:1746140876.790664:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16096 00000100:00100000:0.0:1746140876.790668:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573380480:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140876.790676:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140876.790684:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdae400/0x8156357b7fdb82be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0434 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.790699:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140876.790701:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140876.790705:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdae400/0x8156357b7fdb82be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0434 expref: 9 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140876.790714:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdae400/0x8156357b7fdb82be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0434 expref: 9 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140876.790720:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdae400, rc 0) 00000100:00100000:0.0:1746140876.790734:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573380480:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140876.790740:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16096 00000100:00100000:0.0:1746140876.790766:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.790778:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573380608 00000100:00100000:0.0:1746140876.790780:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573380608 00000100:00100000:0.0:1746140876.790795:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16097 00000100:00100000:0.0:1746140876.790799:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573380608:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140876.790805:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140876.790818:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdaf800/0x8156357b7fdb82c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a043b expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.790829:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140876.790830:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140876.790835:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdaf800/0x8156357b7fdb82c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a043b expref: 10 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140876.790844:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdaf800/0x8156357b7fdb82c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a043b expref: 10 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140876.790852:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdaf800, rc 0) 00000100:00100000:0.0:1746140876.790866:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573380608:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 67us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140876.790871:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16097 00000100:00100000:0.0:1746140876.794938:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.799302:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.799548:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573381760 00000100:00100000:0.0:1746140876.799555:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573381760 00000100:00100000:0.0:1746140876.800012:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10544 00000100:00100000:0.0:1746140876.800022:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:32275:x1830960573381760:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140876.800040:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140876.800057:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdaf000/0x8156357b7fdb82e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a045e expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.800151:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdafe00/0x8156357b7fdb82f6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140876.800166:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f1e400/0x8156357b7fdb82b0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0426 expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.800172:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdafe00/0x8156357b7fdb82f6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140876.800199:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092f1e400/0x8156357b7fdb82b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0426 expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140876.800211:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f1e400/0x8156357b7fdb82b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0426 expref: 10 pid: 14743 timeout: 955 lvb_type: 0 00000100:00100000:0.0:1746140876.800288:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575916032:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140876.800376:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140876.807446:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.810932:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.811285:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.814953:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.815051:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.815728:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.815769:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.819593:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.820338:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.820520:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.822390:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.823086:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.834474:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573384448 00000100:00100000:0.0:1746140876.834479:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573384448 00010000:00010000:0.0:1746140876.834498:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdaf800/0x8156357b7fdb82c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a043b expref: 10 pid: 8460 timeout: 955 lvb_type: 1 00000100:00100000:0.0:1746140876.834517:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8308 00000100:00100000:0.0:1746140876.834523:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573384448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140876.834530:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140876.834955:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdaf800/0x8156357b7fdb82c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a043b expref: 10 pid: 8460 timeout: 955 lvb_type: 1 00010000:00010000:0.0:1746140876.835092:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdaf800/0x8156357b7fdb82c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a043b expref: 10 pid: 8460 timeout: 955 lvb_type: 1 00010000:00010000:0.0:1746140876.835104:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdaf800/0x8156357b7fdb82c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a043b expref: 10 pid: 8460 timeout: 955 lvb_type: 1 00010000:00010000:0.0:1746140876.835128:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140876.835149:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573384448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 627us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140876.835156:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8308 00000100:00100000:0.0:1746140876.839131:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.839184:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.841403:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.845048:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.845469:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.845490:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.845677:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8223 00000100:00100000:0.0:1746140876.845684:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+45:1985:x1830960573385984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140876.869491:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.946139:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.951425:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.961456:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.967096:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.967136:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.969237:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.970343:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.970369:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.974410:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140876.979275:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.013048:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.016851:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.022502:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.022552:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.022830:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16111 00000100:00100000:0.0:1746140877.022837:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+43:1983:x1830960573388800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140877.022845:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140877.022855:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df35000/0x8156357b7fdb8390 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a04b9 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140877.022884:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575918720:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140877.023546:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140877.033039:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.038809:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.039531:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.046568:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.049464:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.056238:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.056284:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.056336:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.056573:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16117 00000100:00100000:0.0:1746140877.056581:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1983:x1830960573390336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140877.056592:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140877.056603:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df34800/0x8156357b7fdb83cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a04e3 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140877.056629:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960575919488:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140877.056819:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140877.059048:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960575919488:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140877.059075:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df34800/0x8156357b7fdb83cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a04e3 expref: 32 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140877.059087:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df34800/0x8156357b7fdb83cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a04e3 expref: 32 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140877.059862:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df34800, rc 0) 00000100:00100000:0.0:1746140877.059891:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1983:x1830960573390336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3311us (3553us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140877.059896:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16117 00000100:00100000:0.0:1746140877.060509:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.062880:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.065708:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140877.066498:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140877.066726:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.073983:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.074005:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.077085:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.081738:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.083738:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.093357:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.096588:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.097678:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.097740:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.100014:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.112595:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.119615:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.119665:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.123072:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.123111:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.123155:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.123684:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8234 00000100:00100000:0.0:1746140877.123697:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8235 00000100:00100000:0.0:1746140877.123703:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573394304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140877.125326:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+48:1984:x1830960573393792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140877.131331:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.131358:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.131382:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.131406:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.155018:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.155080:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.158944:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.209368:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573396480 00000100:00100000:0.0:1746140877.209379:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573396480 00000100:00100000:0.0:1746140877.209422:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16125 00000100:00100000:0.0:1746140877.209430:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+32:32290:x1830960573396480:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140877.209691:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140877.209709:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801355e7600/0x8156357b7fdb8431 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0530 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.209736:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdb83d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a04f1 expref: 33 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.209745:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b2bee00/0x8156357b7fdb8400 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a050d expref: 40 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140877.209751:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140877.209752:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140877.209755:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801355e7600/0x8156357b7fdb8431 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3813376->4194303] (req 3813376->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0530 expref: 33 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.209782:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b2bee00/0x8156357b7fdb8400 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a050d expref: 40 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140877.209793:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b2bee00/0x8156357b7fdb8400 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a050d expref: 40 pid: 8460 timeout: 956 lvb_type: 1 00000100:00100000:0.0:1746140877.209804:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575920768:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140877.209892:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdb83d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a04f1 expref: 33 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.209900:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdb83d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a04f1 expref: 33 pid: 8460 timeout: 956 lvb_type: 0 00000100:00100000:0.0:1746140877.209913:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575920896:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140877.209931:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140877.217467:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575920768:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140877.217481:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575920896:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140877.217508:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801355e7600/0x8156357b7fdb8431 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3813376->4194303] (req 3813376->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0530 expref: 33 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.217525:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355e7600, rc 0) 00000100:00100000:0.0:1746140877.217574:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+33:32290:x1830960573396480:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8145us (8248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140877.217583:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16125 00000100:00100000:0.0:1746140877.222376:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.230870:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573397120 00000100:00100000:0.0:1746140877.230880:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573397120 00000100:00100000:0.0:1746140877.230924:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16126 00000100:00100000:0.0:1746140877.230945:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+48:32290:x1830960573397120:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140877.230961:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140877.230979:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc200/0x8156357b7fdb8438 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0537 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.231008:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801354bea00/0x8156357b7fdb83f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0506 expref: 49 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.231016:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801355e6e00/0x8156357b7fdb8407 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0514 expref: 43 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140877.231023:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140877.231025:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140877.231029:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc200/0x8156357b7fdb8438 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->3706879] (req 3145728->3706879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0537 expref: 49 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.231059:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801355e6e00/0x8156357b7fdb8407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0514 expref: 43 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140877.231073:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801355e6e00/0x8156357b7fdb8407 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0514 expref: 43 pid: 4785 timeout: 956 lvb_type: 1 00000100:00100000:0.0:1746140877.231085:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575921152:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140877.231168:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801354bea00/0x8156357b7fdb83f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0506 expref: 49 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.231176:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801354bea00/0x8156357b7fdb83f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0506 expref: 49 pid: 8460 timeout: 956 lvb_type: 0 00000100:00100000:0.0:1746140877.231184:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575921280:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140877.231201:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140877.234448:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575921152:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140877.234460:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575921280:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140877.234486:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc200/0x8156357b7fdb8438 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->3706879] (req 3145728->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0537 expref: 49 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.234510:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbc200, rc 0) 00000100:00100000:0.0:1746140877.234556:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+49:32290:x1830960573397120:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3624us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140877.234565:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16126 00000100:00100000:0.0:1746140877.236109:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.237257:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.237532:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573397376 00000100:00100000:0.0:1746140877.237538:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573397376 00010000:00010000:0.0:1746140877.237564:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801355e6e00/0x8156357b7fdb8407 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0514 expref: 44 pid: 4785 timeout: 956 lvb_type: 1 00000100:00100000:0.0:1746140877.237588:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8326 00000100:00100000:0.0:1746140877.237594:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009334b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573397376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140877.237604:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140877.237622:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801355e6e00/0x8156357b7fdb8407 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0514 expref: 44 pid: 4785 timeout: 956 lvb_type: 1 00010000:00010000:0.0:1746140877.237633:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801355e6e00/0x8156357b7fdb8407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0514 expref: 44 pid: 4785 timeout: 956 lvb_type: 1 00010000:00010000:0.0:1746140877.237651:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801355e6e00/0x8156357b7fdb8407 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0514 expref: 44 pid: 4785 timeout: 956 lvb_type: 1 00010000:00010000:0.0:1746140877.237662:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140877.237664:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140877.237671:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc200/0x8156357b7fdb8438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0537 expref: 47 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.237678:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc200/0x8156357b7fdb8438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0537 expref: 47 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.237706:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc200/0x8156357b7fdb8438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0537 expref: 47 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140877.237718:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009334bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575921408:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140877.237773:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140877.242651:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009334bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575921408:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140877.242671:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140877.242712:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009334b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573397376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5116us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140877.242722:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8326 00000100:00100000:0.0:1746140877.249051:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746140877.271093:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841196 is committed 00000001:00080000:0.0:1746140877.271108:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841187 is committed 00000001:00080000:0.0:1746140877.271124:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841168 is committed 00000001:00080000:0.0:1746140877.271161:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841200 is committed 00000001:00080000:0.0:1746140877.271169:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841198 is committed 00000001:00080000:0.0:1746140877.271180:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841189 is committed 00000001:00080000:0.0:1746140877.271207:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841147 is committed 00000001:00080000:0.0:1746140877.271216:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841201 is committed 00000001:00080000:0.0:1746140877.271222:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841199 is committed 00000001:00080000:0.0:1746140877.271288:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841202 is committed 00000100:00100000:0.0:1746140877.297036:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.297585:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.330794:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.334823:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8248 00000100:00100000:0.0:1746140877.334830:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573399040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140877.341107:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.343937:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573398656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12958us (13147us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140877.343948:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8246 00002000:00100000:0.0:1746140877.343958:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009fecc380 x1830960573398656/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:293/0 lens 488/440 e 0 to 0 dl 1746140888 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140877.343967:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fecc380 with x1830960573398656 ext(2097152->3145727) 00002000:00010000:0.0:1746140877.343971:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fecc380 00000100:00100000:0.0:1746140877.347921:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.347953:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.350181:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.357720:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.357750:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.357779:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.357801:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.358786:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.358847:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.364718:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.366683:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.369832:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.375032:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.379502:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.385880:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.386047:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.386066:0:20524:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573402240 00000100:00100000:0.0:1746140877.386070:0:20524:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573402240 00000100:00100000:0.0:1746140877.386108:0:20524:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10554 00000100:00100000:0.0:1746140877.386113:0:20524:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+39:32301:x1830960573402240:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140877.386131:0:20524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140877.386144:0:20524:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130081800/0x8156357b7fdb84af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0584 expref: -99 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.386214:0:20524:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130080c00/0x8156357b7fdb84b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140877.386224:0:20524:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130080c00/0x8156357b7fdb84b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20524 initiator: MDT0 00010000:00010000:0.0:1746140877.386232:0:20524:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130080c00/0x8156357b7fdb84b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20524 initiator: MDT0 00000004:00200000:0.0:1746140877.386248:0:20524:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140877.386360:0:20524:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130081800/0x8156357b7fdb84af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0584 expref: 42 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.386385:0:20524:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130080c00/0x8156357b7fdb84b6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0584 expref: 41 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140877.386392:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140877.386394:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140877.386397:0:20524:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130080c00, rc 0) 00000100:00100000:0.0:1746140877.386431:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+41:32301:x1830960573402240:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 317us (383us total) trans 8589944820 rc 0/0 00000100:00100000:0.0:1746140877.386438:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10554 00000100:00100000:0.0:1746140877.389284:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.395300:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.395374:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.395414:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.400450:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.406951:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.409412:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.409465:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.409958:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573403904 00000100:00100000:0.0:1746140877.409962:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573403904 00000100:00100000:0.0:1746140877.409984:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16139 00000100:00100000:0.0:1746140877.409988:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573403904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140877.410000:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140877.410006:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130081600/0x8156357b7fdb84e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a05ae expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140877.410034:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575923200:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140877.410072:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140877.411053:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.412874:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.418728:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.424758:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.432074:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.434562:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.437958:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.439187:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.441818:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.455137:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.459490:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.462636:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.465326:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.470034:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.472844:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.490754:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.496210:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.549188:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.549227:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.549272:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.549295:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.549346:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573407616 00000100:00100000:0.0:1746140877.549355:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573407616 00002000:00100000:0.0:1746140877.549404:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3600383) req@ffff88009b459880 x1830960573407616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:293/0 lens 504/0 e 0 to 0 dl 1746140888 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140877.549415:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b459880 with x1830960573407616 ext(2097152->3600383) 00002000:00010000:0.0:1746140877.549420:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b459880 00000100:00100000:0.0:1746140877.549434:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573407872 00000100:00100000:0.0:1746140877.549437:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573407872 00002000:00100000:0.0:1746140877.549448:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3600384->4194303) req@ffff88009b459c00 x1830960573407872/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:293/0 lens 488/0 e 0 to 0 dl 1746140888 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140877.549454:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b459c00 with x1830960573407872 ext(3600384->4194303) 00002000:00010000:0.0:1746140877.549457:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b459c00 00000100:00100000:0.0:1746140877.549475:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573408128 00000100:00100000:0.0:1746140877.549477:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573408128 00002000:00100000:0.0:1746140877.549495:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2232320->3280895) req@ffff88009b459f80 x1830960573408128/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:293/0 lens 488/0 e 0 to 0 dl 1746140888 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140877.549502:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b459f80 with x1830960573408128 ext(2232320->3280895) 00002000:00010000:0.0:1746140877.549505:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b459f80 00000100:00100000:0.0:1746140877.549514:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573408256 00000100:00100000:0.0:1746140877.549516:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573408256 00002000:00100000:0.0:1746140877.549525:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3280896->4194303) req@ffff88009b45a300 x1830960573408256/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:293/0 lens 488/0 e 0 to 0 dl 1746140888 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140877.549531:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b45a300 with x1830960573408256 ext(3280896->4194303) 00002000:00010000:0.0:1746140877.549534:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b45a300 00000100:00100000:0.0:1746140877.549544:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8260 00000100:00100000:0.0:1746140877.549549:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573407616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140877.549894:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8262 00000100:00100000:0.0:1746140877.549900:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573408128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140877.574097:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573408128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24184us (24811us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140877.574110:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8262 00002000:00100000:0.0:1746140877.574123:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2232320->3280895) req@ffff88009b459f80 x1830960573408128/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:293/0 lens 488/440 e 0 to 0 dl 1746140888 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140877.574132:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b459f80 with x1830960573408128 ext(2232320->3280895) 00002000:00010000:0.0:1746140877.574137:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b459f80 00000100:00100000:0.0:1746140877.588649:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.602531:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.602588:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.624874:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.624933:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.629420:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.637745:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.637855:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.647134:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.647177:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.647200:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.647225:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.654500:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.654539:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.654567:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.654609:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.658365:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.658498:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.658778:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.664502:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.667388:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.671275:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.678052:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.678825:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.681676:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.683691:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.691653:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.701277:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.701462:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.701555:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.703488:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8272 00000100:00100000:0.0:1746140877.703501:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573413632:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140877.718587:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.720185:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1982:x1830960573413632:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 16684us (18624us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140877.720192:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8272 00002000:00100000:0.0:1746140877.720199:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880093e45880 x1830960573413632/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:293/0 lens 488/440 e 0 to 0 dl 1746140888 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140877.720207:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e45880 with x1830960573413632 ext(3145728->4194303) 00002000:00010000:0.0:1746140877.720210:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e45880 00000100:00100000:0.0:1746140877.796571:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.801659:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.802841:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.803545:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.810717:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.815108:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.822536:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.827652:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.836204:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.838243:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573415424 00000100:00100000:0.0:1746140877.838250:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573415424 00000100:00100000:0.0:1746140877.838418:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573415552 00000100:00100000:0.0:1746140877.838421:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573415552 00000100:00100000:0.0:1746140877.850809:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.852734:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.852780:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.853815:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.863968:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.880282:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.884783:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.884832:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.900002:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.902171:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.902872:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.907278:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.918450:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.921665:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.922700:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.943766:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.950878:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.950934:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.972480:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.981883:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140877.981943:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.015042:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.015097:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.017458:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.017526:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.018284:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.018378:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573420416 00000100:00100000:0.0:1746140878.018384:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573420416 00002000:00100000:0.0:1746140878.018415:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3244032->4194303) req@ffff88009ec7e300 x1830960573420416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.018425:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec7e300 with x1830960573420416 ext(3244032->4194303) 00010000:00010000:0.0:1746140878.018434:0:21691:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba9800/0x8156357b7fdb8557 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0610 expref: 16 pid: 4785 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.018448:0:21691:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba9800/0x8156357b7fdb8557 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0610 expref: 16 pid: 4785 timeout: 957 lvb_type: 0 00002000:00010000:0.0:1746140878.018454:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ec7e300 00000100:00100000:0.0:1746140878.018467:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573420672 00000100:00100000:0.0:1746140878.018469:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573420672 00002000:00100000:0.0:1746140878.018478:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009ec7e680 x1830960573420672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.018485:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec7e680 with x1830960573420672 ext(2097152->3145727) 00002000:00010000:0.0:1746140878.018488:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec7e680 00000100:00100000:0.0:1746140878.018495:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573420800 00000100:00100000:0.0:1746140878.018496:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573420800 00002000:00100000:0.0:1746140878.018503:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009ec7ea00 x1830960573420800/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.018509:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec7ea00 with x1830960573420800 ext(3145728->4194303) 00002000:00010000:0.0:1746140878.018512:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec7ea00 00000100:00100000:0.0:1746140878.018525:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1709 00000100:00100000:0.0:1746140878.018530:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1982:x1830960573420416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140878.019694:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8285 00000100:00100000:0.0:1746140878.019701:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573420672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140878.026872:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.029378:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.038872:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573420416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20341us (21416us total) trans 0 rc 950272/950272 00000100:00100000:0.0:1746140878.038884:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1709 00002000:00100000:0.0:1746140878.038890:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3244032->4194303) req@ffff88009ec7e300 x1830960573420416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/440 e 0 to 0 dl 1746140889 ref 1 fl Complete:H/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.038900:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec7e300 with x1830960573420416 ext(3244032->4194303) 00010000:00010000:0.0:1746140878.038908:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba9800/0x8156357b7fdb8557 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0610 expref: 17 pid: 4785 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.038922:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba9800/0x8156357b7fdb8557 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0610 expref: 17 pid: 4785 timeout: 957 lvb_type: 0 00002000:00010000:0.0:1746140878.038928:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ec7e300 00000100:00100000:1.0:1746140878.046353:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16166 00000100:00100000:0.0:1746140878.047449:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.050136:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.056818:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.064847:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.064919:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.065940:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.065989:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573423232 00000100:00100000:1.0:1746140878.065996:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573423232 00000100:00100000:1.0:1746140878.066031:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16167 00000100:00100000:1.0:1746140878.066037:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573423232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140878.066048:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.066065:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b4d200/0x8156357b7fdb85c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0679 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.066116:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575929728:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140878.066668:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00002000:00010000:1.0:1746140878.069543:0:20960:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime: 1746140877 -> 1746140878 00002000:00010000:1.0:1746140878.069551:0:20960:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime: 1746140877 -> 1746140878 00002000:00010000:1.0:1746140878.069553:0:20960:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime: 1746140877 -> 1746140878 00000100:00100000:1.0:1746140878.069577:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575929728:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140878.069607:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b4d200/0x8156357b7fdb85c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0679 expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.069621:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b4d200/0x8156357b7fdb85c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0679 expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.069648:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4d200, rc 0) 00000100:00100000:1.0:1746140878.069689:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573423232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3650us (3748us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140878.069697:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16167 00000100:00100000:0.0:1746140878.082663:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.082778:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573423488 00000100:00100000:1.0:1746140878.082790:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573423488 00002000:00100000:1.0:1746140878.082835:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009ec7ca80 x1830960573423488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.082844:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec7ca80 with x1830960573423488 ext(4194304->4886527) 00002000:00010000:1.0:1746140878.082850:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec7ca80 00000100:00100000:1.0:1746140878.082883:0:21377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8292 00000100:00100000:1.0:1746140878.082891:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573423488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140878.087733:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1983:x1830960573422848:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 22361us (22802us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140878.087746:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8291 00002000:00100000:0.0:1746140878.087757:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8801355be300 x1830960573422848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/440 e 0 to 0 dl 1746140889 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.087768:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355be300 with x1830960573422848 ext(2097152->3145727) 00002000:00010000:0.0:1746140878.087774:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355be300 00000100:00100000:1.0:1746140878.088632:0:21377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573423488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5736us (5972us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140878.088641:0:21377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8292 00002000:00100000:1.0:1746140878.088651:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009ec7ca80 x1830960573423488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/440 e 0 to 0 dl 1746140889 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.088657:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec7ca80 with x1830960573423488 ext(4194304->4886527) 00002000:00010000:1.0:1746140878.088661:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec7ca80 00000100:00100000:0.0:1746140878.098409:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.098479:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573423616 00000100:00100000:1.0:1746140878.098490:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573423616 00000100:00100000:1.0:1746140878.098542:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16168 00000100:00100000:1.0:1746140878.098550:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573423616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140878.098567:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.098584:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x8156357b7fdb85c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0680 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.098630:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575929856:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140878.098723:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140878.101565:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575929856:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140878.101596:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x8156357b7fdb85c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0680 expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.101610:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x8156357b7fdb85c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0680 expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.101641:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5480400, rc 0) 00000100:00100000:1.0:1746140878.101690:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573423616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3140us (3290us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140878.101697:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16168 00000100:00100000:0.0:1746140878.101754:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.105574:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.105631:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573424000 00000100:00100000:1.0:1746140878.105640:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573424000 00000100:00100000:1.0:1746140878.105686:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16169 00000100:00100000:1.0:1746140878.105693:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573424000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140878.105708:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.105722:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb85ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0687 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.105765:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575929984:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140878.106245:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140878.123820:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.129892:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.131461:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.132522:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573424384 00000100:00100000:1.0:1746140878.132529:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573424384 00010000:00010000:1.0:1746140878.132551:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb858f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0648 expref: 15 pid: 12255 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.132578:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8356 00000100:00100000:1.0:1746140878.132583:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573424384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.132592:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.132605:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb858f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0648 expref: 15 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.132614:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb858f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0648 expref: 15 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.132628:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3bb200/0x8156357b7fdb858f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0648 expref: 15 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.132653:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.132654:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.132660:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.132668:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.132692:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.132702:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575930368:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140878.132755:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140878.136491:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575930368:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140878.136521:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.136587:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573424384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4001us (5125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.136597:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8356 00000100:00100000:1.0:1746140878.136715:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.149892:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.155358:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.155485:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573424896 00000100:00100000:1.0:1746140878.155495:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573424896 00010000:00010000:1.0:1746140878.155531:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdb85a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a065d expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.155574:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8357 00000100:00100000:1.0:1746140878.155581:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4908850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1982:x1830960573424896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.155596:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.155619:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdb85a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a065d expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.155630:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdb85a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a065d expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.155652:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdb85a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a065d expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.155685:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.155734:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4908850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573424896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 154us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.155740:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8357 00000100:00100000:0.0:1746140878.164700:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.238761:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.243384:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.248589:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.263635:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.266965:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.269690:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.270458:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.270486:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.270594:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8296 00000100:00100000:1.0:1746140878.270603:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573426432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140878.282884:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573426432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12268us (12412us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140878.282897:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8296 00002000:00100000:1.0:1746140878.282912:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88012d495180 x1830960573426432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/440 e 0 to 0 dl 1746140889 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.282922:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d495180 with x1830960573426432 ext(0->1048575) 00002000:00010000:1.0:1746140878.282929:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d495180 00000100:00100000:0.0:1746140878.283690:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.286447:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.286685:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573426944 00000100:00100000:1.0:1746140878.286691:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573426944 00002000:00100000:1.0:1746140878.286730:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1511424->1515519) req@ffff88013569bb80 x1830960573426944/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.286739:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569bb80 with x1830960573426944 ext(1511424->1515519) 00002000:00010000:1.0:1746140878.286744:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569bb80 00000100:00100000:1.0:1746140878.286844:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8298 00000100:00100000:1.0:1746140878.286851:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573426944:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140878.287121:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573426944:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 270us (681us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140878.287127:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8298 00002000:00100000:1.0:1746140878.287132:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1511424->1515519) req@ffff88013569bb80 x1830960573426944/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/4536 e 0 to 0 dl 1746140889 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.287140:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569bb80 with x1830960573426944 ext(1511424->1515519) 00002000:00010000:1.0:1746140878.287143:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569bb80 00000100:00100000:0.0:1746140878.295202:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.299735:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.299820:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.301796:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573427456 00000100:00100000:1.0:1746140878.301804:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573427456 00002000:00100000:1.0:1746140878.301839:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1511424->2097151) req@ffff8801354bd500 x1830960573427456/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.301849:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd500 with x1830960573427456 ext(1511424->2097151) 00010000:00010000:1.0:1746140878.301856:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f60800/0x8156357b7fdb85f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06aa expref: 18 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.301866:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f60800/0x8156357b7fdb85f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06aa expref: 18 pid: 20960 timeout: 957 lvb_type: 0 00002000:00010000:1.0:1746140878.301871:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801354bd500 00000100:00100000:1.0:1746140878.301892:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1713 00000100:00100000:1.0:1746140878.301898:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1985:x1830960573427456:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140878.306932:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.310931:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.310973:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573427712 00000100:00100000:1.0:1746140878.310983:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573427712 00010000:00010000:1.0:1746140878.311023:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b48600/0x8156357b7fdb85ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0664 expref: 19 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.314486:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8362 00000100:00100000:1.0:1746140878.314498:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573427712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.314513:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.314532:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b48600/0x8156357b7fdb85ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0664 expref: 20 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.314543:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b48600/0x8156357b7fdb85ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0664 expref: 19 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.314565:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b48600/0x8156357b7fdb85ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0664 expref: 19 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.314591:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.314593:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.314600:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 18 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.314608:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 18 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.314638:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 18 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.314649:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575931904:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140878.314704:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140878.316497:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575931904:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140878.316517:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140878.316546:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.316566:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960573427712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2071us (5647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.316576:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8362 00000100:00100000:1.0:1746140878.316597:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573427840 00000100:00100000:1.0:1746140878.316602:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573427840 00010000:00010000:1.0:1746140878.316701:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f60800/0x8156357b7fdb85f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06aa expref: 18 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.316738:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8363 00000100:00100000:1.0:1746140878.316745:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1985:x1830960573427840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.316754:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746140878.316769:0:9847:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140878 -> 1746140879 00002000:00010000:1.0:1746140878.316771:0:9847:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140878 -> 1746140879 00010000:00010000:1.0:1746140878.316777:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f60800/0x8156357b7fdb85f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06aa expref: 18 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.316786:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f60800/0x8156357b7fdb85f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06aa expref: 18 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.316803:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f60800/0x8156357b7fdb85f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06aa expref: 18 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.316815:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.316817:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.316822:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4800/0x8156357b7fdb85f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b1 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.316830:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4800/0x8156357b7fdb85f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b1 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.316888:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4800/0x8156357b7fdb85f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b1 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.316904:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575932032:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140878.317033:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140878.317729:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573428096 00000100:00100000:0.0:1746140878.317734:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573428096 00002000:00100000:0.0:1746140878.317766:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2306048->2310143) req@ffff880093e46a00 x1830960573428096/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.317782:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e46a00 with x1830960573428096 ext(2306048->2310143) 00002000:00010000:0.0:1746140878.317786:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e46a00 00000100:00100000:0.0:1746140878.317801:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8299 00000100:00100000:0.0:1746140878.317807:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1985:x1830960573428096:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140878.317964:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1985:x1830960573428096:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 157us (293us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140878.317971:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8299 00002000:00100000:0.0:1746140878.317976:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2306048->2310143) req@ffff880093e46a00 x1830960573428096/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/4536 e 0 to 0 dl 1746140889 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.317982:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e46a00 with x1830960573428096 ext(2306048->2310143) 00002000:00010000:0.0:1746140878.317985:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e46a00 00000100:00100000:1.0:1746140878.321504:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575932032:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140878.321526:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.321585:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960573427840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4838us (5038us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.321595:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8363 00000100:00100000:0.0:1746140878.324007:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.335611:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.335905:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.336973:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.344775:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.345715:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.354985:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.355186:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573429248 00000100:00100000:1.0:1746140878.355195:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573429248 00002000:00100000:1.0:1746140878.355239:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2310143) req@ffff88012bf13100 x1830960573429248/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.355249:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf13100 with x1830960573429248 ext(2097152->2310143) 00010000:00010000:1.0:1746140878.355258:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 21 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.355274:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 21 pid: 20960 timeout: 957 lvb_type: 0 00002000:00010000:1.0:1746140878.355280:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bf13100 00000100:00100000:1.0:1746140878.355334:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1714 00000100:00100000:1.0:1746140878.355341:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573429248:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140878.359333:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573429248:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3964us (4322us total) trans 21474841211 rc 0/0 00000100:00100000:1.0:1746140878.359348:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1714 00002000:00100000:1.0:1746140878.359359:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2310143) req@ffff88012bf13100 x1830960573429248/t21474841211(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/448 e 0 to 0 dl 1746140889 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.359368:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf13100 with x1830960573429248 ext(2097152->2310143) 00010000:00010000:1.0:1746140878.359377:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 21 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.359391:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 21 pid: 20960 timeout: 957 lvb_type: 0 00002000:00010000:1.0:1746140878.359398:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bf13100 00000100:00100000:0.0:1746140878.363102:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.365539:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573429504 00000100:00100000:1.0:1746140878.365544:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573429504 00010000:00010000:1.0:1746140878.365567:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 21 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.365760:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8364 00000100:00100000:1.0:1746140878.365765:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4908450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573429504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.365812:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746140878.365829:0:9847:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140878 -> 1746140879 00002000:00010000:1.0:1746140878.365831:0:9847:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140878 -> 1746140879 00010000:00010000:1.0:1746140878.365835:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 21 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.365844:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 21 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.365864:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb85ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b8 expref: 21 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.366013:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.366015:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.366022:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.366030:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.366060:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.366070:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575932544:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140878.366134:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140878.366376:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.366445:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573429632 00000100:00100000:1.0:1746140878.366448:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573429632 00002000:00100000:1.0:1746140878.366475:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1544192->2097151) req@ffff8801355bc380 x1830960573429632/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.366484:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bc380 with x1830960573429632 ext(1544192->2097151) 00010000:00010000:1.0:1746140878.366488:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 14 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.366498:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 14 pid: 20960 timeout: 957 lvb_type: 0 00002000:00010000:1.0:1746140878.366505:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801355bc380 00000100:00100000:1.0:1746140878.366529:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1715 00000100:00100000:1.0:1746140878.366535:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573429632:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140878.369755:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575932544:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140878.369781:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.369834:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4908450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573429504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4066us (4358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.369845:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8364 00000100:00100000:0.0:1746140878.374061:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573429632:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7515us (7673us total) trans 17179873944 rc 0/0 00000100:00100000:0.0:1746140878.374072:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1715 00002000:00100000:0.0:1746140878.374085:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1544192->2097151) req@ffff8801355bc380 x1830960573429632/t17179873944(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/448 e 0 to 0 dl 1746140889 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.374100:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bc380 with x1830960573429632 ext(1544192->2097151) 00010000:00010000:0.0:1746140878.374109:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.374125:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00002000:00010000:0.0:1746140878.374132:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801355bc380 00000100:00100000:0.0:1746140878.374749:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.374782:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.374812:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573429888 00000100:00100000:0.0:1746140878.374820:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573429888 00002000:00100000:0.0:1746140878.374850:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88012bf11880 x1830960573429888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.374859:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11880 with x1830960573429888 ext(2097152->3145727) 00002000:00010000:0.0:1746140878.374862:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf11880 00000100:00100000:0.0:1746140878.374879:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573430144 00000100:00100000:0.0:1746140878.374881:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573430144 00002000:00100000:0.0:1746140878.374892:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012bf11500 x1830960573430144/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140878.374902:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11500 with x1830960573430144 ext(3145728->4194303) 00002000:00010000:0.0:1746140878.374904:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf11500 00000100:00100000:0.0:1746140878.374970:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8302 00000100:00100000:0.0:1746140878.374976:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573429888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140878.378753:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.378955:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573430272 00000100:00100000:1.0:1746140878.378963:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573430272 00010000:00010000:1.0:1746140878.378997:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.379094:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8365 00000100:00100000:1.0:1746140878.379101:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1982:x1830960573430272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.379115:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.379137:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.379150:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.379172:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a476e400/0x8156357b7fdb85d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a068e expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.380027:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.380031:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.380040:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2be400/0x8156357b7fdb8622 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06db expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.380049:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2be400/0x8156357b7fdb8622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06db expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.380086:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2be400/0x8156357b7fdb8622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06db expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.380098:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575932672:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140878.380379:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746140878.387596:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575932672:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140878.387617:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.387669:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573430272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8568us (8926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.387678:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8365 00000100:00100000:0.0:1746140878.392859:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.393422:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.404722:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.410425:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.410981:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.411039:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573431296 00000100:00100000:1.0:1746140878.411043:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573431296 00000100:00100000:1.0:1746140878.411077:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16183 00000100:00100000:1.0:1746140878.411082:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32349:x1830960573431296:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140878.411092:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.411109:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a06e9 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.411138:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009368de00/0x8156357b7fdb8573 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a062c expref: 17 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.411145:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008faddc00/0x8156357b7fdb8588 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0641 expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.411150:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.411151:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.411154:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 17 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.411441:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008faddc00/0x8156357b7fdb8588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0641 expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.411454:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008faddc00/0x8156357b7fdb8588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0641 expref: 25 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.411464:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575932800:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140878.411603:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009368de00/0x8156357b7fdb8573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a062c expref: 17 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.411610:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009368de00/0x8156357b7fdb8573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a062c expref: 17 pid: 4785 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.411615:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575932928:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140878.411629:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140878.414923:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.414948:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.414958:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575932800:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140878.414967:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575932928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140878.414992:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 17 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.415006:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f899600, rc 0) 00000100:00100000:1.0:1746140878.415433:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32349:x1830960573431296:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4350us (4451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.415441:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16183 00000100:00100000:1.0:1746140878.415469:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8367 00000100:00100000:1.0:1746140878.415474:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1983:x1830960573431552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.415482:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.415491:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008faddc00/0x8156357b7fdb8588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0641 expref: 26 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.415500:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008faddc00/0x8156357b7fdb8588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0641 expref: 26 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.415513:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008faddc00/0x8156357b7fdb8588 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0641 expref: 26 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.415526:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.415527:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.415534:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 16 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.415542:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 16 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.415570:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 16 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.415582:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575933056:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140878.415745:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140878.417640:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.417811:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575933056:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140878.417831:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.417874:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1983:x1830960573431552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2399us (2923us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.417883:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8367 00000100:00100000:0.0:1746140878.418441:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.422568:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.425391:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.425638:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.425754:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573432320 00000100:00100000:1.0:1746140878.425762:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573432320 00002000:00100000:1.0:1746140878.425803:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f24fb80 x1830960573432320/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.425813:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24fb80 with x1830960573432320 ext(2097152->3145727) 00002000:00010000:1.0:1746140878.425819:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24fb80 00000100:00100000:1.0:1746140878.425833:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573432576 00000100:00100000:1.0:1746140878.425835:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573432576 00002000:00100000:1.0:1746140878.425844:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f24ce00 x1830960573432576/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.425850:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ce00 with x1830960573432576 ext(3145728->4194303) 00002000:00010000:1.0:1746140878.425853:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24ce00 00000100:00100000:1.0:1746140878.425862:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8308 00000100:00100000:1.0:1746140878.425869:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573432320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140878.426552:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.433559:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573432832 00000100:00100000:0.0:1746140878.433569:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573432832 00010000:00010000:0.0:1746140878.433605:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2be400/0x8156357b7fdb8622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06db expref: 25 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:0.0:1746140878.433639:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8369 00000100:00100000:0.0:1746140878.433645:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573432832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140878.433658:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140878.433681:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2be400/0x8156357b7fdb8622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06db expref: 25 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.433693:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2be400/0x8156357b7fdb8622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06db expref: 25 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.433715:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2be400/0x8156357b7fdb8622 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06db expref: 25 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.433745:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.433747:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.433753:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2bee00/0x8156357b7fdb863e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f7 expref: 15 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.433762:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2bee00/0x8156357b7fdb863e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f7 expref: 15 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.433791:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2bee00/0x8156357b7fdb863e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f7 expref: 15 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140878.433803:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b890a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960575933440:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140878.433881:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140878.439128:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b890a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960575933440:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140878.439153:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140878.439210:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1982:x1830960573432832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5563us (5841us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140878.439232:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8369 00000100:00100000:0.0:1746140878.440086:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.440413:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573432320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14543us (15029us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140878.440420:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8308 00002000:00100000:1.0:1746140878.440426:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f24fb80 x1830960573432320/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/440 e 0 to 0 dl 1746140889 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.440434:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24fb80 with x1830960573432320 ext(2097152->3145727) 00002000:00010000:1.0:1746140878.440438:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24fb80 00000100:00100000:0.0:1746140878.444195:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.446668:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.447832:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.447873:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.454784:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.454869:0:21377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573433856 00000100:00100000:1.0:1746140878.454879:0:21377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573433856 00002000:00100000:1.0:1746140878.454915:0:21377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094af5180 x1830960573433856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.454925:0:21377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5180 with x1830960573433856 ext(4194304->4886527) 00002000:00010000:1.0:1746140878.454930:0:21377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5180 00000100:00100000:1.0:1746140878.454959:0:21377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8311 00000100:00100000:1.0:1746140878.454965:0:21377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573433856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140878.458658:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.461974:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.465041:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.465260:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.465451:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16190 00000100:00100000:1.0:1746140878.465536:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:32355:x1830960573434496:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140878.465544:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.465555:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f899e00/0x8156357b7fdb8661 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a071a expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.465572:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4800/0x8156357b7fdb85f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b1 expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.465580:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b464200/0x8156357b7fdb8614 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06cd expref: 22 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.465586:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.465587:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.465590:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f899e00/0x8156357b7fdb8661 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a071a expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.465608:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b464200/0x8156357b7fdb8614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06cd expref: 22 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.465618:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b464200/0x8156357b7fdb8614 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06cd expref: 22 pid: 4785 timeout: 957 lvb_type: 1 00000100:00100000:1.0:1746140878.465626:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575934208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140878.465735:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4800/0x8156357b7fdb85f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b1 expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.465742:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4800/0x8156357b7fdb85f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06b1 expref: 17 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.465750:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575934336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140878.465766:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746140878.467550:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575934208:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140878.467563:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575934336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140878.467586:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f899e00/0x8156357b7fdb8661 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a071a expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.467599:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f899e00, rc 0) 00000100:00100000:1.0:1746140878.467629:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:32355:x1830960573434496:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2172us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.467636:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16190 00000100:00100000:0.0:1746140878.469963:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.470012:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.470465:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.470535:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.470547:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573434880 00000100:00100000:1.0:1746140878.470550:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573434880 00000100:00100000:1.0:1746140878.470571:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16192 00000100:00100000:1.0:1746140878.470576:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573434880:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140878.470583:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.470597:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb866f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0721 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.470633:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575934464:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140878.470672:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746140878.472627:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575934464:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140878.472649:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb866f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0721 expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.472660:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb866f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0721 expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.472685:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f899c00, rc 0) 00000100:00100000:1.0:1746140878.472712:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573434880:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2135us (2176us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140878.472719:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16192 00000100:00100000:0.0:1746140878.474777:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.484580:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140878.484842:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140878.487620:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.487669:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:1.0:1746140878.488518:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140878.490736:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.491243:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140878.491930:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481000/0x8156357b7fdb868b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.491938:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481000/0x8156357b7fdb868b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140878.491982:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140878.491987:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140878.492002:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481000/0x8156357b7fdb868b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492012:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481000/0x8156357b7fdb868b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492020:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb867d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492026:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb867d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492031:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb867d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492035:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5480800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140878.492038:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb867d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492044:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb867d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492051:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140878.492053:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140878.492056:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb867d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492060:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb867d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492083:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492088:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8684 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492093:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492097:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5480e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140878.492099:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492108:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8684 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492114:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e4b5400) 00010000:00010000:0.0:1746140878.492116:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140878.492118:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8684 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492123:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8684 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.492153:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481c00/0x8156357b7fdb8676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a072f expref: 14 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.492164:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481000/0x8156357b7fdb868b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a072f expref: 13 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.492169:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140878.492170:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140878.492172:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481000, rc 0) 00000100:00100000:0.0:1746140878.492196:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+13:32360:x1830960573435392:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 7383us (7628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140878.492202:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10556 00000100:00100000:0.0:1746140878.493753:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.493867:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573436288 00000100:00100000:1.0:1746140878.493874:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573436288 00000100:00100000:1.0:1746140878.495419:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16193 00000100:00100000:1.0:1746140878.495431:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+5:1983:x1830960573436288:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140878.495448:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.495462:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0736 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.495482:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.495484:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.495490:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 6 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.495501:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 6 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.495507:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f898200, rc 0) 00000100:00100000:1.0:1746140878.495555:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573436288:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 128us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.495562:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16193 00000100:00100000:0.0:1746140878.496040:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.496075:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.496115:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.497068:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.497111:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.497174:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573436800 00000100:00100000:1.0:1746140878.497179:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573436800 00000100:00100000:1.0:1746140878.497212:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573436928 00000100:00100000:1.0:1746140878.497215:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573436928 00000100:00100000:1.0:1746140878.497431:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16198 00000100:00100000:1.0:1746140878.497436:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573436928:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140878.497442:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.497450:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f899200/0x8156357b7fdb86b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0759 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.497463:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.497465:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.497471:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f899200/0x8156357b7fdb86b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0759 expref: 10 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.497484:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f899200/0x8156357b7fdb86b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0759 expref: 10 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.497493:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f899200, rc 0) 00000100:00100000:1.0:1746140878.498346:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573436928:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 907us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.498352:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16198 00000100:00100000:0.0:1746140878.502620:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.505735:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.508754:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.511476:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.514044:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.514081:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.514094:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.514107:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.514141:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.514185:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.514589:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573438336 00000100:00100000:0.0:1746140878.514590:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573437952 00000100:00100000:1.0:1746140878.514594:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573438336 00000100:00100000:0.0:1746140878.514595:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573437952 00000100:00100000:0.0:1746140878.514614:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573438208 00000100:00100000:0.0:1746140878.514616:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573438208 00000100:00100000:1.0:1746140878.514621:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16199 00000100:00100000:1.0:1746140878.514628:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573437824:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:0.0:1746140878.514637:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573438464 00000100:00100000:0.0:1746140878.514639:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573438464 00000100:00100000:0.0:1746140878.514652:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16200 00000100:00100000:0.0:1746140878.514658:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573438080:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140878.514668:0:24958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.514680:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e2efc00/0x8156357b7fdb86f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.514691:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec30000/0x8156357b7fdb85ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06a3 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.514692:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb8645 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06fe expref: 24 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.514698:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140878.514700:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 9 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140878.514700:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140878.514703:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2efc00/0x8156357b7fdb86f4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.514707:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b2be200/0x8156357b7fdb8606 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06bf expref: 20 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.514712:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.514714:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.514716:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.514732:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb8645 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06fe expref: 24 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.514733:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b2be200/0x8156357b7fdb8606 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06bf expref: 20 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.514745:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b2be200/0x8156357b7fdb8606 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06bf expref: 20 pid: 20960 timeout: 957 lvb_type: 1 00010000:00010000:0.0:1746140878.514750:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb8645 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06fe expref: 24 pid: 12255 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.514758:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135698380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575935616:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140878.514760:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131c72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960575935488:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140878.514839:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa840 going to sleep for 11 seconds 00010000:00010000:1.0:1746140878.514850:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 9 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.514858:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00000100:00100000:0.0:1746140878.514859:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16201 00000100:00100000:0.0:1746140878.514864:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573437952:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:1.0:1746140878.514871:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575935744:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140878.514881:0:8458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.514891:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 16 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.514897:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec30000/0x8156357b7fdb85ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06a3 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.514897:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140878.514899:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140878.514901:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.514905:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec30000/0x8156357b7fdb85ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06a3 expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.514912:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575935872:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140878.514917:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 16 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.514925:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 16 pid: 12255 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.514928:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140878.514932:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575936000:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140878.514954:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140878.514970:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16202 00000100:00100000:0.0:1746140878.514975:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573438336:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140878.514992:0:4782:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.515001:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.515007:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013569dc00/0x8156357b7fdb86ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0752 expref: 9 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140878.515014:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb8637 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f0 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.515019:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.515020:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.515022:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8702 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.515034:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb8637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f0 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.515040:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb8637 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f0 expref: 20 pid: 12255 timeout: 957 lvb_type: 0 00000100:00100000:0.0:1746140878.515047:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575936128:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140878.515082:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013569dc00/0x8156357b7fdb86ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0752 expref: 9 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140878.515089:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013569dc00/0x8156357b7fdb86ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0752 expref: 9 pid: 8460 timeout: 957 lvb_type: 1 00000100:00100000:0.0:1746140878.515096:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131c72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575936256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140878.515113:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.515119:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:0.0:1746140878.515125:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131c73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575936384:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140878.515136:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3faf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140878.518366:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131c72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960575935488:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140878.518391:0:32377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e2efc00/0x8156357b7fdb86f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140878.518623:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575936000:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140878.518634:0:8458:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140878.518670:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.518699:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.518719:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.518819:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135698380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575935616:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140878.518830:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575935744:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140878.518838:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960575935872:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140878.518855:0:24958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140878.522903:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.522934:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.523003:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.523026:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573439488 00000100:00100000:0.0:1746140878.523033:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573439488 00010000:00010000:0.0:1746140878.523064:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb8637 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f0 expref: 20 pid: 12255 timeout: 957 lvb_type: 0 00000100:00100000:0.0:1746140878.523090:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8378 00000100:00100000:1.0:1746140878.523141:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573439232 00000100:00100000:1.0:1746140878.523153:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573439232 00002000:00100000:1.0:1746140878.523195:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1163263) req@ffff880131c73800 x1830960573439232/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.523203:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131c73800 with x1830960573439232 ext(1048576->1163263) 00010000:00010000:1.0:1746140878.523211:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f899e00/0x8156357b7fdb8661 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a071a expref: 21 pid: 24958 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.523238:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f899e00/0x8156357b7fdb8661 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a071a expref: 21 pid: 24958 timeout: 957 lvb_type: 0 00002000:00010000:1.0:1746140878.523244:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131c73800 00000100:00100000:1.0:1746140878.523267:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573438848 00000100:00100000:1.0:1746140878.523270:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573438848 00002000:00100000:1.0:1746140878.523284:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1699840->2097151) req@ffff880131c73b80 x1830960573438848/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/0 e 0 to 0 dl 1746140889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.523290:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131c73b80 with x1830960573438848 ext(1699840->2097151) 00010000:00010000:1.0:1746140878.523295:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 17 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.523328:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 17 pid: 12255 timeout: 957 lvb_type: 0 00002000:00010000:1.0:1746140878.523334:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131c73b80 00000100:00100000:1.0:1746140878.523348:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1718 00000100:00100000:1.0:1746140878.523355:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573439232:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140878.523546:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1719 00000100:00100000:1.0:1746140878.523551:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573438848:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140878.523798:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573439488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140878.523811:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140878.523833:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb8637 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f0 expref: 22 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.523842:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb8637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f0 expref: 22 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.523861:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdafc00/0x8156357b7fdb8637 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06f0 expref: 22 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.523877:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140878.523907:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573439488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 811us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140878.523914:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8378 00000100:00100000:1.0:1746140878.523971:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.523992:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573438720 00000100:00100000:0.0:1746140878.523995:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573438720 00010000:00010000:0.0:1746140878.524008:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00000100:00100000:0.0:1746140878.524049:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8379 00000100:00100000:1.0:1746140878.524050:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.524057:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573438720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140878.524062:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140878.524069:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140878.524072:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00010000:00010000:0.0:1746140878.524080:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00000100:00100000:1.0:1746140878.524082:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573439360 00000100:00100000:1.0:1746140878.524085:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573439360 00010000:00010000:0.0:1746140878.524091:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f898200/0x8156357b7fdb8692 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0736 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00010000:00010000:1.0:1746140878.524098:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec30000/0x8156357b7fdb85ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06a3 expref: 17 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.524101:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.524111:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573439616 00000100:00100000:1.0:1746140878.524112:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573439616 00000100:00100000:0.0:1746140878.524118:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573438720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 62us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140878.524119:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f899200/0x8156357b7fdb86b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0759 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00000100:00100000:0.0:1746140878.524123:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8379 00000100:00100000:1.0:1746140878.524133:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8380 00000100:00100000:0.0:1746140878.524137:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8381 00000100:00100000:1.0:1746140878.524138:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573439360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140878.524142:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573439616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.524146:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140878.524150:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.524158:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec30000/0x8156357b7fdb85ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06a3 expref: 17 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.524161:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f899200/0x8156357b7fdb86b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0759 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00010000:00010000:1.0:1746140878.524166:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec30000/0x8156357b7fdb85ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06a3 expref: 17 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.524169:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f899200/0x8156357b7fdb86b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0759 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00010000:00010000:0.0:1746140878.524181:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f899200/0x8156357b7fdb86b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0759 expref: 9 pid: 24958 timeout: 957 lvb_type: 1 00010000:00010000:1.0:1746140878.524182:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec30000/0x8156357b7fdb85ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06a3 expref: 17 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.524188:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140878.524194:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.524195:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.524200:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140878.524200:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573439616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140878.524204:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8381 00010000:00010000:1.0:1746140878.524207:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524239:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.524257:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573439360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.524262:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8380 00010000:00010000:1.0:1746140878.524281:0:24958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524288:0:24958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524301:0:24958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524387:0:24958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524393:0:24958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524399:0:24958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f898a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140878.524402:0:24958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524408:0:24958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524420:0:24958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.524426:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f898a00/0x8156357b7fdb86ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.524464:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573437824:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 9838us (10429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.524471:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16199 00000100:00100000:1.0:1746140878.526679:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.526860:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.528601:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573439232:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5244us (5706us total) trans 21474841212 rc 0/0 00000100:00100000:0.0:1746140878.528611:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1718 00002000:00100000:0.0:1746140878.528621:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1163263) req@ffff880131c73800 x1830960573439232/t21474841212(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:294/0 lens 488/448 e 0 to 0 dl 1746140889 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140878.528622:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:0.0:1746140878.528630:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131c73800 with x1830960573439232 ext(1048576->1163263) 00010000:00010000:0.0:1746140878.528638:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f899e00/0x8156357b7fdb8661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a071a expref: 21 pid: 24958 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.528644:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573440000 00010000:00010000:0.0:1746140878.528649:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f899e00/0x8156357b7fdb8661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a071a expref: 21 pid: 24958 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.528651:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573440000 00002000:00010000:0.0:1746140878.528655:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131c73800 00010000:00010000:1.0:1746140878.528678:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.528712:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8383 00000100:00100000:0.0:1746140878.528719:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8384 00000100:00100000:1.0:1746140878.528720:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573439872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140878.528728:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1982:x1830960573440000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.528731:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140878.528736:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140878.528749:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.528750:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008feef400/0x8156357b7fdb8549 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0602 expref: 27 pid: 4785 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.528758:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.528761:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008feef400/0x8156357b7fdb8549 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0602 expref: 27 pid: 4785 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.528771:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd5800/0x8156357b7fdb861b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06d4 expref: 16 pid: 20960 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.528781:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.528782:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.528784:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008feef400/0x8156357b7fdb8549 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0602 expref: 27 pid: 4785 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.528786:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.528794:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8702 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.528797:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.528798:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.528802:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d29400/0x8156357b7fdb8710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.528809:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d29400/0x8156357b7fdb8710 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.528812:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140878.528828:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573440000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140878.528833:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8384 00010000:00010000:1.0:1746140878.528835:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.528863:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573439872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 144us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.528870:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8383 00000100:00100000:0.0:1746140878.530333:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.531915:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.531933:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573440256 00000100:00100000:0.0:1746140878.532054:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573440256 00000100:00100000:1.0:1746140878.532402:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573438848:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8849us (9465us total) trans 17179873947 rc 0/0 00000100:00100000:1.0:1746140878.532410:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1719 00002000:00100000:1.0:1746140878.532418:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1699840->2097151) req@ffff880131c73b80 x1830960573438848/t17179873947(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:294/0 lens 488/448 e 0 to 0 dl 1746140889 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140878.532425:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131c73b80 with x1830960573438848 ext(1699840->2097151) 00010000:00010000:1.0:1746140878.532432:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 18 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.532439:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb8645 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06fe expref: 26 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.532442:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f899600/0x8156357b7fdb8630 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06e9 expref: 18 pid: 12255 timeout: 957 lvb_type: 0 00002000:00010000:1.0:1746140878.532449:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131c73b80 00000100:00100000:0.0:1746140878.532461:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8386 00000100:00100000:0.0:1746140878.532468:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1983:x1830960573440256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140878.532478:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140878.532534:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb8645 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06fe expref: 26 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.532544:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb8645 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06fe expref: 26 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.532557:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943ace00/0x8156357b7fdb8645 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a06fe expref: 26 pid: 12255 timeout: 957 lvb_type: 0 00010000:00010000:0.0:1746140878.532567:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.532570:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.532574:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2efc00/0x8156357b7fdb86f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.532580:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2efc00/0x8156357b7fdb86f4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.532597:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140878.532613:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1983:x1830960573440256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 147us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140878.532619:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8386 00000100:00100000:0.0:1746140878.535796:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140878.537201:0:8458:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.537209:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.537238:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.537244:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.537251:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.537257:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2ee000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140878.537260:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.537267:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.537277:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140878.537287:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee000/0x8156357b7fdb86fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.537699:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960573437952:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 22834us (23589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.537706:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16201 00000100:00100000:0.0:1746140878.540381:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.542567:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.542591:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.542605:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.542658:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.542783:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573440768 00000100:00100000:1.0:1746140878.542788:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573440768 00010000:00010000:1.0:1746140878.542814:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f768c00/0x8156357b7fdb812f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0369 expref: 42 pid: 20524 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.542840:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573441408 00000100:00100000:1.0:1746140878.542843:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573441408 00010000:00010000:1.0:1746140878.542854:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8e00/0x8156357b7fdb7c58 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a00c9 expref: 306 pid: 14743 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.542869:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8388 00000100:00100000:1.0:1746140878.542874:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+42:1984:x1830960573440768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.542881:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.542886:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f768c00/0x8156357b7fdb812f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0369 expref: 42 pid: 20524 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.542895:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f768c00/0x8156357b7fdb812f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0369 expref: 42 pid: 20524 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.542912:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140878.542917:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a691800/0x8156357b7fdb8717 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140878.542924:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.542957:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+42:1984:x1830960573440768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.542962:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8388 00000100:00100000:1.0:1746140878.542976:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8389 00000100:00100000:1.0:1746140878.542980:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+307:1984:x1830960573441408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.542985:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.542989:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8e00/0x8156357b7fdb7c58 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a00c9 expref: 307 pid: 14743 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.542995:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2e8e00/0x8156357b7fdb7c58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a00c9 expref: 307 pid: 14743 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.543005:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140878.543007:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a691800/0x8156357b7fdb8717 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140878.543012:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.543024:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+306:1984:x1830960573441408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 44us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.543028:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8389 00000100:00100000:0.0:1746140878.543144:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.543158:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573441536 00000100:00100000:1.0:1746140878.543161:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573441536 00010000:00010000:1.0:1746140878.543171:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a36c00/0x8156357b7fdb80e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a033f expref: 306 pid: 20524 timeout: 957 lvb_type: 0 00000100:00100000:1.0:1746140878.543193:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8390 00000100:00100000:1.0:1746140878.543197:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+305:1983:x1830960573441536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140878.543203:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140878.543207:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094a36c00/0x8156357b7fdb80e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a033f expref: 305 pid: 20524 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.543214:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094a36c00/0x8156357b7fdb80e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a033f expref: 305 pid: 20524 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.543238:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a36c00/0x8156357b7fdb80e9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a033f expref: 305 pid: 20524 timeout: 957 lvb_type: 0 00010000:00010000:1.0:1746140878.543247:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140878.543251:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a691800/0x8156357b7fdb8717 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140878.543255:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140878.543268:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+304:1983:x1830960573441536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.543273:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8390 00000100:00100000:0.0:1746140878.544400:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.544777:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140878.545173:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a691800/0x8156357b7fdb8717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140878.545180:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a691800/0x8156357b7fdb8717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000040:00080000:0.0:1746140878.545877:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3293, 88 off278432 00000004:00080000:0.0:1746140878.545884:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621578414ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.545936:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3337, 88 off282488 00000004:00080000:0.0:1746140878.545940:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857621635666ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140878.545958:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3338, 88 off282576 00000004:00080000:0.0:1746140878.545961:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857621655786ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140878.545989:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3295, 88 off278616 00000004:00080000:0.0:1746140878.545993:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621687771ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.546001:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3296, 88 off278704 00000004:00080000:0.0:1746140878.546004:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621699183ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.546012:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3339, 88 off282664 00000004:00080000:0.0:1746140878.546015:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857621709926ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140878.546022:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3340, 88 off282752 00000004:00080000:0.0:1746140878.546024:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857621719781ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140878.546032:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3341, 88 off282840 00000004:00080000:0.0:1746140878.546034:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857621729663ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140878.546042:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3297, 88 off278792 00000004:00080000:0.0:1746140878.546045:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621739756ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.546052:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3342, 88 off282928 00000004:00080000:0.0:1746140878.546056:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857621751194ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140878.546064:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3298, 88 off278880 00000004:00080000:0.0:1746140878.546067:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621762176ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.546075:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3343, 88 off283016 00000004:00080000:0.0:1746140878.546078:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857621772741ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140878.546085:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3299, 88 off278968 00000004:00080000:0.0:1746140878.546087:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621782578ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.546095:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3300, 88 off279056 00000004:00080000:0.0:1746140878.546098:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621793066ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.546104:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3301, 88 off279144 00000004:00080000:0.0:1746140878.546107:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621802066ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.546113:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3302, 88 off279232 00000004:00080000:0.0:1746140878.546116:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857621810894ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140878.546123:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3344, 88 off283104 00000004:00080000:0.0:1746140878.546125:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857621820588ns, next at 809142599738ns, rc = 0 00000001:00080000:1.0:1746140878.573249:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944830 is committed 00000004:00080000:1.0:1746140878.573257:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2588 committed 00000004:00080000:1.0:1746140878.573265:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2549 committed 00000004:00080000:1.0:1746140878.573271:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2548 committed 00000004:00080000:1.0:1746140878.573272:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2547 committed 00000004:00080000:1.0:1746140878.573274:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2546 committed 00000004:00080000:1.0:1746140878.573276:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2587 committed 00000004:00080000:1.0:1746140878.573278:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2545 committed 00000004:00080000:1.0:1746140878.573280:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2586 committed 00000004:00080000:1.0:1746140878.573282:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2544 committed 00000004:00080000:1.0:1746140878.573284:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2585 committed 00000004:00080000:1.0:1746140878.573286:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2584 committed 00000004:00080000:1.0:1746140878.573288:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2583 committed 00000004:00080000:1.0:1746140878.573289:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2543 committed 00000004:00080000:1.0:1746140878.573290:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2542 committed 00000004:00080000:1.0:1746140878.573292:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2582 committed 00000004:00080000:1.0:1746140878.573293:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2581 committed 00000004:00080000:1.0:1746140878.573294:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2541 committed 00000001:00080000:1.0:1746140878.573300:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944820 is committed 00000001:00080000:1.0:1746140878.573324:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944772 is committed 00000001:00080000:1.0:1746140878.573330:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944822 is committed 00000001:00080000:1.0:1746140878.573385:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944829 is committed 00000001:00080000:1.0:1746140878.573390:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944828 is committed 00000100:00100000:1.0:1746140878.573746:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575937664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.573791:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.573834:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575938176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.573852:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.573967:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575938688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.573985:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.573995:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575939200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574008:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574021:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746140878.574024:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575938048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574039:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574049:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575938560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574063:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574073:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575939072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574085:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574094:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575939584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574106:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574125:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575937792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574139:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574149:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575938304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574160:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574168:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575938816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574179:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574187:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575939328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574197:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574208:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746140878.574211:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575937920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574238:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574250:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575938432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574263:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574269:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575938944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574281:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574288:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575939456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574301:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.574336:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575938944 00000100:00100000:1.0:1746140878.574339:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575938944 00000100:00100000:1.0:1746140878.574354:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16206 00000100:00100000:1.0:1746140878.574360:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3311:x1830960575938176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140878.574399:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16207 00000100:00100000:0.0:1746140878.574410:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3311:x1830960575938688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574411:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16208 00000100:00100000:1.0:1746140878.574415:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3311:x1830960575939200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574461:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16209 00000100:00100000:1.0:1746140878.574466:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3311:x1830960575938048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574607:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3311:x1830960575938048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (566us total) trans 17179873949 rc 0/0 00000100:00100000:1.0:1746140878.574613:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16209 00000100:00100000:1.0:1746140878.574623:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16212 00000100:00100000:1.0:1746140878.574627:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3311:x1830960575939584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574660:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16213 00000100:00100000:1.0:1746140878.574665:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3312:x1830960575937792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140878.574728:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16214 00000100:00100000:0.0:1746140878.574733:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960575938304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574756:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960575937792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (616us total) trans 17179873950 rc 0/0 00000100:00100000:1.0:1746140878.574762:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16213 00000100:00100000:1.0:1746140878.574771:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16215 00000100:00100000:1.0:1746140878.574775:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960575938816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.574787:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16216 00000100:00100000:1.0:1746140878.574791:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960575939328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140878.574827:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960575938304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (665us total) trans 17179873951 rc 0/0 00000100:00100000:0.0:1746140878.574834:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16214 00000100:00100000:0.0:1746140878.574844:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16218 00000100:00100000:0.0:1746140878.574849:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3312:x1830960575938432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140878.574884:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960575939328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (685us total) trans 21474841214 rc 0/0 00000100:00100000:1.0:1746140878.574889:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16216 00000100:00100000:1.0:1746140878.574899:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16219 00000100:00100000:1.0:1746140878.574905:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3312:x1830960575939456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140878.574923:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3312:x1830960575938432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (659us total) trans 17179873953 rc 0/0 00000100:00100000:0.0:1746140878.574931:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16218 00000100:00100000:0.0:1746140878.575014:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3311:x1830960575939200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 598us (1004us total) trans 21474841215 rc 0/0 00000100:00100000:0.0:1746140878.575018:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16208 00000100:00100000:1.0:1746140878.575019:0:3312:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873926 gen 2 00000004:00080000:1.0:1746140878.575024:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f885880, transno 17179873869 00000004:00080000:1.0:1746140878.575029:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f885180, transno 17179873870 00000004:00080000:1.0:1746140878.575032:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51ad80, transno 17179873871 00000004:00080000:1.0:1746140878.575034:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51a680, transno 17179873872 00000004:00080000:1.0:1746140878.575036:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f518380, transno 17179873873 00000004:00080000:1.0:1746140878.575038:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f886680, transno 17179873874 00000004:00080000:1.0:1746140878.575041:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f885c00, transno 17179873875 00000004:00080000:1.0:1746140878.575043:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f884700, transno 17179873876 00000004:00080000:1.0:1746140878.575046:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b182a00, transno 17179873880 00000004:00080000:1.0:1746140878.575048:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b183b80, transno 17179873881 00000004:00080000:1.0:1746140878.575050:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181880, transno 17179873882 00000004:00080000:1.0:1746140878.575052:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b182d80, transno 17179873883 00000004:00080000:1.0:1746140878.575055:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180700, transno 17179873884 00000004:00080000:1.0:1746140878.575061:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181f80, transno 17179873885 00000004:00080000:1.0:1746140878.575063:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181500, transno 17179873886 00000004:00080000:1.0:1746140878.575066:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180e00, transno 17179873887 00000004:00080000:1.0:1746140878.575068:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f171180, transno 17179873888 00000004:00080000:1.0:1746140878.575071:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f172300, transno 17179873889 00000004:00080000:1.0:1746140878.575073:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f172680, transno 17179873890 00000004:00080000:1.0:1746140878.575075:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f172a00, transno 17179873891 00000004:00080000:1.0:1746140878.575077:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f171500, transno 17179873892 00000004:00080000:1.0:1746140878.575079:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f173b80, transno 17179873893 00000004:00080000:1.0:1746140878.575082:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f173800, transno 17179873894 00000004:00080000:1.0:1746140878.575084:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f170000, transno 17179873895 00000004:00080000:1.0:1746140878.575086:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ced80, transno 17179873911 00000004:00080000:1.0:1746140878.575089:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24c000, transno 17179873912 00000100:00100000:0.0:1746140878.575089:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3311:x1830960575938688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 684us (1103us total) trans 21474841218 rc 0/0 00000004:00080000:1.0:1746140878.575092:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24ed80, transno 17179873913 00000100:00100000:0.0:1746140878.575094:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16207 00000004:00080000:1.0:1746140878.575095:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24e300, transno 17179873914 00000004:00080000:1.0:1746140878.575097:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cdf80, transno 17179873915 00000004:00080000:1.0:1746140878.575099:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba5500, transno 17179873916 00000004:00080000:1.0:1746140878.575101:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24ca80, transno 17179873917 00000004:00080000:1.0:1746140878.575103:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24c380, transno 17179873918 00000004:00080000:1.0:1746140878.575105:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ca80, transno 17179873919 00000004:00080000:1.0:1746140878.575108:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0fb80, transno 17179873920 00000004:00080000:1.0:1746140878.575110:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0d500, transno 17179873921 00000004:00080000:1.0:1746140878.575112:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0c700, transno 17179873922 00000004:00080000:1.0:1746140878.575114:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ed80, transno 17179873923 00000004:00080000:1.0:1746140878.575116:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0f480, transno 17179873924 00000004:00080000:1.0:1746140878.575118:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0dc00, transno 17179873925 00000004:00080000:1.0:1746140878.575120:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0f100, transno 17179873926 00000100:00100000:1.0:1746140878.575126:0:3312:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009f518000 x1830960575937920/t17179873952(17179873952) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746140894 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746140878.575136:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f518000/2, rc 0, transno 17179873952 00000100:00100000:1.0:1746140878.575140:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575937920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140878.575151:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f519c00/2, rc 0, transno 17179873953 00000100:00100000:0.0:1746140878.575153:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3311:x1830960575939584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 525us (1046us total) trans 21474841219 rc 0/0 00000100:00100000:1.0:1746140878.575154:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575938432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140878.575158:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16212 00000100:00100000:1.0:1746140878.575161:0:3312:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841189 gen 2 00000004:00080000:1.0:1746140878.575164:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edca300, transno 21474841136 00000004:00080000:1.0:1746140878.575170:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc9180, transno 21474841137 00000004:00080000:1.0:1746140878.575172:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc8000, transno 21474841138 00000004:00080000:1.0:1746140878.575174:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcad80, transno 21474841139 00000004:00080000:1.0:1746140878.575177:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edcb480, transno 21474841140 00000004:00080000:1.0:1746140878.575179:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc9880, transno 21474841141 00000004:00080000:1.0:1746140878.575181:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc8a80, transno 21474841142 00000004:00080000:1.0:1746140878.575184:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edca680, transno 21474841143 00000004:00080000:1.0:1746140878.575187:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180380, transno 21474841144 00000004:00080000:1.0:1746140878.575189:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180a80, transno 21474841148 00000004:00080000:1.0:1746140878.575192:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181c00, transno 21474841149 00000004:00080000:1.0:1746140878.575194:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b183480, transno 21474841150 00000004:00080000:1.0:1746140878.575197:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b182300, transno 21474841151 00000004:00080000:1.0:1746140878.575199:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181180, transno 21474841152 00000004:00080000:1.0:1746140878.575202:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180000, transno 21474841153 00000004:00080000:1.0:1746140878.575204:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b183800, transno 21474841154 00000004:00080000:1.0:1746140878.575207:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b182680, transno 21474841155 00000004:00080000:1.0:1746140878.575210:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba4700, transno 21474841156 00000004:00080000:1.0:1746140878.575212:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba5880, transno 21474841157 00000004:00080000:1.0:1746140878.575214:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba7480, transno 21474841158 00000004:00080000:1.0:1746140878.575228:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba6d80, transno 21474841159 00000004:00080000:1.0:1746140878.575231:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba4000, transno 21474841160 00000004:00080000:1.0:1746140878.575233:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba6300, transno 21474841161 00000004:00080000:1.0:1746140878.575235:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba4380, transno 21474841162 00000004:00080000:1.0:1746140878.575237:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba5180, transno 21474841163 00000004:00080000:1.0:1746140878.575240:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba6a00, transno 21474841164 00000004:00080000:1.0:1746140878.575242:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bac000, transno 21474841165 00000004:00080000:1.0:1746140878.575244:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baf800, transno 21474841172 00000004:00080000:1.0:1746140878.575247:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bad180, transno 21474841173 00000004:00080000:1.0:1746140878.575249:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baea00, transno 21474841174 00000004:00080000:1.0:1746140878.575251:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6badc00, transno 21474841175 00000004:00080000:1.0:1746140878.575253:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bae680, transno 21474841176 00000004:00080000:1.0:1746140878.575256:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bae300, transno 21474841177 00000004:00080000:1.0:1746140878.575258:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baca80, transno 21474841178 00000004:00080000:1.0:1746140878.575261:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baed80, transno 21474841179 00000004:00080000:1.0:1746140878.575263:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bac700, transno 21474841180 00000004:00080000:1.0:1746140878.575265:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cc380, transno 21474841181 00000004:00080000:1.0:1746140878.575269:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cdc00, transno 21474841182 00000004:00080000:1.0:1746140878.575271:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093130a80, transno 21474841183 00000004:00080000:1.0:1746140878.575273:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cd500, transno 21474841184 00000004:00080000:1.0:1746140878.575276:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093132300, transno 21474841185 00000004:00080000:1.0:1746140878.575278:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093133b80, transno 21474841186 00000004:00080000:1.0:1746140878.575280:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009edc8380, transno 21474841187 00000004:00080000:1.0:1746140878.575282:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f078e00, transno 21474841188 00000004:00080000:1.0:1746140878.575284:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093131880, transno 21474841189 00000100:00100000:1.0:1746140878.575288:0:3312:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012b06b800 x1830960575938944/t21474841217(21474841217) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746140894 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746140878.575295:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b06b800/2, rc 0, transno 21474841217 00000100:00100000:1.0:1746140878.575298:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575938944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140878.575325:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b67480/2, rc 0, transno 17179873950 00000100:00100000:1.0:1746140878.575328:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575937792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140878.575335:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f518700/2, rc 0, transno 17179873951 00000100:00100000:1.0:1746140878.575338:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575938304:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140878.575344:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b068a80/2, rc 0, transno 21474841214 00000100:00100000:1.0:1746140878.575346:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575939328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140878.575614:0:14783:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 6 in flight, 45 done 00000100:00100000:1.0:1746140878.575663:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746140878.575671:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575939712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140878.575693:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140878.576084:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3312:x1830960575938816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1307us (1903us total) trans 21474841220 rc 0/0 00000100:00100000:1.0:1746140878.576089:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16215 00000004:00080000:1.0:1746140878.576299:0:14789:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 3 in flight, 40 done 00000100:00100000:1.0:1746140878.576351:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3312:x1830960575939456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1447us (2049us total) trans 21474841216 rc 0/0 00000100:00100000:1.0:1746140878.576356:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16219 00000004:00080000:1.0:1746140878.576374:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b06b480/2, rc 0, transno 21474841216 00000100:00100000:1.0:1746140878.576377:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575939456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140878.576383:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b06ad80/2, rc 0, transno 21474841220 00000100:00100000:1.0:1746140878.576385:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575938816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140878.576483:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.579276:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.587156:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.587195:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.587234:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.587247:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140878.587265:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.587290:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573442176 00000100:00100000:1.0:1746140878.587298:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573442176 00000100:00100000:0.0:1746140878.587337:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140878.587346:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573442304 00000100:00100000:1.0:1746140878.587348:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573442304 00000100:00100000:0.0:1746140878.587358:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573442432 00000100:00100000:1.0:1746140878.587360:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573442560 00000100:00100000:1.0:1746140878.587361:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573442560 00000100:00100000:0.0:1746140878.587361:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573442432 00000100:00100000:1.0:1746140878.587371:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573442688 00000100:00100000:1.0:1746140878.587373:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573442688 00000100:00100000:0.0:1746140878.587378:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573442816 00000100:00100000:0.0:1746140878.587379:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573442816 00000100:00100000:1.0:1746140878.587387:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16222 00000100:00100000:1.0:1746140878.587393:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573442176:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140878.587406:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.587422:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0783 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140878.587445:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fece, atime: 0x6813fecd, ctime: 0x6813fece, blocks: 0x81f 00010000:00010000:1.0:1746140878.587459:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.587461:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.587470:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.587482:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.587492:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ac5a00, rc 0) 00000100:00100000:0.0:1746140878.587499:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16223 00000100:00100000:1.0:1746140878.587528:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573442176:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 134us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140878.587569:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573442304:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140878.587578:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140878.587588:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d29800/0x8156357b7fdb873a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a078a expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140878.587609:0:8459:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fecf, atime: 0x6813fece, ctime: 0x6813fecf, blocks: 0x81f 00010000:00010000:0.0:1746140878.587619:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.587620:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.587624:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d29800/0x8156357b7fdb873a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a078a expref: 8 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140878.587635:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d29800/0x8156357b7fdb873a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a078a expref: 8 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140878.587641:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d29800, rc 0) 00000100:00100000:1.0:1746140878.587644:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16222 00000100:00100000:0.0:1746140878.587658:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573442304:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 92us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.587660:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16224 00000100:00100000:1.0:1746140878.587665:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573442560:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140878.587672:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140878.587679:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb8741 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0798 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140878.587690:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fecf, atime: 0x6813fece, ctime: 0x6813fecf, blocks: 0x821 00010000:00010000:1.0:1746140878.587697:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.587699:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.587702:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb8741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0798 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.587711:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb8741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0798 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.587717:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ac5400, rc 0) 00000100:00100000:1.0:1746140878.587733:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573442560:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 68us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.587737:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16224 00000100:00100000:0.0:1746140878.587764:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16223 00000100:00100000:0.0:1746140878.587777:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16226 00000100:00100000:0.0:1746140878.587782:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573442688:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140878.587786:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140878.587793:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d29000/0x8156357b7fdb874f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a079f expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140878.587798:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16227 00002000:00010000:0.0:1746140878.587803:0:8459:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fecf, atime: 0x6813fece, ctime: 0x6813fecf, blocks: 0x158f 00000100:00100000:1.0:1746140878.587804:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573442816:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140878.587808:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.587810:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140878.587810:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140878.587813:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d29000/0x8156357b7fdb874f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a079f expref: 8 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140878.587817:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb8756 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a07a6 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140878.587825:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d29000/0x8156357b7fdb874f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a079f expref: 8 pid: 8459 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746140878.587827:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fece, atime: 0x6813fece, ctime: 0x6813fece, blocks: 0x102b 00010000:00010000:0.0:1746140878.587831:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d29000, rc 0) 00010000:00010000:1.0:1746140878.587834:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.587835:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140878.587838:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb8756 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07a6 expref: 9 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140878.587843:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573442688:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 62us (578us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140878.587846:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb8756 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07a6 expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140878.587847:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16226 00010000:00010000:1.0:1746140878.587852:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ac4a00, rc 0) 00000100:00100000:1.0:1746140878.587865:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573442816:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 62us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140878.587870:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16227 00010000:00010000:1.0:1746140878.665528:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746140879.147531:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575939840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746140879.147599:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140879.147902:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575939840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746140879.195559:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575940352:0@lo:400:kworker.0 00000100:00100000:1.0:1746140879.195620:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140879.195681:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746140879.195688:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55f02bfa-093a-4e1f-9a53-4ed2824b373e:3312:1830960575939968:0@lo:400:kworker.0 00000100:00100000:1.0:1746140879.195715:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140879.195746:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1830960575940480:0@lo:400:kworker.0 00000100:00100000:1.0:1746140879.195768:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140879.195792:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575940352 00000100:00100000:1.0:1746140879.195795:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575940352 00000100:00100000:1.0:1746140879.195824:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1746140879.195830:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3312:x1830960575940352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746140879.195875:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3312:x1830960575940352:12345-0@lo:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.195880:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1746140879.195911:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575940352:0@lo:400:kworker.0 00000100:00100000:1.0:1746140879.195926:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1830960575940480:0@lo:400:kworker.0 00000100:00080000:0.0:1746140879.195969:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140879.196102:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55f02bfa-093a-4e1f-9a53-4ed2824b373e:3312:1830960575939968:0@lo:400:kworker.0 00000100:00100000:0.0:1746140879.211579:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575940608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746140879.211650:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.212377:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575940608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746140879.600497:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.600546:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.600579:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.600599:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.600632:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.600646:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.600676:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.600704:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573443200 00000100:00100000:0.0:1746140879.600713:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573443200 00000100:00100000:0.0:1746140879.600770:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573443456 00000100:00100000:0.0:1746140879.600772:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573443456 00000100:00100000:0.0:1746140879.600785:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573443328 00000100:00100000:0.0:1746140879.600787:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573443328 00000100:00100000:0.0:1746140879.600799:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573443712 00000100:00100000:0.0:1746140879.600800:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573443712 00000100:00100000:0.0:1746140879.600815:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573443968 00000100:00100000:0.0:1746140879.600817:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573443968 00000100:00100000:0.0:1746140879.600827:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573443840 00000100:00100000:0.0:1746140879.600828:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573443840 00000100:00100000:0.0:1746140879.600837:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573444352 00000100:00100000:0.0:1746140879.600839:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573444352 00000100:00100000:0.0:1746140879.600852:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8314 00000100:00100000:0.0:1746140879.600859:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573443200:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746140879.600893:0:8464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.600908:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140879.600910:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140879.600915:0:8464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.600929:0:8464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140879.602384:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8315 00000100:00100000:0.0:1746140879.602397:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573443456:12345-192.168.204.16@tcp:3:mirror_io.0 00000100:00100000:1.0:1746140879.602426:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8316 00010000:00010000:0.0:1746140879.602426:0:21694:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8764 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21694 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140879.602435:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573443328:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746140879.602437:0:21694:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140879.602439:0:21694:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140879.602443:0:21694:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21694 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.602452:0:21376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.602458:0:21694:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21694 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.602459:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.602461:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.602463:0:21376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.602472:0:21376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140879.607940:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140879.633516:0:8464:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.633534:0:8464:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.633542:0:8464:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.633548:0:8464:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d28a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140879.633552:0:8464:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.633559:0:8464:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.633580:0:8464:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.633586:0:8464:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d28a00/0x8156357b7fdb875d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140879.633744:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573443200:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 32879us (33250us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140879.633754:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8314 00010000:00010000:0.0:1746140879.635850:0:21688:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131f79600/0x8156357b7fdb8779 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.635865:0:21688:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131f79600/0x8156357b7fdb8779 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.635873:0:21688:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131f79600/0x8156357b7fdb8779 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.635880:0:21688:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131f79600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140879.635884:0:21688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131f79600/0x8156357b7fdb8779 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.635892:0:21688:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131f79600/0x8156357b7fdb8779 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.635911:0:21688:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131f79600/0x8156357b7fdb8779 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.635917:0:21688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f79600/0x8156357b7fdb8779 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140879.636016:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573443968:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 33207us (35375us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140879.636031:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8318 00010000:00010000:1.0:1746140879.644652:0:21376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.644671:0:21376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.644681:0:21376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.644687:0:21376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093beba00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140879.644691:0:21376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.644697:0:21376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.644714:0:21376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.644720:0:21376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093beba00/0x8156357b7fdb876b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140879.644804:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573443328:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 42366us (44218us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140879.644814:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8316 00000100:00100000:0.0:1746140879.674251:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.678032:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.680297:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.709440:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.709504:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.709605:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573445760 00000100:00100000:1.0:1746140879.709615:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573445760 00000100:00100000:1.0:1746140879.709654:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10563 00000100:00100000:1.0:1746140879.709660:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32373:x1830960573445760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140879.709682:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140879.709700:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c200/0x8156357b7fdb8795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a07b4 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.709814:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711539:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711556:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711570:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711576:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711582:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711682:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711690:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711695:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:1.0:1746140879.711702:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140879.711760:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711766:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711775:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711778:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009454d000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140879.711781:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711785:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711792:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140879.711794:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140879.711796:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.711800:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d000/0x8156357b7fdb87aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.713119:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.713128:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.713135:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.713139:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009454ca00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140879.713142:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.713147:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.713159:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5415c00) 00010000:00010000:1.0:1746140879.713161:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140879.713164:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.713169:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454ca00/0x8156357b7fdb87c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.713221:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c200/0x8156357b7fdb8795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.713231:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.713237:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140879.713239:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140879.713241:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009454d400, rc 0) 00000100:00100000:1.0:1746140879.713272:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32373:x1830960573445760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3612us (3843us total) trans 8589944834 rc 0/0 00000100:00100000:1.0:1746140879.713279:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10563 00000100:00100000:0.0:1746140879.718980:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.719022:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.719043:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573446016 00000100:00100000:1.0:1746140879.719053:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573446016 00000100:00100000:0.0:1746140879.719058:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.719074:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.719096:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573447040 00000100:00100000:1.0:1746140879.719099:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573447040 00000100:00100000:1.0:1746140879.719117:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10565 00000100:00100000:1.0:1746140879.719124:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32368:x1830960573446016:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140879.719145:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140879.719162:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009454cc00/0x8156357b7fdb87db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a07bb expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.719265:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.719277:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb872c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a077c expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.719284:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb87b8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ad expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.719289:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.719295:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140879.719344:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.719353:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 8 pid: 14743 timeout: 958 lvb_type: 0 00000100:00100000:1.0:1746140879.719362:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575940736:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140879.719422:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb87b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ad expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.719429:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb87b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ad expref: 269 pid: 14785 timeout: 958 lvb_type: 0 00000100:00100000:1.0:1746140879.719441:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575940864:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140879.719464:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb872c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a077c expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.719470:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb872c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a077c expref: 9 pid: 27790 timeout: 958 lvb_type: 0 00000100:00100000:1.0:1746140879.719477:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575940992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140879.719493:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140879.720409:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.720576:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.720677:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.720755:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.720863:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.720916:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573446400 00000100:00100000:1.0:1746140879.720920:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573446400 00000100:00100000:1.0:1746140879.721028:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573446528 00000100:00100000:1.0:1746140879.721031:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573446528 00000100:00100000:1.0:1746140879.721042:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573446656 00000100:00100000:1.0:1746140879.721043:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573446656 00000100:00100000:1.0:1746140879.721059:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573446784 00000100:00100000:1.0:1746140879.721060:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573446784 00000100:00100000:1.0:1746140879.721072:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16230 00000100:00100000:1.0:1746140879.721077:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573446400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140879.721085:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140879.721095:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a07d0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.721108:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.721110:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.721115:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d0 expref: 28 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.721129:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d0 expref: 28 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.721138:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d29c00, rc 0) 00000100:00100000:1.0:1746140879.721164:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573446400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 87us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.721169:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16230 00000100:00100000:1.0:1746140879.721178:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16231 00000100:00100000:1.0:1746140879.721182:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573446528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140879.721189:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140879.721210:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d28800/0x8156357b7fdb880c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a07d7 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.721220:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.721221:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.721224:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d28800/0x8156357b7fdb880c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d7 expref: 23 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.721233:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d28800/0x8156357b7fdb880c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d7 expref: 23 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.721239:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d28800, rc 0) 00000100:00100000:1.0:1746140879.721253:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573446528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.721258:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16231 00000100:00100000:1.0:1746140879.721268:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16232 00000100:00100000:1.0:1746140879.721272:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573446656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140879.721277:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140879.721282:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8813 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a07de expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.721291:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.721292:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.721295:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07de expref: 23 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.721320:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07de expref: 23 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.721328:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d29400, rc 0) 00000100:00100000:1.0:1746140879.721343:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573446656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 71us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.721348:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16232 00000100:00100000:1.0:1746140879.721358:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16233 00000100:00100000:1.0:1746140879.721362:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573446784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140879.721367:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140879.721373:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d28600/0x8156357b7fdb881a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a07e5 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.721382:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.721383:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.721387:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d28600/0x8156357b7fdb881a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07e5 expref: 28 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.721396:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d28600/0x8156357b7fdb881a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07e5 expref: 28 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.721402:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d28600, rc 0) 00000100:00100000:1.0:1746140879.721416:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573446784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.721420:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16233 00000100:00100000:0.0:1746140879.723390:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.724501:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573447296 00000100:00100000:1.0:1746140879.724506:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573447296 00000100:00100000:1.0:1746140879.724536:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16235 00000100:00100000:1.0:1746140879.724542:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573447296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140879.724551:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140879.724562:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d28e00/0x8156357b7fdb8828 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a07fa expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.724575:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.724577:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140879.724582:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d28e00/0x8156357b7fdb8828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07fa expref: 18 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.724592:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130d28e00/0x8156357b7fdb8828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07fa expref: 18 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140879.724599:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d28e00, rc 0) 00000100:00100000:1.0:1746140879.724621:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573447296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 80us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.724630:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16235 00000100:00100000:0.0:1746140879.724846:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.724861:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.724874:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.724885:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.724929:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575940736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140879.724953:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.724969:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573447936 00000100:00100000:0.0:1746140879.724972:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573447936 00010000:00010000:0.0:1746140879.724993:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 10 pid: 14743 timeout: 958 lvb_type: 0 00000100:00100000:0.0:1746140879.725015:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8393 00000100:00100000:0.0:1746140879.725019:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573447936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140879.725029:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140879.725034:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 10 pid: 14743 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725043:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 10 pid: 14743 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725058:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454d400/0x8156357b7fdb87cd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07b4 expref: 10 pid: 14743 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725072:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140879.725076:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140879.725082:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140879.725086:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140879.725102:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573447936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140879.725107:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8393 00000100:00100000:0.0:1746140879.725151:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc08380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575940864:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140879.725175:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575940992:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140879.725211:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:0.0:1746140879.725237:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.725246:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573448064 00000100:00100000:0.0:1746140879.725248:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573448064 00010000:00010000:0.0:1746140879.725260:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb87b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ad expref: 270 pid: 14785 timeout: 958 lvb_type: 0 00000100:00100000:0.0:1746140879.725274:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8394 00000100:00100000:0.0:1746140879.725278:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1984:x1830960573448064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140879.725284:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140879.725288:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb87b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ad expref: 270 pid: 14785 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725294:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb87b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ad expref: 270 pid: 14785 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725324:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369cd800/0x8156357b7fdb87b8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ad expref: 270 pid: 14785 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725332:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140879.725335:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140879.725339:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140879.725344:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140879.725358:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1984:x1830960573448064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140879.725366:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8394 00000100:00100000:0.0:1746140879.725393:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.725403:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573448192 00000100:00100000:0.0:1746140879.725406:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573448192 00010000:00010000:0.0:1746140879.725416:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb872c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a077c expref: 10 pid: 27790 timeout: 958 lvb_type: 0 00000100:00100000:0.0:1746140879.725429:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8395 00000100:00100000:0.0:1746140879.725433:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573448192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140879.725440:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140879.725443:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb872c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a077c expref: 10 pid: 27790 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725451:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb872c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a077c expref: 10 pid: 27790 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725463:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb872c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a077c expref: 10 pid: 27790 timeout: 958 lvb_type: 0 00010000:00010000:0.0:1746140879.725471:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140879.725473:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140879.725479:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140879.725485:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140879.725494:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140879.725499:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140879.725503:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140879.725518:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140879.725532:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573448192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 98us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140879.725537:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8395 00010000:00010000:0.0:1746140879.725550:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140879.725556:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:0.0:1746140879.725572:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140879.725712:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454cc00/0x8156357b7fdb87db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 270 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.725722:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 269 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.725728:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140879.725730:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140879.725732:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009454c000, rc 0) 00000100:00100000:0.0:1746140879.725753:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32368:x1830960573446016:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6630us (6786us total) trans 8589944835 rc 0/0 00000100:00100000:0.0:1746140879.725759:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10565 00000100:00100000:0.0:1746140879.725820:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.725831:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573448320 00000100:00100000:0.0:1746140879.725834:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573448320 00000100:00100000:0.0:1746140879.725848:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10567 00000100:00100000:0.0:1746140879.725852:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32372:x1830960573448320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140879.725861:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140879.725870:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0bec00/0x8156357b7fdb8836 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a081d expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.725901:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0bec00/0x8156357b7fdb8836 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a081d expref: 270 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.725908:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0bec00/0x8156357b7fdb8836 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a081d expref: 270 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.725922:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140879.725924:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140879.725926:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0bec00, rc 0) 00000100:00100000:0.0:1746140879.725941:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32372:x1830960573448320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 89us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140879.725946:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10567 00000100:00100000:0.0:1746140879.731463:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.736804:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.743747:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.744461:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573448960 00000100:00100000:1.0:1746140879.744467:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.744471:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573448960 00002000:00100000:0.0:1746140879.744515:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc08000 x1830960573448960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140879.744543:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.744563:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.744578:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.744594:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.744607:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.744630:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.744647:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573449472 00000100:00100000:1.0:1746140879.744650:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573449472 00002000:00100000:1.0:1746140879.744668:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009fc09500 x1830960573449472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.744676:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc09500 with x1830960573449472 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.744682:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc09500 00000100:00100000:1.0:1746140879.744698:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573449344 00000100:00100000:1.0:1746140879.744700:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573449344 00002000:00100000:1.0:1746140879.744710:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009fc08a80 x1830960573449344/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.744716:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08a80 with x1830960573449344 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.744719:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc08a80 00000100:00100000:1.0:1746140879.744730:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573449984 00000100:00100000:1.0:1746140879.744733:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573449984 00002000:00100000:1.0:1746140879.744743:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc0ad80 x1830960573449984/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.744750:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0ad80 with x1830960573449984 ext(0->1048575) 00002000:00010000:1.0:1746140879.744754:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc0ad80 00000100:00100000:1.0:1746140879.744763:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573450240 00000100:00100000:1.0:1746140879.744765:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573450240 00002000:00100000:1.0:1746140879.744775:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f51ad80 x1830960573450240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.744781:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51ad80 with x1830960573450240 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.744784:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f51ad80 00000100:00100000:1.0:1746140879.744799:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573450624 00000100:00100000:1.0:1746140879.744801:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573450624 00002000:00100000:1.0:1746140879.744812:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f51a680 x1830960573450624/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.744818:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51a680 with x1830960573450624 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.744820:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f51a680 00000100:00100000:1.0:1746140879.744832:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8323 00000100:00100000:1.0:1746140879.744839:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1983:x1830960573449472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140879.746785:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8328 00000100:00100000:1.0:1746140879.746797:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573450752:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:0.0:1746140879.746895:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08000 with x1830960573448960 ext(1048576->2097151) 00002000:00010000:0.0:1746140879.746900:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc08000 00000100:00100000:0.0:1746140879.746928:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8329 00000100:00100000:0.0:1746140879.746938:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573448960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140879.757782:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.757827:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.757922:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573450880 00000100:00100000:1.0:1746140879.757933:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573450880 00010000:00010000:1.0:1746140879.757972:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb8860 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0824 expref: 10 pid: 14741 timeout: 958 lvb_type: 0 00000100:00100000:1.0:1746140879.758013:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8397 00000100:00100000:1.0:1746140879.758020:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573450880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140879.758033:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140879.758040:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb8860 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0824 expref: 10 pid: 14741 timeout: 958 lvb_type: 0 00010000:00010000:1.0:1746140879.758464:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb8860 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0824 expref: 10 pid: 14741 timeout: 958 lvb_type: 0 00010000:00010000:1.0:1746140879.758505:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013569cc00/0x8156357b7fdb8860 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0824 expref: 10 pid: 14741 timeout: 958 lvb_type: 0 00010000:00010000:1.0:1746140879.758881:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140879.758887:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece400/0x8156357b7fdb886e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140879.758895:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece400/0x8156357b7fdb886e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140879.758901:0:8473:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece400/0x8156357b7fdb886e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140879.758934:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140879.759086:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573450880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1064us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.759094:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8397 00000100:00100000:0.0:1746140879.769802:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1983:x1830960573449472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24961us (25332us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140879.769812:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8323 00002000:00100000:0.0:1746140879.769821:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009fc09500 x1830960573449472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/440 e 0 to 0 dl 1746140890 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140879.769830:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc09500 with x1830960573449472 ext(1048576->2097151) 00002000:00010000:0.0:1746140879.769834:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc09500 00000100:00100000:0.0:1746140879.772012:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.772120:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573451264 00000100:00100000:0.0:1746140879.772127:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573451264 00000100:00100000:0.0:1746140879.772161:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10571 00000100:00100000:0.0:1746140879.772168:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32373:x1830960573451264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140879.772185:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140879.772212:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb887c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0839 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.772265:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb887c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0839 expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.772282:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb887c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0839 expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.772292:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140879.772295:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140879.772299:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60000/0x8156357b7fdb8875 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0832 expref: 272 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.772323:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5480800, rc 0) 00000100:00100000:0.0:1746140879.772360:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32373:x1830960573451264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 192us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140879.772366:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10571 00000100:00100000:0.0:1746140879.778175:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573450624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 31693us (33556us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140879.778187:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8327 00002000:00100000:0.0:1746140879.778209:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f51a680 x1830960573450624/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:295/0 lens 488/440 e 0 to 0 dl 1746140890 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140879.778219:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51a680 with x1830960573450624 ext(1048576->2097151) 00002000:00010000:0.0:1746140879.778224:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f51a680 00000100:00100000:0.0:1746140879.780430:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573448960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 33365us (36567us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140879.780440:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8329 00002000:00100000:0.0:1746140879.780592:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc08000 x1830960573448960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/440 e 0 to 0 dl 1746140890 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140879.780653:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08000 with x1830960573448960 ext(1048576->2097151) 00002000:00010000:0.0:1746140879.780657:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc08000 00000100:00100000:0.0:1746140879.784256:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573450752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 37454us (39617us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140879.784268:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8328 00002000:00100000:0.0:1746140879.784279:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f518380 x1830960573450752/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:295/0 lens 488/440 e 0 to 0 dl 1746140890 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140879.784287:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518380 with x1830960573450752 ext(1048576->2097151) 00002000:00010000:0.0:1746140879.784292:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f518380 00000001:00080000:1.0:1746140879.790866:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944835 is committed 00000001:00080000:1.0:1746140879.790877:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944834 is committed 00000001:00080000:1.0:1746140879.790886:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944832 is committed 00000001:00080000:1.0:1746140879.790892:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944837 is committed 00000004:00080000:1.0:1746140879.790895:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2596 committed 00000004:00080000:1.0:1746140879.790902:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2558 committed 00000004:00080000:1.0:1746140879.790918:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2557 committed 00000004:00080000:1.0:1746140879.790920:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2556 committed 00000004:00080000:1.0:1746140879.790923:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2555 committed 00000004:00080000:1.0:1746140879.790924:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2595 committed 00000004:00080000:1.0:1746140879.790926:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2554 committed 00000004:00080000:1.0:1746140879.790927:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2594 committed 00000004:00080000:1.0:1746140879.790929:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2553 committed 00000004:00080000:1.0:1746140879.790930:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2593 committed 00000004:00080000:1.0:1746140879.790932:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2592 committed 00000004:00080000:1.0:1746140879.790933:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2591 committed 00000004:00080000:1.0:1746140879.790935:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2552 committed 00000004:00080000:1.0:1746140879.790937:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2551 committed 00000004:00080000:1.0:1746140879.790938:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2590 committed 00000004:00080000:1.0:1746140879.790939:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2589 committed 00000004:00080000:1.0:1746140879.791192:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2550 committed 00000001:00080000:1.0:1746140879.791210:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944836 is committed 00000100:00100000:1.0:1746140879.791394:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575941888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140879.791431:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140879.791453:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575942400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140879.791466:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.791604:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575942016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140879.791627:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575941760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140879.791954:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575942912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140879.791975:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.792009:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.792110:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575942272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140879.792125:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.792136:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575942784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.792149:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.792158:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575943296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.792170:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.792190:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575942272 00000100:00100000:0.0:1746140879.792192:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575942272 00000100:00100000:0.0:1746140879.792217:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575942784 00000100:00100000:0.0:1746140879.792219:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575942784 00000100:00100000:0.0:1746140879.792224:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575943296 00000100:00100000:0.0:1746140879.792226:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575943296 00000100:00100000:0.0:1746140879.792233:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16241 00000100:00100000:0.0:1746140879.792238:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3313:x1830960575942400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140879.792521:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3313:x1830960575942400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 282us (1052us total) trans 17179873956 rc 0/0 00000100:00100000:0.0:1746140879.792527:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16241 00000100:00100000:0.0:1746140879.792539:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16243 00000100:00100000:0.0:1746140879.792543:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3312:x1830960575941760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140879.792615:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140879.792617:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140879 -> 1746140879 00002000:00010000:0.0:1746140879.792619:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140879 -> 1746140879 00002000:00010000:0.0:1746140879.792621:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140879 -> 1746140879 00002000:00010000:0.0:1746140879.792622:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140879.792644:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3312:x1830960575941760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (634us total) trans 17179873958 rc 0/0 00000100:00100000:0.0:1746140879.792649:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16243 00000100:00100000:0.0:1746140879.792658:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16244 00000100:00100000:0.0:1746140879.792663:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3311:x1830960575941632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140879.792730:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140879.792732:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140879 -> 1746140879 00002000:00010000:0.0:1746140879.792734:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140878 -> 1746140878 00002000:00010000:0.0:1746140879.792736:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140879 -> 1746140879 00002000:00010000:0.0:1746140879.792737:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140879.792754:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3311:x1830960575941632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (715us total) trans 17179873959 rc 0/0 00000100:00100000:0.0:1746140879.792761:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16244 00000100:00100000:0.0:1746140879.792770:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16245 00000100:00100000:0.0:1746140879.792773:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3312:x1830960575942272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140879.792841:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3312:x1830960575942272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (714us total) trans 17179873960 rc 0/0 00000100:00100000:0.0:1746140879.792845:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16245 00000100:00100000:0.0:1746140879.792855:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16246 00000100:00100000:0.0:1746140879.792858:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3312:x1830960575942784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140879.793078:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575943424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140879.793092:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746140879.793107:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b183b80/2, rc 0, transno 17179873956 00000100:00100000:1.0:1746140879.793110:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575942400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140879.793122:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575942656 00000100:00100000:1.0:1746140879.793124:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575942656 00000100:00100000:0.0:1746140879.794590:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16247 00000100:00100000:0.0:1746140879.794604:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3312:x1830960575943296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.794733:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3312:x1830960575943296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (2561us total) trans 21474841223 rc 0/0 00000100:00100000:0.0:1746140879.795425:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16247 00000004:00080000:0.0:1746140879.796186:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f24ed80/2, rc 0, transno 17179873958 00000100:00100000:0.0:1746140879.796191:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575941760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140879.796208:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b182a00/2, rc 0, transno 17179873960 00000100:00100000:0.0:1746140879.796210:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575942272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140879.796217:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b180380/2, rc 0, transno 21474841223 00000100:00100000:0.0:1746140879.796221:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575943296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.796236:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.796255:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575942528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140879.796276:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.796284:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575943040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.796294:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.796302:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575943552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.796327:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.796336:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746140879.796340:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575943680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.796349:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140879.796360:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575942528 00000100:00100000:0.0:1746140879.796363:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575942528 00000100:00100000:0.0:1746140879.796372:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575943040 00000100:00100000:0.0:1746140879.796373:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575943040 00000100:00100000:0.0:1746140879.796378:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575943552 00000100:00100000:0.0:1746140879.796379:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575943552 00000100:00100000:0.0:1746140879.796384:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575943680 00000100:00100000:0.0:1746140879.796385:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575943680 00000100:00100000:0.0:1746140879.796391:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16253 00000100:00100000:0.0:1746140879.796394:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3310:x1830960575942528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140879.796465:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3310:x1830960575942528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (189us total) trans 17179873963 rc 0/0 00000100:00100000:0.0:1746140879.796995:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16253 00000100:00100000:0.0:1746140879.797007:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16256 00000100:00100000:0.0:1746140879.797011:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960575943680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.797075:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3310:x1830960575943680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (724us total) trans 21474841229 rc 0/0 00000100:00100000:0.0:1746140879.797079:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16256 00000004:00080000:0.0:1746140879.797095:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0ca80/2, rc 0, transno 21474841229 00000100:00100000:0.0:1746140879.797097:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575943680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140879.797103:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f24ca80/2, rc 0, transno 17179873962 00000100:00100000:0.0:1746140879.797106:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575942016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140879.797111:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b181880/2, rc 0, transno 17179873963 00000100:00100000:0.0:1746140879.797112:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575942528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140879.797117:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b181500/2, rc 0, transno 21474841227 00000100:00100000:0.0:1746140879.797118:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575943040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140879.797122:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b181c00/2, rc 0, transno 21474841228 00000100:00100000:0.0:1746140879.797124:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575943552:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140879.797186:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140879.797188:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140879 -> 1746140879 00002000:00010000:0.0:1746140879.797190:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140878 -> 1746140878 00002000:00010000:0.0:1746140879.797191:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140879 -> 1746140879 00002000:00010000:0.0:1746140879.797204:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:1.0:1746140879.797249:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b181f80/2, rc 0, transno 21474841222 00000100:00100000:1.0:1746140879.797253:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575942912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140879.797264:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b180a80/2, rc 0, transno 21474841225 00000100:00100000:1.0:1746140879.797266:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575943424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140879.797384:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573451392 00000100:00100000:1.0:1746140879.797387:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573451392 00000100:00100000:1.0:1746140879.797407:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573451520 00000100:00100000:1.0:1746140879.797409:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573451520 00000100:00100000:0.0:1746140879.797464:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3312:x1830960575942784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4604us (5313us total) trans 21474841230 rc 0/0 00000100:00100000:0.0:1746140879.797468:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16246 00000100:00100000:1.0:1746140879.797513:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4608 00000100:00100000:1.0:1746140879.797519:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32373:x1830960573451520:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:1.0:1746140879.797558:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32373:x1830960573451520:12345-192.168.204.16@tcp:49:cat.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.797564:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4608 00000004:00080000:0.0:1746140879.797600:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b180700/2, rc 0, transno 21474841230 00000100:00100000:0.0:1746140879.797603:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575942784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140879.803302:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.805621:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.805661:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.805678:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.805702:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.805726:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.805747:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573452032 00000100:00100000:0.0:1746140879.805752:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573452032 00010000:00010000:0.0:1746140879.805784:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8813 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07de expref: 25 pid: 4782 timeout: 958 lvb_type: 1 00000100:00100000:0.0:1746140879.805817:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573452160 00000100:00100000:0.0:1746140879.805819:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573452160 00010000:00010000:0.0:1746140879.805829:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013569ce00/0x8156357b7fdb884b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a080f expref: 18 pid: 20960 timeout: 958 lvb_type: 1 00000100:00100000:0.0:1746140879.805840:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573452288 00000100:00100000:0.0:1746140879.805842:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573452288 00010000:00010000:0.0:1746140879.805848:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130d29000/0x8156357b7fdb874f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a079f expref: 8 pid: 8459 timeout: 958 lvb_type: 1 00000100:00100000:0.0:1746140879.805861:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8398 00000100:00100000:0.0:1746140879.805866:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573452032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140879.805876:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140879.805893:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8813 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07de expref: 24 pid: 4782 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.805903:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07de expref: 24 pid: 4782 timeout: 958 lvb_type: 1 00000100:00100000:1.0:1746140879.805946:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573451904 00000100:00100000:1.0:1746140879.805951:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573451904 00002000:00100000:1.0:1746140879.805978:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b45b480 x1830960573451904/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.805987:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b45b480 with x1830960573451904 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.805994:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b45b480 00000100:00100000:1.0:1746140879.806006:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573452544 00000100:00100000:1.0:1746140879.806008:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573452544 00002000:00100000:1.0:1746140879.806019:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b892680 x1830960573452544/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.806024:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892680 with x1830960573452544 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.806027:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b892680 00000100:00100000:1.0:1746140879.806128:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8330 00000100:00100000:1.0:1746140879.806134:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573451904:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:0.0:1746140879.806735:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d29400/0x8156357b7fdb8813 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07de expref: 24 pid: 4782 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.806745:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140879.806747:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140879.806753:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0840 expref: 23 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.806762:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0840 expref: 23 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.806788:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4177920->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0840 expref: 23 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140879.806798:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec7d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575944192:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140879.806847:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140879.810641:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.814224:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573451904:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8077us (8596us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140879.814236:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8330 00002000:00100000:1.0:1746140879.814248:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b45b480 x1830960573451904/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/440 e 0 to 0 dl 1746140890 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.814258:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b45b480 with x1830960573451904 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.814265:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b45b480 00000100:00100000:0.0:1746140879.817377:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.821100:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.821247:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.821270:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.821384:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.821426:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573453312 00000100:00100000:0.0:1746140879.821431:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573453312 00010000:00010000:0.0:1746140879.821454:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d28600/0x8156357b7fdb881a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07e5 expref: 29 pid: 4782 timeout: 958 lvb_type: 1 00000100:00100000:0.0:1746140879.821473:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573453440 00000100:00100000:0.0:1746140879.821475:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573453440 00010000:00010000:0.0:1746140879.821484:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013569dc00/0x8156357b7fdb8852 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0816 expref: 20 pid: 20960 timeout: 958 lvb_type: 1 00000100:00100000:0.0:1746140879.821506:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573453568 00000100:00100000:0.0:1746140879.821507:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573453568 00010000:00010000:0.0:1746140879.821516:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb8756 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07a6 expref: 8 pid: 24958 timeout: 958 lvb_type: 1 00000100:00100000:0.0:1746140879.821527:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8401 00000100:00100000:0.0:1746140879.821532:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573453312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140879.821542:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140879.821560:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d28600/0x8156357b7fdb881a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07e5 expref: 30 pid: 4782 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821569:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d28600/0x8156357b7fdb881a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07e5 expref: 30 pid: 4782 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821587:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d28600/0x8156357b7fdb881a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07e5 expref: 30 pid: 4782 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821598:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140879.821614:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573453312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140879.821618:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8401 00000100:00100000:0.0:1746140879.821629:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8402 00000100:00100000:0.0:1746140879.821633:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573453440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140879.821637:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140879.821643:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013569dc00/0x8156357b7fdb8852 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0816 expref: 20 pid: 20960 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821649:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013569dc00/0x8156357b7fdb8852 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0816 expref: 20 pid: 20960 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821659:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013569dc00/0x8156357b7fdb8852 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0816 expref: 20 pid: 20960 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821666:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140879.821676:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573453440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 43us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140879.821680:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8402 00000100:00100000:0.0:1746140879.821687:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8403 00000100:00100000:0.0:1746140879.821690:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573453568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140879.821695:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140879.821699:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb8756 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07a6 expref: 8 pid: 24958 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821706:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb8756 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07a6 expref: 8 pid: 24958 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821715:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb8756 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07a6 expref: 8 pid: 24958 timeout: 958 lvb_type: 1 00010000:00010000:0.0:1746140879.821721:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140879.821722:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140879.821727:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec31000/0x8156357b7fdb888a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0847 expref: 28 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.821734:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec31000/0x8156357b7fdb888a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0847 expref: 28 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140879.821757:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ec31000/0x8156357b7fdb888a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0847 expref: 28 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140879.821767:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575944704:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140879.821806:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140879.825073:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.825134:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573453824 00000100:00100000:1.0:1746140879.825143:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573453824 00002000:00100000:1.0:1746140879.825181:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880093348700 x1830960573453824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.825190:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093348700 with x1830960573453824 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.825208:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093348700 00000100:00100000:1.0:1746140879.825242:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8334 00000100:00100000:1.0:1746140879.825250:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573453824:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140879.828016:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.828053:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.831745:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573453824:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6491us (6675us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140879.831754:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8334 00002000:00100000:1.0:1746140879.831761:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880093348700 x1830960573453824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/440 e 0 to 0 dl 1746140890 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.831769:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093348700 with x1830960573453824 ext(1048576->2097151) 00002000:00010000:1.0:1746140879.831774:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093348700 00000100:00100000:0.0:1746140879.843855:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.843884:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.843909:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.843940:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.844023:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573454592 00000100:00100000:1.0:1746140879.844028:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573454592 00002000:00100000:1.0:1746140879.844046:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009334b480 x1830960573454592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.844054:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009334b480 with x1830960573454592 ext(2097152->3145727) 00002000:00010000:1.0:1746140879.844057:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009334b480 00000100:00100000:1.0:1746140879.844068:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573455104 00000100:00100000:1.0:1746140879.844070:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573455104 00002000:00100000:1.0:1746140879.844080:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009334b100 x1830960573455104/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:295/0 lens 488/0 e 0 to 0 dl 1746140890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140879.844087:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009334b100 with x1830960573455104 ext(2097152->3145727) 00002000:00010000:1.0:1746140879.844089:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009334b100 00000100:00100000:1.0:1746140879.844106:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8338 00000100:00100000:1.0:1746140879.844112:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009334b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573454592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140879.844144:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8340 00000100:00100000:0.0:1746140879.844151:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009334b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573455104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140879.848604:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.878126:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.878161:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.878228:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.878249:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573455872 00000100:00100000:1.0:1746140879.878254:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573455872 00000100:00100000:0.0:1746140879.886879:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.889933:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573456512 00000100:00100000:1.0:1746140879.889940:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573456512 00000100:00100000:1.0:1746140879.889974:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16262 00000100:00100000:1.0:1746140879.889980:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:32372:x1830960573456512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140879.889991:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140879.890004:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a690e00/0x8156357b7fdb88a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0863 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.890022:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140879.890024:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140879.890027:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a690e00/0x8156357b7fdb88a6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4882432->5242879] (req 4882432->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0863 expref: 24 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.890040:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a690e00/0x8156357b7fdb88a6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4882432->5242879] (req 4882432->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0863 expref: 24 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140879.890050:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a690e00, rc 0) 00000100:00100000:1.0:1746140879.890069:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:32372:x1830960573456512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140879.890073:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16262 00000100:00100000:0.0:1746140879.893945:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.895139:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.895985:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.900148:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.900189:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.905439:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.905700:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.908165:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140879.909618:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.911449:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.913404:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.916126:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.929001:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.931684:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.931727:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.932391:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.933373:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.942947:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.953057:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.958203:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.960452:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.965521:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140879.982476:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.031106:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.035681:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.036711:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.036748:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.048294:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.078025:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.080073:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.086838:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.093765:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.093804:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.093949:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8411 00000100:00100000:1.0:1746140880.093958:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1983:x1830960573462912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.093967:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.093980:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130d28800/0x8156357b7fdb880c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d7 expref: 28 pid: 4782 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.094002:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130d28800/0x8156357b7fdb880c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d7 expref: 28 pid: 4782 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.094173:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130d28800/0x8156357b7fdb880c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d7 expref: 28 pid: 4782 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.094222:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.094258:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573462912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 301us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.094266:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8411 00000100:00080000:1.0:1746140880.094300:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140880.097906:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.100636:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.107246:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.107575:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573463424 00000100:00100000:1.0:1746140880.107582:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573463424 00002000:00100000:1.0:1746140880.107616:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2605056->3145727) req@ffff880093132a00 x1830960573463424/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.107624:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093132a00 with x1830960573463424 ext(2605056->3145727) 00010000:00010000:1.0:1746140880.107631:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb88ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a086a expref: 20 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.107647:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb88ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a086a expref: 20 pid: 32377 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.107652:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093132a00 00000100:00100000:1.0:1746140880.107667:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1724 00000100:00100000:1.0:1746140880.107673:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573463424:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140880.108259:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.114635:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573463680 00000100:00100000:1.0:1746140880.114642:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573463680 00000100:00100000:1.0:1746140880.114700:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10574 00000100:00100000:1.0:1746140880.114708:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:32386:x1830960573463680:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140880.114732:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.114751:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481200/0x8156357b7fdb8939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a08be expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.114806:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d28800/0x8156357b7fdb8940 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.114818:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d28800/0x8156357b7fdb8940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.114828:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d28800/0x8156357b7fdb8940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.114841:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb8947 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.114846:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb8947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.114852:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb8947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.114953:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2600/0x8156357b7fdb894e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.114962:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 273 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.114967:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ec expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.114973:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2600/0x8156357b7fdb894e lrc: 5/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.115003:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ec expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.115012:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ec expref: 8 pid: 14741 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.115027:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575947520:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140880.115103:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 273 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.115111:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 273 pid: 14743 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.115118:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575947648:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.115149:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.115863:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.117444:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.119737:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.120020:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573463424:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12346us (12778us total) trans 17179873965 rc 0/0 00000100:00100000:1.0:1746140880.120028:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1724 00002000:00100000:1.0:1746140880.120036:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2605056->3145727) req@ffff880093132a00 x1830960573463424/t17179873965(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/448 e 0 to 0 dl 1746140891 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.120044:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093132a00 with x1830960573463424 ext(2605056->3145727) 00010000:00010000:1.0:1746140880.120051:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb88ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a086a expref: 22 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.120060:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb88ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a086a expref: 22 pid: 32377 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.120066:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093132a00 00000100:00100000:1.0:1746140880.122658:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.122688:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.122705:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573464448 00000100:00100000:1.0:1746140880.122708:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573464576 00000100:00100000:1.0:1746140880.122711:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573464576 00000100:00100000:0.0:1746140880.122711:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573464448 00010000:00010000:1.0:1746140880.122740:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 274 pid: 14743 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.122762:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8414 00000100:00100000:0.0:1746140880.122762:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4612 00000100:00100000:1.0:1746140880.122767:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:1984:x1830960573464576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140880.122768:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:7722:x1830960573464448:12345-192.168.204.16@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746140880.122781:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.122787:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 274 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.122798:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 274 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.122824:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454c000/0x8156357b7fdb87e9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07bb expref: 274 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.122842:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140880.122847:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2600/0x8156357b7fdb894e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.122858:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2600/0x8156357b7fdb894e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.122862:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2600/0x8156357b7fdb894e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.122866:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.122900:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:1984:x1830960573464576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.122909:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8414 00000100:00100000:0.0:1746140880.124005:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:7722:x1830960573464448:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 1235us (1356us total) trans 8589944844 rc 0/0 00000100:00100000:0.0:1746140880.124012:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4612 00000100:00100000:0.0:1746140880.124361:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16274 00000100:00100000:0.0:1746140880.124368:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573464704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140880.124375:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140880.124384:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb897f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a08cc expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.124412:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575948032:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140880.124434:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3facc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140880.124449:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.125513:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.125565:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573465216 00000100:00100000:1.0:1746140880.125569:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573465216 00010000:00010000:1.0:1746140880.125586:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ec expref: 12 pid: 14741 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.125602:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8416 00000100:00100000:1.0:1746140880.125606:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960573465216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.125614:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.125618:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ec expref: 12 pid: 14741 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.125626:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ec expref: 12 pid: 14741 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.125640:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013569d400/0x8156357b7fdb87fe lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07ec expref: 12 pid: 14741 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.125652:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140880.125657:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2600/0x8156357b7fdb894e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.125793:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2600/0x8156357b7fdb894e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.125799:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2600/0x8156357b7fdb894e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140880.125816:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.125836:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1982:x1830960573465216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 229us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.125841:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8416 00002000:00010000:1.0:1746140880.126346:0:8458:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140879 -> 1746140880 00002000:00010000:1.0:1746140880.126349:0:8458:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140878 -> 1746140880 00002000:00010000:1.0:1746140880.126350:0:8458:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140879 -> 1746140880 00000100:00100000:1.0:1746140880.126359:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575948032:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140880.126371:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb897f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08cc expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.126378:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb897f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08cc expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.126385:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5216600, rc 0) 00000100:00100000:1.0:1746140880.126411:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573464704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2044us (2268us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140880.126415:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16274 00000100:00100000:0.0:1746140880.130029:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec80e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575948288:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140880.130052:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140880.130091:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573465088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4648us (5641us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.130100:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8415 00000100:00100000:0.0:1746140880.131526:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573465344 00000100:00100000:0.0:1746140880.131534:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573465344 00000100:00100000:0.0:1746140880.131563:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573465600 00000100:00100000:0.0:1746140880.131566:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573465600 00000100:00100000:0.0:1746140880.131576:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573465728 00000100:00100000:0.0:1746140880.131577:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573465728 00000100:00100000:0.0:1746140880.131586:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573465856 00000100:00100000:0.0:1746140880.131587:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573465856 00000100:00100000:0.0:1746140880.131595:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573465472 00000100:00100000:0.0:1746140880.131596:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573465472 00000100:00100000:0.0:1746140880.131606:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16276 00000100:00100000:0.0:1746140880.131612:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573465344:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140880.131627:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140880.131641:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb898d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a08e1 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.131684:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575948416:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140880.131732:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.131746:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16277 00000100:00100000:0.0:1746140880.131751:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573465600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140880.131756:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140880.131760:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009454d000/0x8156357b7fdb8994 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a08ef expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.131776:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f171500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575948544:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140880.131789:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.131799:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16278 00000100:00100000:0.0:1746140880.131803:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573465728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140880.131808:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140880.131812:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009454da00/0x8156357b7fdb899b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a08f6 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.131826:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f173b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575948672:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140880.131838:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa180 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.134776:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.134886:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.134974:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573466240 00000100:00100000:1.0:1746140880.134983:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573466240 00002000:00100000:1.0:1746140880.135023:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2990080->2994175) req@ffff88009f170000 x1830960573466240/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.135032:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170000 with x1830960573466240 ext(2990080->2994175) 00002000:00010000:1.0:1746140880.135038:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f170000 00000100:00100000:1.0:1746140880.135708:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8353 00000100:00100000:1.0:1746140880.135716:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573466240:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140880.136255:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573466240:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 539us (1367us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140880.136262:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8353 00002000:00100000:1.0:1746140880.136270:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2990080->2994175) req@ffff88009f170000 x1830960573466240/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.136277:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170000 with x1830960573466240 ext(2990080->2994175) 00002000:00010000:1.0:1746140880.136281:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f170000 00000100:00100000:1.0:1746140880.137354:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575948416:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140880.137382:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb898d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08e1 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.137393:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5400/0x8156357b7fdb898d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08e1 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.137408:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ac5400, rc 0) 00000100:00100000:1.0:1746140880.137430:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573465344:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5818us (7430us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140880.137436:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16276 00000100:00100000:0.0:1746140880.137793:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f171500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575948544:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140880.137809:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009454d000/0x8156357b7fdb8994 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08ef expref: 21 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.137819:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009454d000/0x8156357b7fdb8994 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08ef expref: 21 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.137839:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009454d000, rc 0) 00000100:00100000:0.0:1746140880.137856:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573465600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6104us (7793us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140880.137861:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16277 00000100:00100000:1.0:1746140880.137867:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573466624 00000100:00100000:1.0:1746140880.137872:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573466624 00002000:00100000:1.0:1746140880.137901:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880093e44380 x1830960573466624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.137908:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e44380 with x1830960573466624 ext(2097152->3145727) 00002000:00010000:1.0:1746140880.137911:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e44380 00000100:00100000:0.0:1746140880.138214:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8354 00000100:00100000:0.0:1746140880.138221:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573466752:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140880.148513:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573467264 00000100:00100000:0.0:1746140880.148518:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573467264 00000100:00100000:0.0:1746140880.148547:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4613 00000100:00100000:0.0:1746140880.148552:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:32377:x1830960573467264:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746140880.148706:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32377:x1830960573467264:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 152us (1478us total) trans 8589944845 rc 0/0 00000100:00100000:0.0:1746140880.148716:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4613 00000100:00100000:0.0:1746140880.157498:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.158046:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573466752:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 19824us (20210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.158057:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8354 00002000:00100000:1.0:1746140880.158066:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8801354bc700 x1830960573466752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.158075:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bc700 with x1830960573466752 ext(3145728->4194303) 00002000:00010000:1.0:1746140880.158079:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bc700 00000100:00100000:0.0:1746140880.165505:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.168045:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.168737:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140880.168955:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.168961:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:0.0:1746140880.168975:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140880.169061:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169068:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169081:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169086:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b5ece00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140880.169496:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169509:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169518:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140880.169520:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140880.169524:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169535:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ece00/0x8156357b7fdb89f6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169557:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eca00/0x8156357b7fdb89e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169562:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eca00/0x8156357b7fdb89e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169567:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eca00/0x8156357b7fdb89e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169570:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b5eca00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140880.169572:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eca00/0x8156357b7fdb89e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169580:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eca00/0x8156357b7fdb89e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169586:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140880.169588:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140880.169591:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eca00/0x8156357b7fdb89e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169595:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eca00/0x8156357b7fdb89e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169602:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ecc00/0x8156357b7fdb89ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169606:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ecc00/0x8156357b7fdb89ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169615:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ecc00/0x8156357b7fdb89ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169620:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b5ecc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140880.169622:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ecc00/0x8156357b7fdb89ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169625:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ecc00/0x8156357b7fdb89ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169630:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009a11c900) 00010000:00010000:0.0:1746140880.169631:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140880.169633:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ecc00/0x8156357b7fdb89ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169637:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ecc00/0x8156357b7fdb89ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.169688:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ec800/0x8156357b7fdb89e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0919 expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.169694:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ec800/0x8156357b7fdb89e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0919 expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.169701:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ec800, rc 0) 00000100:00100000:0.0:1746140880.169721:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32388:x1830960573468416:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4136us (4216us total) trans 8589944848 rc 301/301 00000100:00100000:0.0:1746140880.169726:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10578 00000100:00100000:0.0:1746140880.170242:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.171707:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.171739:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.171754:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.171771:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573469184 00000100:00100000:0.0:1746140880.171776:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573469184 00000100:00100000:0.0:1746140880.172976:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573469440 00000100:00100000:0.0:1746140880.172984:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573469440 00000100:00100000:0.0:1746140880.173171:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16283 00000100:00100000:0.0:1746140880.173177:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573469440:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140880.173207:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.173218:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 26 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.173223:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140880.173224:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140880.173226:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.173241:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 26 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.173248:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 26 pid: 32377 timeout: 959 lvb_type: 0 00000100:00100000:0.0:1746140880.173257:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f171500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575949312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.173413:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16284 00000100:00100000:1.0:1746140880.173421:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573469056:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140880.173438:0:4186:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f977400/0x8156357b7fdb8a19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.173448:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 7 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.173455:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013569c600/0x8156357b7fdb8821 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07f3 expref: 17 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.173462:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013569c800/0x8156357b7fdb87e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07c2 expref: 26 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.173467:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.173469:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.173471:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f977400/0x8156357b7fdb8a19 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.173495:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013569c800/0x8156357b7fdb87e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07c2 expref: 26 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.173502:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013569c800/0x8156357b7fdb87e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07c2 expref: 26 pid: 9872 timeout: 959 lvb_type: 1 00000100:00100000:1.0:1746140880.173509:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575949440:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140880.173970:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.174007:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.174025:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573469312 00000100:00100000:0.0:1746140880.174028:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573469312 00000100:00100000:0.0:1746140880.174047:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16285 00000100:00100000:0.0:1746140880.174052:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573469312:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140880.174070:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.174081:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f79c00/0x8156357b7fdb8748 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0791 expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.174087:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013569de00/0x8156357b7fdb883d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0801 expref: 21 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.174093:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d0 expref: 29 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.174098:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.174099:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.174101:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.174116:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d0 expref: 29 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.174123:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d0 expref: 29 pid: 4782 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.174130:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f885880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575949824:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140880.174153:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013569de00/0x8156357b7fdb883d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0801 expref: 21 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.174160:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013569de00/0x8156357b7fdb883d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0801 expref: 21 pid: 20960 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.174167:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575949952:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140880.174185:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f79c00/0x8156357b7fdb8748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0791 expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.174202:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f79c00/0x8156357b7fdb8748 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0791 expref: 9 pid: 4784 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.174208:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575950080:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140880.174219:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fae40 going to sleep for 11 seconds 00010000:00010000:1.0:1746140880.174415:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013569c600/0x8156357b7fdb8821 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07f3 expref: 17 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.174423:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013569c600/0x8156357b7fdb8821 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07f3 expref: 17 pid: 9872 timeout: 959 lvb_type: 1 00000100:00100000:1.0:1746140880.174431:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575950208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140880.174455:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 7 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.174461:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 7 pid: 24958 timeout: 959 lvb_type: 1 00000100:00100000:1.0:1746140880.174468:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575950336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.174481:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.176352:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.178757:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.178835:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f171500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575949312:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140880.178855:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.180237:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575949440:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.180247:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575950208:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.180254:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575950336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140880.180269:0:4186:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f977400/0x8156357b7fdb8a19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.180286:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573469952 00000100:00100000:1.0:1746140880.180289:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573469952 00002000:00100000:1.0:1746140880.180328:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (2084864->2097151) req@ffff88009f884700 x1830960573469952/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 12776/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.180335:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f884700 with x1830960573469952 ext(2084864->2097151) 00010000:00010000:1.0:1746140880.180341:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 27 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.180349:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 27 pid: 32377 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.180354:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f884700 00000100:00100000:1.0:1746140880.180367:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1725 00000100:00100000:1.0:1746140880.180372:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573469952:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140880.180669:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f885880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575949824:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140880.180677:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575949952:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140880.180684:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575950080:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140880.180699:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.181044:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1982:x1830960573469952:12345-192.168.204.16@tcp:4:cat.0 Request processed in 671us (2293us total) trans 21474841233 rc 0/0 00000100:00100000:1.0:1746140880.181051:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1725 00002000:00100000:1.0:1746140880.181058:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (2084864->2097151) req@ffff88009f884700 x1830960573469952/t21474841233(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 12776/448 e 0 to 0 dl 1746140891 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.181065:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f884700 with x1830960573469952 ext(2084864->2097151) 00010000:00010000:1.0:1746140880.181071:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 29 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.181079:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 29 pid: 32377 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.181085:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f884700 00000100:00100000:0.0:1746140880.186244:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.186280:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.186329:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.186345:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.186359:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573470592 00000100:00100000:0.0:1746140880.186362:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573470592 00010000:00010000:0.0:1746140880.186377:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131f79c00/0x8156357b7fdb8748 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0791 expref: 12 pid: 4784 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.186401:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573470336 00000100:00100000:0.0:1746140880.186539:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573470336 00010000:00010000:0.0:1746140880.186553:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013569de00/0x8156357b7fdb883d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0801 expref: 22 pid: 20960 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.186756:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8419 00000100:00100000:1.0:1746140880.186763:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8420 00000100:00100000:0.0:1746140880.186764:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573470592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140880.186771:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573470080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.186778:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140880.186778:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140880.186801:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131f79c00/0x8156357b7fdb8748 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0791 expref: 12 pid: 4784 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.186802:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d29800/0x8156357b7fdb873a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a078a expref: 12 pid: 8459 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.186812:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d29800/0x8156357b7fdb873a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a078a expref: 12 pid: 8459 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.186812:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131f79c00/0x8156357b7fdb8748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0791 expref: 12 pid: 4784 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.186837:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d29800/0x8156357b7fdb873a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a078a expref: 12 pid: 8459 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.186858:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.186897:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573470080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 127us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.186904:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8420 00010000:00010000:0.0:1746140880.187263:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f79c00/0x8156357b7fdb8748 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0791 expref: 10 pid: 4784 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.187370:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140880.187388:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573470592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 624us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.187394:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8419 00000100:00100000:0.0:1746140880.187557:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.187579:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.187601:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.187612:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573471104 00000100:00100000:0.0:1746140880.187615:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573471104 00010000:00010000:0.0:1746140880.187626:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092995600/0x8156357b7fdb89a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08fd expref: 21 pid: 24958 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.187638:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573471232 00000100:00100000:0.0:1746140880.187640:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573471232 00000100:00100000:1.0:1746140880.187646:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573471360 00000100:00100000:1.0:1746140880.187648:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573471360 00010000:00010000:0.0:1746140880.187648:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 28 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.187658:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef800/0x8156357b7fdb89b0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0904 expref: 9 pid: 32377 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.187659:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8423 00000100:00100000:0.0:1746140880.187663:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f886d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573471104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140880.187669:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140880.187675:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8424 00010000:00010000:0.0:1746140880.187678:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092995600/0x8156357b7fdb89a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08fd expref: 21 pid: 24958 timeout: 959 lvb_type: 1 00000100:00100000:1.0:1746140880.187679:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573471232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.187684:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140880.187686:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092995600/0x8156357b7fdb89a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08fd expref: 21 pid: 24958 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.187693:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 28 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.187700:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 28 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:0.0:1746140880.187700:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140880.187711:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547d800/0x8156357b7fdb8924 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08a9 expref: 28 pid: 32377 timeout: 959 lvb_type: 0 00000100:00100000:0.0:1746140880.187716:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f886d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573471104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140880.187719:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140880.187720:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8423 00010000:00010000:1.0:1746140880.187721:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.187725:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.187729:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8425 00000100:00100000:0.0:1746140880.187732:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573471360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.187734:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187738:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140880.187743:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef800/0x8156357b7fdb89b0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0904 expref: 9 pid: 32377 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.187750:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef800/0x8156357b7fdb89b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0904 expref: 9 pid: 32377 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.187753:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140880.187758:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.187766:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573471232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.187766:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573471360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 33us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.187770:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8425 00000100:00100000:1.0:1746140880.187773:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8424 00010000:00010000:0.0:1746140880.187787:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187794:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187813:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187825:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187832:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187837:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5480e00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140880.187841:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187847:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187856:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.187857:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.187862:0:4785:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b67600/0x8156357b7fdb8a35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0927 expref: 18 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187869:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b67600/0x8156357b7fdb8a35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0927 expref: 18 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.187895:0:4785:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093b67600/0x8156357b7fdb8a35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0927 expref: 18 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.187908:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f886300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575950976:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140880.188552:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.188621:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.188651:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.188666:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573470720 00000100:00100000:1.0:1746140880.188669:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573470720 00000100:00100000:0.0:1746140880.188671:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140880.188682:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013569d000/0x8156357b7fdb87f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07c9 expref: 30 pid: 9872 timeout: 959 lvb_type: 1 00000100:00100000:1.0:1746140880.188697:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8426 00000100:00100000:1.0:1746140880.188702:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f887100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573470208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140880.188740:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8428 00000100:00100000:0.0:1746140880.188747:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573470464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140880.188753:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140880.188763:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d0 expref: 31 pid: 4782 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.188771:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d0 expref: 31 pid: 4782 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.188782:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb8805 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07d0 expref: 31 pid: 4782 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.188791:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.188792:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.188795:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188801:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188814:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140880.188828:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573470464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.188834:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8428 00010000:00010000:0.0:1746140880.188851:0:4784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188858:0:4784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188870:0:4784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188875:0:4784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188881:0:4784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188885:0:4784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5216600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140880.188888:0:4784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188894:0:4784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188902:0:4784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.188907:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5216600/0x8156357b7fdb8a20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.188944:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573469312:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 14892us (14938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.188953:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16285 00000100:00100000:0.0:1746140880.188980:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.188991:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573470848 00000100:00100000:0.0:1746140880.188994:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573470848 00010000:00010000:0.0:1746140880.189005:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 9 pid: 24958 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.189029:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8429 00000100:00100000:0.0:1746140880.189035:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573470848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140880.189040:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.189041:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.189049:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d28e00/0x8156357b7fdb8828 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07fa expref: 20 pid: 8460 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.189049:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 9 pid: 24958 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.189057:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d28e00/0x8156357b7fdb8828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07fa expref: 20 pid: 8460 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.189057:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 9 pid: 24958 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.189067:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb8733 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0783 expref: 9 pid: 24958 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.189068:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d28e00/0x8156357b7fdb8828 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a07fa expref: 20 pid: 8460 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.189075:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.189076:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.189076:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140880.189079:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b5ed600/0x8156357b7fdb8a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.189085:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b5ed600/0x8156357b7fdb8a0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.189087:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573470848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.189092:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8429 00010000:00010000:1.0:1746140880.189108:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.189120:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f887100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573470208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 419us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.189126:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8426 00000100:00100000:1.0:1746140880.189598:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573471744 00000100:00100000:1.0:1746140880.189602:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573471744 00010000:00010000:1.0:1746140880.189613:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2efe00/0x8156357b7fdb892b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08b0 expref: 28 pid: 32377 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.189628:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8431 00000100:00100000:1.0:1746140880.189633:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573471744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.189639:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.189647:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e2efe00/0x8156357b7fdb892b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08b0 expref: 28 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.189655:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e2efe00/0x8156357b7fdb892b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08b0 expref: 28 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.189664:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2efe00/0x8156357b7fdb892b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08b0 expref: 28 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.189671:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.189673:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.189675:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b5ec400/0x8156357b7fdb8a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.189681:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b5ec400/0x8156357b7fdb8a27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.189698:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.189714:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573471744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.189722:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8431 00000100:00100000:0.0:1746140880.192033:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f886300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575950976:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140880.192051:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.192064:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480e00/0x8156357b7fdb8a12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.192116:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573469440:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 18938us (20375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.192123:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16283 00000100:00100000:1.0:1746140880.198485:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16290 00000100:00100000:1.0:1746140880.198491:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573472128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.198497:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.198511:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f977c00/0x8156357b7fdb8a43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a093c expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140880.198526:0:4785:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fecf, atime: 0x6813fecf, ctime: 0x6813fecf, blocks: 0x821 00010000:00010000:1.0:1746140880.198542:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.198544:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.198553:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f977c00/0x8156357b7fdb8a43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a093c expref: 29 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.198566:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f977c00/0x8156357b7fdb8a43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a093c expref: 29 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.198575:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f977c00, rc 0) 00000100:00100000:1.0:1746140880.198615:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573472128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 125us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.198621:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16290 00000100:00100000:1.0:1746140880.198804:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16294 00000100:00100000:1.0:1746140880.198809:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573472512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.198816:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.198823:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f977600/0x8156357b7fdb8a5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0951 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140880.198838:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fed0, atime: 0x6813fed0, ctime: 0x6813fed0, blocks: 0x102b 00010000:00010000:1.0:1746140880.198846:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.198847:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.198852:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f977600/0x8156357b7fdb8a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0951 expref: 30 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.198860:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f977600/0x8156357b7fdb8a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0951 expref: 30 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.198867:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f977600, rc 0) 00000100:00100000:1.0:1746140880.198888:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573472512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.198893:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16294 00000100:00100000:0.0:1746140880.199257:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.199332:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573472768 00000100:00100000:1.0:1746140880.199336:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573472768 00002000:00100000:1.0:1746140880.199372:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f886300 x1830960573472768/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.199386:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f886300 with x1830960573472768 ext(1048576->2097151) 00002000:00010000:1.0:1746140880.199391:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f886300 00000100:00100000:1.0:1746140880.199418:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8359 00000100:00100000:1.0:1746140880.199424:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573472768:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140880.201445:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575951104:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140880.201479:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8a58 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a094a expref: 30 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.201497:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2efa00/0x8156357b7fdb8a58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a094a expref: 30 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.201506:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2efa00, rc 0) 00000100:00100000:1.0:1746140880.201537:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573472384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2799us (2859us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140880.201545:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16293 00000100:00100000:0.0:1746140880.206248:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.206400:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573472896 00000100:00100000:1.0:1746140880.206407:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573472896 00000100:00100000:1.0:1746140880.206445:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16295 00000100:00100000:1.0:1746140880.206451:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:32382:x1830960573472896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.206465:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.206483:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f976c00/0x8156357b7fdb8a66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0958 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.206505:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140880.206509:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b67c00/0x8156357b7fdb8a2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.206515:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746140880.206521:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f976c00/0x8156357b7fdb8a66 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4882432->5242879] (req 4882432->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0958 expref: 30 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.206534:0:32376:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880093b67c00/0x8156357b7fdb8a2e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.206549:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f976c00/0x8156357b7fdb8a66 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4882432->5242879] (req 4882432->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0958 expref: 30 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.206557:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f976c00, rc 0) 00000100:00100000:1.0:1746140880.206583:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:32382:x1830960573472896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 133us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.206588:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16295 00000100:00100000:1.0:1746140880.206771:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573472768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7348us (7515us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.206779:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8359 00002000:00100000:1.0:1746140880.206785:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f886300 x1830960573472768/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.206793:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f886300 with x1830960573472768 ext(1048576->2097151) 00002000:00010000:1.0:1746140880.206796:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f886300 00000100:00100000:0.0:1746140880.213519:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.214454:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.214568:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573473024 00000100:00100000:1.0:1746140880.214578:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573473024 00010000:00010000:1.0:1746140880.214614:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee000/0x8156357b7fdb8932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08b7 expref: 30 pid: 32377 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.214642:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8432 00000100:00100000:1.0:1746140880.214648:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573473024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.214662:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.214687:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee000/0x8156357b7fdb8932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08b7 expref: 30 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.214705:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee000/0x8156357b7fdb8932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08b7 expref: 30 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.214728:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee000/0x8156357b7fdb8932 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08b7 expref: 30 pid: 32377 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.214745:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.214746:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.214751:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b67c00/0x8156357b7fdb8a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.214759:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b67c00/0x8156357b7fdb8a2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.214793:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.214832:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573473024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 184us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.214839:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8432 00000100:00100000:0.0:1746140880.215002:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.215796:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.216078:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.223773:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.223819:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.224354:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573473920 00000100:00100000:1.0:1746140880.224358:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573473920 00002000:00100000:1.0:1746140880.224383:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff88009f885c00 x1830960573473920/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.224391:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f885c00 with x1830960573473920 ext(4882432->4886527) 00002000:00010000:1.0:1746140880.224394:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f885c00 00000100:00100000:1.0:1746140880.224409:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8360 00000100:00100000:1.0:1746140880.224413:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573473920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140880.224749:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573473920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 334us (984us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140880.224755:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8360 00002000:00100000:1.0:1746140880.224760:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff88009f885c00 x1830960573473920/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.224766:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f885c00 with x1830960573473920 ext(4882432->4886527) 00002000:00010000:1.0:1746140880.224768:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f885c00 00000100:00100000:0.0:1746140880.226414:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.231847:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.233164:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.233513:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.233533:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.233559:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.233628:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.233734:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573475840 00000100:00100000:0.0:1746140880.233738:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573475840 00002000:00100000:0.0:1746140880.233759:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009edcb480 x1830960573475840/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140880.233766:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb480 with x1830960573475840 ext(3145728->4194303) 00002000:00010000:0.0:1746140880.233770:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcb480 00000100:00100000:0.0:1746140880.233783:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8361 00000100:00100000:0.0:1746140880.233789:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573475200:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140880.256614:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573475200:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22815us (23092us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.256624:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8361 00002000:00100000:1.0:1746140880.256647:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009edc8a80 x1830960573475200/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.256656:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8a80 with x1830960573475200 ext(2097152->3145727) 00002000:00010000:1.0:1746140880.256660:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8a80 00000100:00100000:0.0:1746140880.264128:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.264243:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573476224 00000100:00100000:1.0:1746140880.264255:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573476224 00002000:00100000:1.0:1746140880.264355:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f887100 x1830960573476224/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.264365:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f887100 with x1830960573476224 ext(4194304->4886527) 00002000:00010000:1.0:1746140880.264370:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f887100 00000100:00100000:0.0:1746140880.277445:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.281860:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.282046:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573476608 00000100:00100000:1.0:1746140880.282054:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573476608 00000100:00100000:1.0:1746140880.282106:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10581 00000100:00100000:1.0:1746140880.282115:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32393:x1830960573476608:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140880.282138:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.282158:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976600/0x8156357b7fdb8a97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0989 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.282297:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282330:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282342:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282355:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282360:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282366:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282473:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977800/0x8156357b7fdb8aac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282481:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977800/0x8156357b7fdb8aac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282486:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977800/0x8156357b7fdb8aac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:1.0:1746140880.282496:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140880.282588:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282594:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282600:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282606:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f976400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140880.282609:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282615:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282625:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140880.282628:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140880.282631:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282635:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976400/0x8156357b7fdb8a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282663:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282668:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282672:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282679:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f976800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140880.282681:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282685:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282690:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800936f8d00) 00010000:00010000:1.0:1746140880.282692:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140880.282694:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282698:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976800/0x8156357b7fdb8aa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.282732:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f976600/0x8156357b7fdb8a97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0989 expref: 278 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.282741:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977800/0x8156357b7fdb8aac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0989 expref: 277 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.282746:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140880.282747:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140880.282750:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f977800, rc 0) 00000100:00100000:1.0:1746140880.282796:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:32393:x1830960573476608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 682us (937us total) trans 8589944852 rc 0/0 00000100:00100000:1.0:1746140880.282801:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10581 00000100:00100000:1.0:1746140880.282822:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573476736 00000100:00100000:1.0:1746140880.282825:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573476736 00010000:00010000:1.0:1746140880.282839:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f976c00/0x8156357b7fdb8a66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0958 expref: 29 pid: 32376 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.282854:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8433 00000100:00100000:1.0:1746140880.282858:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573476736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.282867:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.282882:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f976c00/0x8156357b7fdb8a66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0958 expref: 29 pid: 32376 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.282889:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f976c00/0x8156357b7fdb8a66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0958 expref: 29 pid: 32376 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.282903:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f976c00/0x8156357b7fdb8a66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0958 expref: 29 pid: 32376 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.282911:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.282926:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573476736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.282930:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8433 00000100:00100000:0.0:1746140880.283355:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.284099:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.286485:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.292382:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.294966:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.297076:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.303445:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.305491:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.336630:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.339716:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.340201:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.343289:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.343400:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573478912 00000100:00100000:1.0:1746140880.343408:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573478912 00002000:00100000:1.0:1746140880.343448:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1179648->1183743) req@ffff88008ece0e00 x1830960573478912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.343456:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0e00 with x1830960573478912 ext(1179648->1183743) 00002000:00010000:1.0:1746140880.343460:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece0e00 00000100:00100000:1.0:1746140880.343985:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8368 00000100:00100000:1.0:1746140880.343994:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573478912:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140880.344130:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573478912:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 137us (851us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140880.344135:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8368 00002000:00100000:1.0:1746140880.344140:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1179648->1183743) req@ffff88008ece0e00 x1830960573478912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.344146:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0e00 with x1830960573478912 ext(1179648->1183743) 00002000:00010000:1.0:1746140880.344149:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece0e00 00000100:00100000:0.0:1746140880.350038:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.352194:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.352260:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573479424 00000100:00100000:1.0:1746140880.352266:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573479424 00000100:00100000:1.0:1746140880.352300:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10582 00000100:00100000:1.0:1746140880.352324:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:32399:x1830960573479424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.352400:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.352416:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977a00/0x8156357b7fdb8ac8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a099e expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.352477:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977400/0x8156357b7fdb8acf lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.352491:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977400/0x8156357b7fdb8acf lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.352500:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977400/0x8156357b7fdb8acf lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:1.0:1746140880.352509:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140880.352770:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977a00/0x8156357b7fdb8ac8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a099e expref: 282 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.352801:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977400/0x8156357b7fdb8acf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a099e expref: 280 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.352808:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140880.352811:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746140880.352814:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f977400, rc 0) 00000100:00100000:1.0:1746140880.352834:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:32399:x1830960573479424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 512us (679us total) trans 8589944855 rc 0/0 00000100:00100000:1.0:1746140880.352839:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10582 00000100:00100000:0.0:1746140880.355797:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.355847:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.356252:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16305 00000100:00100000:0.0:1746140880.356259:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573479936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140880.356266:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140880.356276:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ffe200/0x8156357b7fdb8ae4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a09ac expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.356322:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575952640:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140880.356536:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.366764:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.366804:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.366835:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.366893:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573480448 00000100:00100000:1.0:1746140880.366897:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573480448 00002000:00100000:1.0:1746140880.366914:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008ece2a00 x1830960573480448/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 504/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.366923:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2a00 with x1830960573480448 ext(1048576->2097151) 00002000:00010000:1.0:1746140880.366927:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece2a00 00000100:00100000:0.0:1746140880.367126:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.367217:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573480704 00000100:00100000:1.0:1746140880.367220:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573480704 00002000:00100000:1.0:1746140880.367232:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88008ece3100 x1830960573480704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.367238:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece3100 with x1830960573480704 ext(1048576->2097151) 00002000:00010000:1.0:1746140880.367241:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece3100 00000100:00100000:1.0:1746140880.367258:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8371 00000100:00100000:1.0:1746140880.367263:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573480448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140880.367456:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8373 00000100:00100000:0.0:1746140880.367462:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573480704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140880.396993:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.397049:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.403550:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.407301:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.417437:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.420992:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.436975:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.440704:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.450513:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.461427:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.461498:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.461621:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573482496 00000100:00100000:1.0:1746140880.461632:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573482496 00002000:00100000:1.0:1746140880.461678:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b182300 x1830960573482496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.461689:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182300 with x1830960573482496 ext(2097152->3145727) 00002000:00010000:1.0:1746140880.461695:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b182300 00000100:00100000:1.0:1746140880.461728:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573483008 00000100:00100000:1.0:1746140880.461730:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573483008 00002000:00100000:1.0:1746140880.461744:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b181180 x1830960573483008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.461750:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181180 with x1830960573483008 ext(3145728->4194303) 00002000:00010000:1.0:1746140880.461754:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b181180 00000100:00100000:1.0:1746140880.461766:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8375 00000100:00100000:1.0:1746140880.461773:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573482496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140880.462658:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.472504:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573482496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10720us (11199us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.472518:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8375 00002000:00100000:1.0:1746140880.472530:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b182300 x1830960573482496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.472540:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182300 with x1830960573482496 ext(2097152->3145727) 00002000:00010000:1.0:1746140880.472546:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b182300 00000100:00100000:0.0:1746140880.483121:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.504846:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.504947:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573483520 00000100:00100000:1.0:1746140880.504956:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573483520 00000100:00100000:0.0:1746140880.507802:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.507869:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.507911:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.507984:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573483904 00000100:00100000:1.0:1746140880.507988:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573483904 00000100:00100000:1.0:1746140880.508005:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16311 00000100:00100000:1.0:1746140880.508008:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573483648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.508014:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.508025:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb8b31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a09d6 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.508065:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575953536:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140880.508297:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00002000:00010000:1.0:1746140880.509707:0:4785:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140880 -> 1746140881 00002000:00010000:1.0:1746140880.509710:0:4785:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140880 -> 1746140881 00002000:00010000:1.0:1746140880.509711:0:4785:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140880 -> 1746140881 00000100:00100000:1.0:1746140880.509726:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575953536:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140880.509745:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb8b31 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09d6 expref: 22 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.509753:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb8b31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09d6 expref: 22 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.509766:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb9000, rc 0) 00000100:00100000:1.0:1746140880.509786:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573483648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1777us (1917us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140880.509791:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16311 00000100:00100000:0.0:1746140880.515966:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.516002:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.518710:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.519358:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573484288 00000100:00100000:1.0:1746140880.519368:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573484288 00002000:00100000:1.0:1746140880.519408:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f2c0380 x1830960573484288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.519418:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0380 with x1830960573484288 ext(0->1048575) 00002000:00010000:1.0:1746140880.519423:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c0380 00000100:00100000:1.0:1746140880.519449:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8381 00000100:00100000:1.0:1746140880.519458:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573484288:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140880.528455:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573484288:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8994us (9747us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.528465:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8381 00002000:00100000:1.0:1746140880.528471:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f2c0380 x1830960573484288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.528479:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0380 with x1830960573484288 ext(0->1048575) 00002000:00010000:1.0:1746140880.528484:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c0380 00000100:00100000:0.0:1746140880.528936:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.530454:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.530478:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.530716:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573485056 00000100:00100000:1.0:1746140880.530719:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573485056 00010000:00010000:1.0:1746140880.530730:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2c00/0x8156357b7fdb8b1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09cf expref: 18 pid: 14743 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.530755:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8442 00000100:00100000:1.0:1746140880.530759:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573485056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.530764:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.530767:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2c00/0x8156357b7fdb8b1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09cf expref: 18 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.530774:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2c00/0x8156357b7fdb8b1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09cf expref: 18 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.530783:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2c00/0x8156357b7fdb8b1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09cf expref: 18 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.530888:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140880.530891:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.530973:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573485056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 213us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.531057:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8442 00000100:00100000:0.0:1746140880.540626:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.540750:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573485312 00000100:00100000:1.0:1746140880.540759:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573485312 00000100:00100000:1.0:1746140880.540885:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16313 00000100:00100000:1.0:1746140880.540893:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32404:x1830960573485312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.540910:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.540925:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a09f2 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.540952:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.540963:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140880.540965:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140880.540968:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 22 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.540994:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.541005:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 28 pid: 8458 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.541021:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575953920:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.541411:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140880.543543:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960575953920:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140880.543569:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 22 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.543588:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb9400, rc 0) 00000100:00100000:1.0:1746140880.543655:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32404:x1830960573485312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2762us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.543663:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16313 00000100:00100000:0.0:1746140880.545618:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.545736:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573485440 00000100:00100000:1.0:1746140880.545744:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573485440 00002000:00100000:1.0:1746140880.545784:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1179648->1802239) req@ffff88009f2c0e00 x1830960573485440/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.545793:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0e00 with x1830960573485440 ext(1179648->1802239) 00010000:00010000:1.0:1746140880.545802:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 29 pid: 8458 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.545814:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 29 pid: 8458 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.545820:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c0e00 00000100:00100000:1.0:1746140880.545848:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1729 00000100:00100000:1.0:1746140880.545854:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573485440:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140880.560962:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.561070:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573485568 00000100:00100000:1.0:1746140880.561083:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573485568 00010000:00010000:1.0:1746140880.561125:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 31 pid: 8458 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.561192:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8443 00000100:00100000:1.0:1746140880.561203:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573485568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.561216:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.561236:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 31 pid: 8458 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.561247:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 31 pid: 8458 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.561267:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef800/0x8156357b7fdb8ac1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1802239) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0997 expref: 31 pid: 8458 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.561286:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.561288:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.561294:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 21 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.561301:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 21 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.561372:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 21 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.561388:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575954048:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140880.561479:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140880.565677:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575954048:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140880.565699:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.565802:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573485568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4602us (4849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.565812:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8443 00000100:00100000:0.0:1746140880.567203:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.579042:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.593368:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.593406:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.593444:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.601159:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.601263:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573487104 00000100:00100000:1.0:1746140880.601272:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573487104 00002000:00100000:1.0:1746140880.601496:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880093135180 x1830960573487104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.601506:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135180 with x1830960573487104 ext(3145728->4194303) 00002000:00010000:1.0:1746140880.601512:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093135180 00000100:00100000:1.0:1746140880.601540:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8386 00000100:00100000:1.0:1746140880.601546:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573487104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140880.612269:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1982:x1830960573487104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10722us (11120us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.612277:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8386 00002000:00100000:1.0:1746140880.612283:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880093135180 x1830960573487104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.612290:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135180 with x1830960573487104 ext(3145728->4194303) 00002000:00010000:1.0:1746140880.612294:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093135180 00000100:00100000:0.0:1746140880.618779:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.618948:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573487360 00000100:00100000:1.0:1746140880.618959:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573487360 00002000:00100000:1.0:1746140880.619012:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880093134e00 x1830960573487360/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.619024:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093134e00 with x1830960573487360 ext(4194304->4886527) 00002000:00010000:1.0:1746140880.619029:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093134e00 00000100:00100000:1.0:1746140880.619128:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8387 00000100:00100000:1.0:1746140880.619139:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573487360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140880.629576:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573487360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10424us (10793us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140880.629590:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8387 00002000:00100000:1.0:1746140880.629603:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880093134e00 x1830960573487360/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.629614:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093134e00 with x1830960573487360 ext(4194304->4886527) 00002000:00010000:1.0:1746140880.629619:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093134e00 00000100:00100000:0.0:1746140880.633662:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.651493:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.651911:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573487744 00000100:00100000:1.0:1746140880.651923:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573487744 00000100:00100000:1.0:1746140880.651994:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10586 00000100:00100000:1.0:1746140880.652002:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:32410:x1830960573487744:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140880.652022:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.652038:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68dea00/0x8156357b7fdb8b70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0a00 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.652089:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68dec00/0x8156357b7fdb8b77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.652104:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68dec00/0x8156357b7fdb8b77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.652114:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68dec00/0x8156357b7fdb8b77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.652124:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68dee00/0x8156357b7fdb8b7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.652129:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68dee00/0x8156357b7fdb8b7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.652133:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68dee00/0x8156357b7fdb8b7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.652239:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.652250:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f3400/0x8156357b7fdb8b46 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09eb expref: 17 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.652256:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2ef200/0x8156357b7fdb8b62 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f9 expref: 280 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.652262:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.652291:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2ef200/0x8156357b7fdb8b62 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f9 expref: 280 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.652345:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2ef200/0x8156357b7fdb8b62 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f9 expref: 280 pid: 14743 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.652362:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575954176:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140880.652476:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f3400/0x8156357b7fdb8b46 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09eb expref: 17 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.652484:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f3400/0x8156357b7fdb8b46 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09eb expref: 17 pid: 14743 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.652491:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575954304:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.652511:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140880.655459:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575954176:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.655614:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.655653:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.655681:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573487872 00000100:00100000:0.0:1746140880.655690:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573487872 00010000:00010000:1.0:1746140880.655846:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f3400/0x8156357b7fdb8b46 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09eb expref: 18 pid: 14743 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.655862:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8445 00000100:00100000:1.0:1746140880.655867:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573487872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.655872:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.655875:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f3400/0x8156357b7fdb8b46 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09eb expref: 18 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.655882:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f3400/0x8156357b7fdb8b46 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09eb expref: 18 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.655891:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f3400/0x8156357b7fdb8b46 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09eb expref: 18 pid: 14743 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.655906:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140880.655909:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.655915:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.655920:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.655932:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.655946:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573487872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.655951:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8445 00000100:00100000:0.0:1746140880.658886:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.658919:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.658949:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.658972:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.658987:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.659015:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573488384 00000100:00100000:0.0:1746140880.659022:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573488384 00000100:00100000:1.0:1746140880.659048:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573488640 00000100:00100000:1.0:1746140880.659053:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573488640 00000100:00100000:0.0:1746140880.659059:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573488256 00000100:00100000:0.0:1746140880.659062:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573488256 00000100:00100000:1.0:1746140880.659080:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16314 00000100:00100000:1.0:1746140880.659087:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573488384:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140880.659104:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.659119:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a68dfc00/0x8156357b7fdb8b8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0a15 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.659137:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.659138:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.659146:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a68dfc00/0x8156357b7fdb8b8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a15 expref: 7 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.659159:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a68dfc00/0x8156357b7fdb8b8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a15 expref: 7 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.659169:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a68dfc00, rc 0) 00000100:00100000:1.0:1746140880.659325:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573488384:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 237us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.659326:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16315 00000100:00100000:0.0:1746140880.659335:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573488128:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:1.0:1746140880.659347:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16314 00010000:00010000:0.0:1746140880.659352:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140880.659362:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16318 00010000:00010000:0.0:1746140880.659364:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f21600/0x8156357b7fdb8b9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0a07 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.659367:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573488512:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140880.659373:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.659380:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a68dfe00/0x8156357b7fdb8ba8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0a1c expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.659380:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.659382:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.659389:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f21600/0x8156357b7fdb8b9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a07 expref: 10 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.659390:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.659391:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.659394:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a68dfe00/0x8156357b7fdb8ba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a1c expref: 10 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.659401:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130f21600/0x8156357b7fdb8b9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a07 expref: 10 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.659403:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a68dfe00/0x8156357b7fdb8ba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a1c expref: 10 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.659410:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a68dfe00, rc 0) 00010000:00010000:0.0:1746140880.659410:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f21600, rc 0) 00000100:00100000:1.0:1746140880.659426:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573488512:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.659431:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16318 00000100:00100000:0.0:1746140880.659439:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573488128:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 106us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.659447:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16315 00000100:00100000:1.0:1746140880.659538:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.659577:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573488768 00000100:00100000:0.0:1746140880.659581:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573488768 00000100:00100000:0.0:1746140880.659610:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16319 00000100:00100000:0.0:1746140880.659615:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573488768:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140880.659621:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140880.659629:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f20c00/0x8156357b7fdb8baf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0a2a expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.659640:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.659641:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.659645:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f20c00/0x8156357b7fdb8baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a2a expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.659661:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f20c00/0x8156357b7fdb8baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a2a expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.659669:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f20c00, rc 0) 00000100:00100000:1.0:1746140880.659704:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573488768:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.659713:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16319 00000100:00100000:1.0:1746140880.663143:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.671077:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.671282:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.671351:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575954432:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140880.671370:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008febb800/0x8156357b7fdb8bbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140880.671426:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573489280 00000100:00100000:0.0:1746140880.671430:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573489280 00010000:00010000:0.0:1746140880.671450:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a00 expref: 13 pid: 14741 timeout: 959 lvb_type: 0 00000100:00100000:0.0:1746140880.671475:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8446 00000100:00100000:0.0:1746140880.671480:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573489280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140880.671488:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140880.671493:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a00 expref: 13 pid: 14741 timeout: 959 lvb_type: 0 00010000:00010000:0.0:1746140880.671502:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a00 expref: 13 pid: 14741 timeout: 959 lvb_type: 0 00010000:00010000:0.0:1746140880.671521:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a68df000/0x8156357b7fdb8b85 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a00 expref: 13 pid: 14741 timeout: 959 lvb_type: 0 00010000:00010000:0.0:1746140880.671535:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140880.671539:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008febb800/0x8156357b7fdb8bbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.671547:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008febb800/0x8156357b7fdb8bbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.671556:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008febb800/0x8156357b7fdb8bbd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140880.671567:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140880.671585:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573489280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140880.671590:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8446 00010000:00010000:1.0:1746140880.671615:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008febb800/0x8156357b7fdb8bbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140880.671621:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008febb800/0x8156357b7fdb8bbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:1.0:1746140880.671642:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140880.671782:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008febba00/0x8156357b7fdb8bb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a31 expref: 14 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.671809:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008febb800/0x8156357b7fdb8bbd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a31 expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.671815:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140880.671817:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746140880.671819:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008febb800, rc 0) 00000100:00100000:1.0:1746140880.671838:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:32410:x1830960573489024:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 8229us (8702us total) trans 8589944861 rc 0/0 00000100:00100000:1.0:1746140880.671844:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10587 00000100:00100000:0.0:1746140880.674067:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.674411:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573489408 00000100:00100000:1.0:1746140880.674417:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573489408 00010000:00010000:1.0:1746140880.674438:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130f21600/0x8156357b7fdb8b9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a07 expref: 8 pid: 24958 timeout: 959 lvb_type: 1 00000100:00100000:1.0:1746140880.674455:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8447 00000100:00100000:1.0:1746140880.674460:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573489408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.674470:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.674490:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130f21600/0x8156357b7fdb8b9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a07 expref: 8 pid: 24958 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.674992:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140880.675120:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130f21600/0x8156357b7fdb8b9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a07 expref: 8 pid: 24958 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.675139:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f21600/0x8156357b7fdb8b9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a07 expref: 8 pid: 24958 timeout: 959 lvb_type: 1 00000100:00100000:0.0:1746140880.675143:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140880.675150:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.675169:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573489408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 708us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.675175:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8447 00000100:00100000:1.0:1746140880.675194:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573489920 00000100:00100000:1.0:1746140880.675197:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573489920 00010000:00010000:1.0:1746140880.675207:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b67200/0x8156357b7fdb8a3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a092e expref: 30 pid: 24958 timeout: 959 lvb_type: 1 00000100:00100000:1.0:1746140880.675222:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8449 00000100:00100000:1.0:1746140880.675226:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573489920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.675235:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.675241:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b67200/0x8156357b7fdb8a3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a092e expref: 30 pid: 24958 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.675249:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b67200/0x8156357b7fdb8a3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a092e expref: 30 pid: 24958 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.675259:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b67200/0x8156357b7fdb8a3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a092e expref: 30 pid: 24958 timeout: 959 lvb_type: 1 00010000:00010000:1.0:1746140880.675268:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.675281:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1983:x1830960573489920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.675286:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8449 00000100:00100000:0.0:1746140880.680153:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.680503:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.680945:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573490432 00000100:00100000:1.0:1746140880.680949:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573490432 00002000:00100000:1.0:1746140880.680978:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a0:0x0] (847872->851967) req@ffff88009b892a00 x1830960573490432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.680987:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892a00 with x1830960573490432 ext(847872->851967) 00002000:00010000:1.0:1746140880.680991:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b892a00 00000100:00100000:1.0:1746140880.681016:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8388 00000100:00100000:1.0:1746140880.681021:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573490432:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140880.681150:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573490432:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 128us (646us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140880.681156:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8388 00002000:00100000:1.0:1746140880.681161:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a0:0x0] (847872->851967) req@ffff88009b892a00 x1830960573490432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.681168:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892a00 with x1830960573490432 ext(847872->851967) 00002000:00010000:1.0:1746140880.681170:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b892a00 00000100:00100000:0.0:1746140880.683463:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.687406:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.687502:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.687745:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.687807:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8452 00000100:00100000:0.0:1746140880.687815:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573490944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140880.687821:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140880.687830:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e2efc00/0x8156357b7fdb8a4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0935 expref: 30 pid: 32376 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.687839:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e2efc00/0x8156357b7fdb8a4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0935 expref: 30 pid: 32376 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.687851:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2efc00/0x8156357b7fdb8a4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0935 expref: 30 pid: 32376 timeout: 959 lvb_type: 1 00010000:00010000:0.0:1746140880.687862:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.687863:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.687869:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008feba400/0x8156357b7fdb8be0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a46 expref: 23 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.687877:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008feba400/0x8156357b7fdb8be0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a46 expref: 23 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.687901:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008feba400/0x8156357b7fdb8be0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a46 expref: 23 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.687912:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b890a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960575955456:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140880.687956:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.697478:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573491200 00000100:00100000:0.0:1746140880.697489:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573491200 00002000:00100000:0.0:1746140880.697533:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1802240->1806335) req@ffff880093130700 x1830960573491200/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140880.697545:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130700 with x1830960573491200 ext(1802240->1806335) 00002000:00010000:0.0:1746140880.697550:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130700 00000100:00100000:0.0:1746140880.697581:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8389 00000100:00100000:0.0:1746140880.697589:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573491200:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140880.697781:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573491200:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 192us (361us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140880.697788:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8389 00002000:00100000:0.0:1746140880.697795:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1802240->1806335) req@ffff880093130700 x1830960573491200/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140880.697802:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130700 with x1830960573491200 ext(1802240->1806335) 00002000:00010000:0.0:1746140880.697805:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130700 00000100:00100000:0.0:1746140880.700149:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.713616:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.713656:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.714606:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.714774:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573491840 00000100:00100000:1.0:1746140880.714778:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573491840 00000100:00100000:1.0:1746140880.714796:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16324 00000100:00100000:1.0:1746140880.714801:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573491840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.714808:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.714815:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a68df200/0x8156357b7fdb8bf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0a5b expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.714826:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.714828:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.714835:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a68df200/0x8156357b7fdb8bf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a5b expref: 32 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.714849:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a68df200/0x8156357b7fdb8bf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a5b expref: 32 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.714858:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a68df200, rc 0) 00000100:00100000:1.0:1746140880.714885:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573491840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.714891:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16324 00000100:00100000:0.0:1746140880.718843:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.726588:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.726912:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573492096 00000100:00100000:1.0:1746140880.726921:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573492096 00002000:00100000:1.0:1746140880.726963:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a0:0x0] (847872->1048575) req@ffff88009b893b80 x1830960573492096/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.726973:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893b80 with x1830960573492096 ext(847872->1048575) 00010000:00010000:1.0:1746140880.726983:0:21691:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008feba200/0x8156357b7fdb8bc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 847872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a38 expref: 22 pid: 8460 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.726998:0:21691:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008feba200/0x8156357b7fdb8bc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 847872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a38 expref: 22 pid: 8460 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.727004:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b893b80 00000100:00100000:1.0:1746140880.727138:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1730 00000100:00100000:1.0:1746140880.727145:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573492096:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140880.731252:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573492096:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4093us (4656us total) trans 21474841237 rc 0/0 00000100:00100000:1.0:1746140880.731265:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1730 00002000:00100000:1.0:1746140880.731276:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a0:0x0] (847872->1048575) req@ffff88009b893b80 x1830960573492096/t21474841237(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/448 e 0 to 0 dl 1746140891 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.731286:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893b80 with x1830960573492096 ext(847872->1048575) 00010000:00010000:1.0:1746140880.731295:0:21691:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008feba200/0x8156357b7fdb8bc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 847872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a38 expref: 24 pid: 8460 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.731344:0:21691:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008feba200/0x8156357b7fdb8bc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 847872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a38 expref: 24 pid: 8460 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.731351:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b893b80 00000100:00100000:0.0:1746140880.734771:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.740713:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.741486:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573492480 00000100:00100000:1.0:1746140880.741499:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573492480 00002000:00100000:1.0:1746140880.741541:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009b892300 x1830960573492480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.741550:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892300 with x1830960573492480 ext(0->1048575) 00002000:00010000:1.0:1746140880.741554:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b892300 00000100:00100000:1.0:1746140880.741585:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8390 00000100:00100000:1.0:1746140880.741592:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573492480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140880.749560:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.750797:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573492480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9202us (10089us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.750806:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8390 00002000:00100000:1.0:1746140880.750815:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009b892300 x1830960573492480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.750823:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892300 with x1830960573492480 ext(0->1048575) 00002000:00010000:1.0:1746140880.750828:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b892300 00000100:00100000:0.0:1746140880.756254:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.756338:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.756842:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.756906:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.759424:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.759470:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573493376 00000100:00100000:1.0:1746140880.759476:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573493376 00002000:00100000:1.0:1746140880.759507:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (2473984->2478079) req@ffff88009b891880 x1830960573493376/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.759516:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891880 with x1830960573493376 ext(2473984->2478079) 00002000:00010000:1.0:1746140880.759521:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b891880 00000100:00100000:1.0:1746140880.759536:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8391 00000100:00100000:1.0:1746140880.759543:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573493376:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140880.759685:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573493376:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 142us (266us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140880.759691:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8391 00002000:00100000:1.0:1746140880.759697:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (2473984->2478079) req@ffff88009b891880 x1830960573493376/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.759704:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891880 with x1830960573493376 ext(2473984->2478079) 00002000:00010000:1.0:1746140880.759707:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b891880 00000100:00100000:0.0:1746140880.762760:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.763686:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573493504 00000100:00100000:1.0:1746140880.763697:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573493504 00002000:00100000:1.0:1746140880.763740:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1806335) req@ffff88009b890380 x1830960573493504/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.763752:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890380 with x1830960573493504 ext(1048576->1806335) 00010000:00010000:1.0:1746140880.763765:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008feba400/0x8156357b7fdb8be0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a46 expref: 23 pid: 8460 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.763781:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008feba400/0x8156357b7fdb8be0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a46 expref: 23 pid: 8460 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.763788:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b890380 00000100:00100000:1.0:1746140880.763823:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1731 00000100:00100000:1.0:1746140880.763831:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1982:x1830960573493504:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140880.767040:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.770864:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.772695:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573493504:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8864us (9943us total) trans 17179873967 rc 0/0 00000100:00100000:1.0:1746140880.772704:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1731 00002000:00100000:1.0:1746140880.772714:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1806335) req@ffff88009b890380 x1830960573493504/t17179873967(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/448 e 0 to 0 dl 1746140891 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.772723:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890380 with x1830960573493504 ext(1048576->1806335) 00010000:00010000:1.0:1746140880.772730:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008feba400/0x8156357b7fdb8be0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a46 expref: 25 pid: 8460 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.772742:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008feba400/0x8156357b7fdb8be0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a46 expref: 25 pid: 8460 timeout: 959 lvb_type: 0 00002000:00010000:1.0:1746140880.772747:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b890380 00000100:00100000:0.0:1746140880.773401:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.774343:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573494016 00000100:00100000:0.0:1746140880.774348:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573494016 00010000:00010000:0.0:1746140880.774366:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef400/0x8156357b7fdb8af9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09c1 expref: 32 pid: 8458 timeout: 959 lvb_type: 0 00000100:00100000:0.0:1746140880.774563:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8459 00000100:00100000:0.0:1746140880.774574:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573494016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140880.774582:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140880.774594:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef400/0x8156357b7fdb8af9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09c1 expref: 32 pid: 8458 timeout: 959 lvb_type: 0 00010000:00010000:0.0:1746140880.774603:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef400/0x8156357b7fdb8af9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09c1 expref: 32 pid: 8458 timeout: 959 lvb_type: 0 00010000:00010000:0.0:1746140880.774616:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef400/0x8156357b7fdb8af9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09c1 expref: 32 pid: 8458 timeout: 959 lvb_type: 0 00010000:00010000:0.0:1746140880.774637:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.774639:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.774646:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f3e00/0x8156357b7fdb8c11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a77 expref: 31 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.774654:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c9f3e00/0x8156357b7fdb8c11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a77 expref: 31 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.774683:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c9f3e00/0x8156357b7fdb8c11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3510271) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a77 expref: 31 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.774694:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960575957120:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140880.774763:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.775166:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.779219:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.779345:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573494400 00000100:00100000:1.0:1746140880.779354:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573494400 00002000:00100000:1.0:1746140880.779397:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3506176->3510271) req@ffff88009f2c3480 x1830960573494400/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.779407:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c3480 with x1830960573494400 ext(3506176->3510271) 00002000:00010000:1.0:1746140880.779412:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c3480 00000100:00100000:1.0:1746140880.779443:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8392 00000100:00100000:1.0:1746140880.779449:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573494400:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140880.779610:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573494400:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 161us (400us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140880.779616:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8392 00002000:00100000:1.0:1746140880.779622:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3506176->3510271) req@ffff88009f2c3480 x1830960573494400/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.779629:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c3480 with x1830960573494400 ext(3506176->3510271) 00002000:00010000:1.0:1746140880.779631:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c3480 00000100:00100000:0.0:1746140880.781781:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.782299:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.782356:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.797720:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573494784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15651us (15935us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140880.797733:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8393 00002000:00100000:0.0:1746140880.797744:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f2c2680 x1830960573494784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140880.797753:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2680 with x1830960573494784 ext(1048576->2097151) 00002000:00010000:0.0:1746140880.797759:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c2680 00000100:00100000:0.0:1746140880.811062:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.811099:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.811141:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.811299:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573495680 00000100:00100000:1.0:1746140880.811319:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573495680 00002000:00100000:1.0:1746140880.811337:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3510272->4194303) req@ffff88009f2c2300 x1830960573495680/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.811344:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2300 with x1830960573495680 ext(3510272->4194303) 00002000:00010000:1.0:1746140880.811347:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c2300 00000100:00100000:1.0:1746140880.811412:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8396 00000100:00100000:1.0:1746140880.811419:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573495680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140880.814945:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.815014:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573496192 00000100:00100000:1.0:1746140880.815024:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573496192 00002000:00100000:1.0:1746140880.815065:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (3817472->4194303) req@ffff88009f2c1500 x1830960573496192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.815075:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1500 with x1830960573496192 ext(3817472->4194303) 00002000:00010000:1.0:1746140880.815080:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c1500 00000100:00100000:1.0:1746140880.815112:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8398 00000100:00100000:1.0:1746140880.815119:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573496192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140880.824614:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573496192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9493us (9679us total) trans 0 rc 376832/376832 00000100:00100000:1.0:1746140880.824623:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8398 00002000:00100000:1.0:1746140880.824628:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a9:0x0] (3817472->4194303) req@ffff88009f2c1500 x1830960573496192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 376832/376832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.824636:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1500 with x1830960573496192 ext(3817472->4194303) 00002000:00010000:1.0:1746140880.824639:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c1500 00000100:00100000:0.0:1746140880.828831:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.853099:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.857564:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.857626:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.857676:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.858431:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16329 00000100:00100000:1.0:1746140880.858440:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573497088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.858462:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.858478:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb8c57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0a8c expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.858502:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.858503:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.858515:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb8c57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a8c expref: 25 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.858530:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb8c57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a8c expref: 25 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.858539:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092995200, rc 0) 00000100:00100000:1.0:1746140880.858581:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573497088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 143us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.858587:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16329 00000100:00100000:0.0:1746140880.858797:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.858820:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573497472 00000100:00100000:1.0:1746140880.858824:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573497472 00000100:00100000:0.0:1746140880.870614:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.870734:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.870794:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573497984 00000100:00100000:1.0:1746140880.870798:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573497984 00002000:00100000:1.0:1746140880.870816:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880094af5880 x1830960573497984/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/0 e 0 to 0 dl 1746140891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.870821:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5880 with x1830960573497984 ext(1048576->2097151) 00002000:00010000:1.0:1746140880.870823:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094af5880 00000100:00100000:1.0:1746140880.870836:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8401 00000100:00100000:1.0:1746140880.870839:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573497984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140880.878703:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573497984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7847us (7952us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.878715:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8401 00002000:00100000:1.0:1746140880.878727:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880094af5880 x1830960573497984/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.878737:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5880 with x1830960573497984 ext(1048576->2097151) 00002000:00010000:1.0:1746140880.878744:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094af5880 00000100:00100000:0.0:1746140880.896752:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.897636:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.905721:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.907860:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.922476:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.923653:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.927216:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.927245:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.928096:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.929188:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.929254:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573499392 00000100:00100000:1.0:1746140880.929258:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573499392 00010000:00010000:1.0:1746140880.929276:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 26 pid: 4785 timeout: 959 lvb_type: 0 00000100:00100000:1.0:1746140880.929294:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8464 00000100:00100000:1.0:1746140880.929298:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573499392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.929323:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.929337:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 26 pid: 4785 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.929348:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 26 pid: 4785 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.929366:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9400/0x8156357b7fdb8b54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a09f2 expref: 26 pid: 4785 timeout: 959 lvb_type: 0 00010000:00010000:1.0:1746140880.929400:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.929402:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.929409:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2400/0x8156357b7fdb8c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0abd expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.929417:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2400/0x8156357b7fdb8c81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0abd expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.929445:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2400/0x8156357b7fdb8c81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0abd expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.929456:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575958528:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140880.929513:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.933142:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.933343:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575958528:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140880.933366:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.933434:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573499392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4133us (4245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.933445:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8464 00000100:00100000:0.0:1746140880.941558:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.942112:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.944896:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.946419:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573500160 00000100:00100000:1.0:1746140880.946426:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573500160 00010000:00010000:1.0:1746140880.946456:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63f400/0x8156357b7fdb8c7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ab6 expref: 25 pid: 32377 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140880.946488:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8465 00000100:00100000:1.0:1746140880.946494:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573500160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.946505:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.946524:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f63f400/0x8156357b7fdb8c7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ab6 expref: 25 pid: 32377 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140880.946533:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f63f400/0x8156357b7fdb8c7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ab6 expref: 25 pid: 32377 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140880.946553:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f63f400/0x8156357b7fdb8c7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ab6 expref: 25 pid: 32377 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140880.946568:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.946570:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.946576:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb8c8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0acb expref: 24 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.946583:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb8c8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0acb expref: 24 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.946610:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb8c8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0acb expref: 24 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.946621:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575958912:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140880.946690:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.950001:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.950207:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575958912:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140880.950234:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140880.950296:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573500160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3801us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.950324:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8465 00000100:00100000:0.0:1746140880.952820:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.952897:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573500672 00000100:00100000:1.0:1746140880.952906:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573500672 00000100:00100000:1.0:1746140880.952957:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4624 00000100:00100000:1.0:1746140880.952964:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32418:x1830960573500672:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140880.953162:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:32418:x1830960573500672:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 198us (352us total) trans 8589944867 rc 0/0 00000100:00100000:1.0:1746140880.953169:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4624 00000100:00100000:0.0:1746140880.954290:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.954348:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.954407:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.954450:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573501056 00000100:00100000:0.0:1746140880.954456:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573501056 00000100:00100000:0.0:1746140880.954486:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16340 00000100:00100000:0.0:1746140880.954493:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573501056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140880.954504:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140880.954518:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d0b1400/0x8156357b7fdb8ca4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ae0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140880.954554:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575959168:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140880.954613:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa540 going to sleep for 11 seconds 00000100:00100000:1.0:1746140880.956198:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575959168:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140880.956215:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d0b1400/0x8156357b7fdb8ca4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ae0 expref: 33 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.956225:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d0b1400/0x8156357b7fdb8ca4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ae0 expref: 33 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.956235:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d0b1400, rc 0) 00000100:00100000:1.0:1746140880.956565:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573501056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2071us (2214us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140880.956573:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16340 00000100:00100000:0.0:1746140880.961645:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.961709:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573501184 00000100:00100000:1.0:1746140880.961720:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573501184 00010000:00010000:1.0:1746140880.961759:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee600/0x8156357b7fdb8c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a69 expref: 32 pid: 8460 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140880.961801:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8466 00000100:00100000:1.0:1746140880.961810:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573501184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140880.961822:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140880.961847:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee600/0x8156357b7fdb8c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a69 expref: 32 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140880.961858:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee600/0x8156357b7fdb8c03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a69 expref: 32 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140880.961885:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2ee600/0x8156357b7fdb8c03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a69 expref: 32 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140880.962018:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.962020:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.962027:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb8c88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ac4 expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.962035:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb8c88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ac4 expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.962069:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb8c88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ac4 expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.962082:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960575959424:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140880.962651:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.962752:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140880.963406:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573501568 00000100:00100000:1.0:1746140880.963410:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573501568 00000100:00100000:0.0:1746140880.963412:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573501440 00000100:00100000:0.0:1746140880.963416:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573501440 00000100:00100000:1.0:1746140880.963436:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16343 00000100:00100000:1.0:1746140880.963442:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573501568:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140880.963444:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16344 00010000:00010000:1.0:1746140880.963448:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140880.963450:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573501440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.963458:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f19400/0x8156357b7fdb8cb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0af5 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140880.963461:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.963469:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140880.963470:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140880.963474:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d0b0200/0x8156357b7fdb8cb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0aee expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.963477:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f19400/0x8156357b7fdb8cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0af5 expref: 33 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.963490:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092f19400/0x8156357b7fdb8cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0af5 expref: 33 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140880.963498:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f19400, rc 0) 00000100:00100000:0.0:1746140880.963503:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575959680:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140880.963529:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573501568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 87us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.963535:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16343 00000100:00100000:0.0:1746140880.963544:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa540 going to sleep for 11 seconds 00000100:00100000:1.0:1746140880.964927:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960575959424:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140880.964937:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140880.964957:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575959680:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140880.964966:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573501184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3159us (3333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.964972:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8466 00010000:00010000:0.0:1746140880.964978:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d0b0200/0x8156357b7fdb8cb9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0aee expref: 32 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.964988:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d0b0200/0x8156357b7fdb8cb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0aee expref: 32 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.965007:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d0b0200, rc 0) 00000100:00100000:0.0:1746140880.965030:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573501440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1580us (1670us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140880.965037:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16344 00000100:00100000:0.0:1746140880.968540:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.968811:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.968842:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.968875:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8406 00000100:00100000:0.0:1746140880.968882:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573502080:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140880.972146:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.973278:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573502464 00000100:00100000:0.0:1746140880.973288:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573502464 00000100:00100000:1.0:1746140880.973905:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16345 00000100:00100000:1.0:1746140880.973915:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:32425:x1830960573502464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.973932:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.973949:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f19c00/0x8156357b7fdb8cc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0afc expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.973978:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2400/0x8156357b7fdb8c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0abd expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.973985:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140880.973986:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140880.973989:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f19c00/0x8156357b7fdb8cc0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0afc expref: 32 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.974019:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2400/0x8156357b7fdb8c81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0abd expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.974032:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2400/0x8156357b7fdb8c81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0abd expref: 25 pid: 32377 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140880.974043:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575959808:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140880.974120:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140880.975352:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575959808:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140880.975377:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f19c00/0x8156357b7fdb8cc0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0afc expref: 32 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140880.975391:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f19c00, rc 0) 00000100:00100000:1.0:1746140880.975419:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:32425:x1830960573502464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1506us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140880.975427:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16345 00000100:00100000:0.0:1746140880.976936:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.977653:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573502080:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8770us (8840us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140880.977660:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8406 00002000:00100000:1.0:1746140880.977666:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012bf11880 x1830960573502080/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:296/0 lens 488/440 e 0 to 0 dl 1746140891 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140880.977674:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11880 with x1830960573502080 ext(3145728->4194303) 00002000:00010000:1.0:1746140880.977677:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf11880 00000100:00100000:0.0:1746140880.990786:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140880.990850:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140880.990905:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573502720 00000100:00100000:1.0:1746140880.990915:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573502720 00000100:00100000:1.0:1746140880.990971:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16346 00000100:00100000:1.0:1746140880.990977:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573502720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140880.990993:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140880.991006:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f19800/0x8156357b7fdb8cc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0b03 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140880.991057:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575959936:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140880.991129:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140880.996194:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140880.996931:0:32377:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff88009edcad80 x1830960575959936) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2400/0x8156357b7fdb8c81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0abd expref: 27 pid: 32377 timeout: 960 lvb_type: 0 00010000:00010000:0.0:1746140880.996961:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2400/0x8156357b7fdb8c81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0abd expref: 27 pid: 32377 timeout: 960 lvb_type: 0 00000100:00100000:0.0:1746140880.996987:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575959936:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140880.997012:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f19800/0x8156357b7fdb8cc7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b03 expref: 26 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.997032:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f19800/0x8156357b7fdb8cc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b03 expref: 26 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140880.997039:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f19800, rc 0) 00000100:00100000:0.0:1746140880.997083:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1983:x1830960573502720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6105us (6307us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140880.997089:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16346 00000100:00100000:0.0:1746140880.998800:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.001951:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.002401:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573503488 00000100:00100000:0.0:1746140881.002411:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573503488 00002000:00100000:0.0:1746140881.002454:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009edca300 x1830960573503488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.002464:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca300 with x1830960573503488 ext(4194304->4886527) 00002000:00010000:0.0:1746140881.002474:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edca300 00000100:00100000:0.0:1746140881.002511:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8409 00000100:00100000:0.0:1746140881.002519:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1983:x1830960573503488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140881.006233:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.006260:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.006607:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.006779:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573503616 00000100:00100000:1.0:1746140881.006786:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.006788:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573503616 00000100:00100000:1.0:1746140881.006801:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573503744 00000100:00100000:1.0:1746140881.006803:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573503744 00000100:00100000:0.0:1746140881.006834:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573504000 00000100:00100000:0.0:1746140881.006836:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573504000 00000100:00100000:1.0:1746140881.006841:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573503872 00000100:00100000:1.0:1746140881.006843:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573503872 00000100:00100000:0.0:1746140881.006850:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16347 00000100:00100000:0.0:1746140881.006857:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573503616:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140881.006873:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.006889:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d0b1e00/0x8156357b7fdb8cea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0b11 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.006913:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.006915:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.006923:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0b1e00/0x8156357b7fdb8cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b11 expref: 8 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140881.006938:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d0b1e00/0x8156357b7fdb8cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b11 expref: 8 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140881.006950:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d0b1e00, rc 0) 00000100:00100000:0.0:1746140881.007003:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573503616:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 148us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.007008:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16347 00000100:00100000:0.0:1746140881.007047:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.007060:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573504128 00000100:00100000:0.0:1746140881.007063:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573504128 00000100:00100000:0.0:1746140881.013866:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1983:x1830960573503488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11347us (11925us total) trans 0 rc 692224/692224 00000100:00100000:0.0:1746140881.013878:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8409 00002000:00100000:0.0:1746140881.013891:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009edca300 x1830960573503488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.013900:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edca300 with x1830960573503488 ext(4194304->4886527) 00002000:00010000:0.0:1746140881.013904:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edca300 00000100:00100000:0.0:1746140881.015677:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.015718:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.017183:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.017243:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.017529:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.020654:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.020736:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.020815:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573505536 00000100:00100000:1.0:1746140881.020821:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573505536 00000100:00100000:1.0:1746140881.020856:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16354 00000100:00100000:1.0:1746140881.020867:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32422:x1830960573505536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140881.020881:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.020893:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0b57 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.020912:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140881.020914:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140881.020917:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4882432->5242879] (req 4882432->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b57 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.020925:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4882432->5242879] (req 4882432->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b57 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.020932:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f42ba00, rc 0) 00000100:00100000:1.0:1746140881.020956:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32422:x1830960573505536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.020961:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16354 00000100:00100000:1.0:1746140881.020979:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573505152 00000100:00100000:1.0:1746140881.020981:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573505152 00002000:00100000:1.0:1746140881.021003:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2146303) req@ffff8800a513f480 x1830960573505152/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.021012:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513f480 with x1830960573505152 ext(2097152->2146303) 00010000:00010000:1.0:1746140881.021017:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb8c8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0acb expref: 27 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.021027:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb8c8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0acb expref: 27 pid: 8460 timeout: 960 lvb_type: 0 00002000:00010000:1.0:1746140881.021033:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a513f480 00000100:00100000:1.0:1746140881.021083:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1735 00000100:00100000:1.0:1746140881.021088:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573505152:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140881.023100:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573505152:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2005us (2445us total) trans 21474841240 rc 0/0 00000100:00100000:1.0:1746140881.023109:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1735 00002000:00100000:1.0:1746140881.023116:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2146303) req@ffff8800a513f480 x1830960573505152/t21474841240(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/448 e 0 to 0 dl 1746140892 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.023124:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513f480 with x1830960573505152 ext(2097152->2146303) 00010000:00010000:1.0:1746140881.023132:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb8c8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0acb expref: 29 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.023146:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb8c8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0acb expref: 29 pid: 8460 timeout: 960 lvb_type: 0 00002000:00010000:1.0:1746140881.023152:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a513f480 00000100:00100000:0.0:1746140881.024966:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.028158:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.028795:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140881.030345:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030352:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030370:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030375:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030381:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030385:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f63ec00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140881.030389:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030398:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030407:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140881.030409:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140881.030412:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030417:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63ec00/0x8156357b7fdb8d68 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.030834:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e800/0x8156357b7fdb8d61 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b5e expref: 16 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.030842:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e800/0x8156357b7fdb8d61 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b5e expref: 16 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.030850:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63e800, rc 0) 00000100:00100000:0.0:1746140881.030884:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+15:32427:x1830960573505792:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5687us (5926us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140881.030890:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10595 00000100:00100000:1.0:1746140881.031493:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.031549:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573506304 00000100:00100000:1.0:1746140881.031555:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573506304 00002000:00100000:1.0:1746140881.031587:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff88009edc9880 x1830960573506304/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.031597:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830960573506304 ext(4882432->4886527) 00002000:00010000:1.0:1746140881.031601:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9880 00000100:00100000:1.0:1746140881.031622:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8410 00000100:00100000:1.0:1746140881.031627:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573506304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140881.031788:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573506304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 160us (294us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140881.031794:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8410 00002000:00100000:1.0:1746140881.031799:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff88009edc9880 x1830960573506304/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.031806:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830960573506304 ext(4882432->4886527) 00002000:00010000:1.0:1746140881.031808:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9880 00000100:00100000:0.0:1746140881.037111:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.037231:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573506560 00000100:00100000:1.0:1746140881.037241:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573506560 00000100:00100000:1.0:1746140881.037299:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4625 00000100:00100000:1.0:1746140881.037333:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+15:32427:x1830960573506560:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746140881.037842:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+16:32427:x1830960573506560:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 535us (743us total) trans 8589944870 rc 0/0 00000100:00100000:1.0:1746140881.037849:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4625 00000100:00100000:0.0:1746140881.038059:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.038136:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.038382:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8412 00000100:00100000:0.0:1746140881.038391:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573507072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140881.040633:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.041029:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.041692:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8414 00000100:00100000:1.0:1746140881.041699:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573507584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140881.050116:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.050269:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573507712 00000100:00100000:1.0:1746140881.050280:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573507712 00000100:00100000:1.0:1746140881.050356:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16355 00000100:00100000:1.0:1746140881.050365:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32429:x1830960573507712:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140881.050381:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.050398:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f42b400/0x8156357b7fdb8d6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0b65 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.050426:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f977c00/0x8156357b7fdb8a43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a093c expref: 37 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.050436:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a68dfc00/0x8156357b7fdb8b8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a15 expref: 7 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.050443:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092725600/0x8156357b7fdb8a6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a096d expref: 25 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.050449:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.050450:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.050453:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f42b400/0x8156357b7fdb8d6f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1552384->2064383] (req 1552384->2064383) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b65 expref: 37 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.050482:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092725600/0x8156357b7fdb8a6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a096d expref: 25 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.050495:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092725600/0x8156357b7fdb8a6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a096d expref: 25 pid: 4782 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.050506:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575961088:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.050588:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a68dfc00/0x8156357b7fdb8b8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a15 expref: 7 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.050597:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a68dfc00/0x8156357b7fdb8b8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a15 expref: 7 pid: 4785 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.050605:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edcaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575961216:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.050630:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f977c00/0x8156357b7fdb8a43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a093c expref: 37 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.050637:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f977c00/0x8156357b7fdb8a43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a093c expref: 37 pid: 4785 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.050645:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960575961344:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.050663:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140881.054698:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573507072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16306us (16558us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140881.054708:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8412 00002000:00100000:1.0:1746140881.054717:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a513c000 x1830960573507072/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.054726:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513c000 with x1830960573507072 ext(3145728->4194303) 00002000:00010000:1.0:1746140881.054731:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513c000 00000100:00100000:0.0:1746140881.057550:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.057585:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.057608:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.059433:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573507584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17594us (18263us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140881.059444:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8414 00002000:00100000:0.0:1746140881.059456:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8800a513ce00 x1830960573507584/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.059466:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ce00 with x1830960573507584 ext(3145728->4194303) 00002000:00010000:0.0:1746140881.059471:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513ce00 00000100:00100000:1.0:1746140881.063404:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.063447:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573508352 00000100:00100000:0.0:1746140881.063454:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573508352 00002000:00100000:0.0:1746140881.063487:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a8:0x0] (1552384->1556479) req@ffff88009edc8700 x1830960573508352/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.063495:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8700 with x1830960573508352 ext(1552384->1556479) 00002000:00010000:0.0:1746140881.063498:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc8700 00000100:00100000:0.0:1746140881.063513:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8415 00000100:00100000:0.0:1746140881.063519:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573508352:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140881.063887:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573508352:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 368us (483us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140881.063893:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8415 00002000:00100000:0.0:1746140881.063899:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3a8:0x0] (1552384->1556479) req@ffff88009edc8700 x1830960573508352/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.063911:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8700 with x1830960573508352 ext(1552384->1556479) 00002000:00010000:0.0:1746140881.063914:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc8700 00000100:00100000:0.0:1746140881.073040:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.075049:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.078529:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.079588:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573509120 00000100:00100000:0.0:1746140881.079598:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573509120 00000100:00100000:0.0:1746140881.079654:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4626 00000100:00100000:0.0:1746140881.079662:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a97b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:32429:x1830960573509120:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746140881.079883:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a97b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:32429:x1830960573509120:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 221us (1359us total) trans 8589944871 rc 0/0 00000100:00100000:0.0:1746140881.079890:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4626 00000100:00100000:0.0:1746140881.174869:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.205273:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.210781:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.217133:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.218160:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.222295:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.230153:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.254904:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.263177:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.267150:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.275775:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.280636:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.280687:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.306951:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.307057:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.307141:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573511936 00000100:00100000:1.0:1746140881.307152:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573511936 00000100:00100000:1.0:1746140881.307232:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16360 00000100:00100000:1.0:1746140881.307239:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573511936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140881.307253:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.307268:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8dbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0b96 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.307344:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575962496:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140881.307412:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.307420:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140881.307528:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573512704 00000100:00100000:0.0:1746140881.307531:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573512704 00002000:00100000:0.0:1746140881.307544:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3653631) req@ffff880093132a00 x1830960573512704/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 504/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.307551:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093132a00 with x1830960573512704 ext(2097152->3653631) 00002000:00010000:0.0:1746140881.307553:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093132a00 00000100:00100000:0.0:1746140881.307573:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8422 00000100:00100000:0.0:1746140881.307580:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1983:x1830960573512192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140881.307899:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.307918:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573512960 00000100:00100000:1.0:1746140881.307923:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573512960 00002000:00100000:1.0:1746140881.307943:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3653632->4194303) req@ffff88009fc0aa00 x1830960573512960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.307951:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0aa00 with x1830960573512960 ext(3653632->4194303) 00002000:00010000:1.0:1746140881.307955:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc0aa00 00000100:00100000:1.0:1746140881.307968:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8425 00000100:00100000:1.0:1746140881.307973:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573512960:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:1.0:1746140881.308877:0:8460:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140881 -> 1746140882 00000100:00100000:1.0:1746140881.308888:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575962496:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140881.308908:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8dbc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b96 expref: 34 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.308916:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8dbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b96 expref: 34 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.308931:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f42b200, rc 0) 00000100:00100000:1.0:1746140881.309075:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573511936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1836us (2017us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140881.309082:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16360 00000100:00100000:0.0:1746140881.323444:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.323711:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573512960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15736us (15811us total) trans 0 rc 540672/540672 00000100:00100000:1.0:1746140881.323718:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8425 00002000:00100000:1.0:1746140881.323722:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3653632->4194303) req@ffff88009fc0aa00 x1830960573512960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.323728:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0aa00 with x1830960573512960 ext(3653632->4194303) 00002000:00010000:1.0:1746140881.323731:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc0aa00 00000100:00100000:0.0:1746140881.331119:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.342415:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.345253:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.355602:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.361278:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.361648:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.361704:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.362348:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.362399:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573514368 00000100:00100000:1.0:1746140881.362402:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573514368 00010000:00010000:1.0:1746140881.362417:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fda8e00/0x8156357b7fdb8da0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b7a expref: 28 pid: 32376 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.362612:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8482 00000100:00100000:1.0:1746140881.362620:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573514368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.362628:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.362640:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fda8e00/0x8156357b7fdb8da0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b7a expref: 28 pid: 32376 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.362655:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fda8e00/0x8156357b7fdb8da0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2813951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b7a expref: 28 pid: 32376 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.362669:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fda8e00/0x8156357b7fdb8da0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2813951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b7a expref: 28 pid: 32376 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.362695:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.362697:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.362703:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3c00/0x8156357b7fdb8dc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b9d expref: 33 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.362710:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3c00/0x8156357b7fdb8dc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b9d expref: 33 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.362731:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f3c00/0x8156357b7fdb8dc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b9d expref: 33 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.362741:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009edc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960575963264:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.362792:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140881.363200:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.363856:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009edc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960575963264:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.363864:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.363879:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573514368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1262us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.363884:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8482 00000100:00100000:0.0:1746140881.370485:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.370529:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.370577:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.371004:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8430 00000100:00100000:1.0:1746140881.371014:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573515008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140881.376123:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573515392 00000100:00100000:1.0:1746140881.376132:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573515392 00010000:00010000:1.0:1746140881.376195:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fda9000/0x8156357b7fdb8db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b8f expref: 39 pid: 32376 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.376222:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573515520 00000100:00100000:1.0:1746140881.376224:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573515520 00010000:00010000:1.0:1746140881.376234:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fda8200/0x8156357b7fdb8dae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b88 expref: 26 pid: 32376 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.376248:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8483 00000100:00100000:1.0:1746140881.376254:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1982:x1830960573515392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.376266:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.376287:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fda9000/0x8156357b7fdb8db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b8f expref: 39 pid: 32376 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.376298:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fda9000/0x8156357b7fdb8db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b8f expref: 39 pid: 32376 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.376334:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fda9000/0x8156357b7fdb8db5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b8f expref: 39 pid: 32376 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.376354:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.376395:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573515392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 140us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.376404:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8483 00000100:00100000:0.0:1746140881.380953:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.383759:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.383957:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573515008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12943us (13425us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140881.383967:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8430 00002000:00100000:1.0:1746140881.383976:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009fc0a680 x1830960573515008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.383985:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0a680 with x1830960573515008 ext(3145728->4194303) 00002000:00010000:1.0:1746140881.383990:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc0a680 00000100:00100000:1.0:1746140881.386301:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.386407:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573516032 00000100:00100000:0.0:1746140881.386416:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573516032 00002000:00100000:0.0:1746140881.386781:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1445887) req@ffff88008f078700 x1830960573516032/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.386789:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f078700 with x1830960573516032 ext(1048576->1445887) 00010000:00010000:0.0:1746140881.386796:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936f2e00/0x8156357b7fdb8dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bab expref: 34 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:0.0:1746140881.386808:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936f2e00/0x8156357b7fdb8dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bab expref: 34 pid: 8460 timeout: 960 lvb_type: 0 00002000:00010000:0.0:1746140881.386815:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f078700 00000100:00100000:0.0:1746140881.386831:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1738 00000100:00100000:0.0:1746140881.386837:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573516032:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140881.387660:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.392148:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573516032:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5306us (5851us total) trans 17179873971 rc 0/0 00000100:00100000:1.0:1746140881.392158:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1738 00002000:00100000:1.0:1746140881.392176:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1445887) req@ffff88008f078700 x1830960573516032/t17179873971(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/448 e 0 to 0 dl 1746140892 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.392185:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f078700 with x1830960573516032 ext(1048576->1445887) 00010000:00010000:1.0:1746140881.392193:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936f2e00/0x8156357b7fdb8dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bab expref: 36 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.392208:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936f2e00/0x8156357b7fdb8dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bab expref: 36 pid: 8460 timeout: 960 lvb_type: 0 00002000:00010000:1.0:1746140881.392215:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f078700 00000100:00100000:0.0:1746140881.394108:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.394732:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.396484:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.396544:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573516672 00000100:00100000:1.0:1746140881.396556:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573516672 00002000:00100000:1.0:1746140881.396603:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1368064->1372159) req@ffff88009abde300 x1830960573516672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.396612:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abde300 with x1830960573516672 ext(1368064->1372159) 00002000:00010000:1.0:1746140881.396617:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abde300 00000100:00100000:1.0:1746140881.396650:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8432 00000100:00100000:1.0:1746140881.396656:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573516672:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140881.396811:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573516672:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 154us (328us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140881.396817:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8432 00002000:00100000:1.0:1746140881.396822:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1368064->1372159) req@ffff88009abde300 x1830960573516672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.396829:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abde300 with x1830960573516672 ext(1368064->1372159) 00002000:00010000:1.0:1746140881.396831:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abde300 00000100:00100000:0.0:1746140881.397413:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.402430:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.402503:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573517056 00000100:00100000:1.0:1746140881.402513:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573517056 00002000:00100000:1.0:1746140881.402556:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1810432->1814527) req@ffff88009abdfb80 x1830960573517056/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.402567:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdfb80 with x1830960573517056 ext(1810432->1814527) 00002000:00010000:1.0:1746140881.402572:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdfb80 00000100:00100000:1.0:1746140881.402606:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8433 00000100:00100000:1.0:1746140881.402614:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573517056:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140881.402800:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573517056:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 186us (380us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140881.402810:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8433 00002000:00100000:1.0:1746140881.402816:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1810432->1814527) req@ffff88009abdfb80 x1830960573517056/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.402823:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdfb80 with x1830960573517056 ext(1810432->1814527) 00002000:00010000:1.0:1746140881.402826:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdfb80 00000100:00100000:0.0:1746140881.411973:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.414176:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.414212:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.414262:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573517696 00000100:00100000:1.0:1746140881.414266:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573517696 00000100:00100000:0.0:1746140881.416233:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.416269:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.418454:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.419594:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.419624:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.419650:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.419822:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16371 00000100:00100000:0.0:1746140881.419830:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573518464:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140881.419837:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.419845:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb8e25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0bea expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.419857:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.419858:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.419863:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb8e25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bea expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140881.419876:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb8e25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bea expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140881.419884:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009272de00, rc 0) 00000100:00100000:0.0:1746140881.419913:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573518464:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.419918:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16371 00000100:00100000:0.0:1746140881.425601:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.430212:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.434429:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.434541:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.443059:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.446489:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.446525:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.446556:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.446569:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.446589:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.446622:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.446771:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573519872 00000100:00100000:1.0:1746140881.446775:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573519872 00000100:00100000:0.0:1746140881.446807:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16376 00000100:00100000:0.0:1746140881.446813:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573520000:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746140881.446830:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009272d400/0x8156357b7fdb8e64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.446843:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e600/0x8156357b7fdb8d30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b3b expref: 32 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.446849:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef400/0x8156357b7fdb8e1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0be3 expref: 10 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140881.446857:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b57 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.446861:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.446862:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.446863:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009272d400/0x8156357b7fdb8e64 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.446880:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b57 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.446888:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b57 expref: 27 pid: 32376 timeout: 960 lvb_type: 0 00000100:00100000:0.0:1746140881.446897:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575965312:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140881.446951:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef400/0x8156357b7fdb8e1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0be3 expref: 10 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140881.446956:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef400/0x8156357b7fdb8e1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0be3 expref: 10 pid: 8459 timeout: 960 lvb_type: 1 00000100:00100000:0.0:1746140881.446960:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575965696:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.447413:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16377 00000100:00100000:1.0:1746140881.447420:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573519616:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746140881.447436:0:24958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.447446:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3a00/0x8156357b7fdb8dca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ba4 expref: 34 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.447451:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140881.448407:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140881.448410:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.448428:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f3a00/0x8156357b7fdb8dca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ba4 expref: 34 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.448436:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3a00/0x8156357b7fdb8dca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ba4 expref: 34 pid: 8460 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.448444:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575966080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.448472:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473a180 going to sleep for 11 seconds 00000100:00100000:1.0:1746140881.448489:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16379 00000100:00100000:1.0:1746140881.448495:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573519872:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746140881.448510:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f63e600/0x8156357b7fdb8d30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b3b expref: 32 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.448513:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.448522:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f19c00/0x8156357b7fdb8cc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0afc expref: 32 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.448526:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f63e600/0x8156357b7fdb8d30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b3b expref: 32 pid: 4784 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.448529:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f3800/0x8156357b7fdb8d29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b49 expref: 27 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.448534:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb8cf1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b1f expref: 10 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140881.448535:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575966208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.448539:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.448541:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.448543:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.448554:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fae40 going to sleep for 11 seconds 00010000:00010000:1.0:1746140881.448555:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb8cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b1f expref: 10 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.448562:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb8cf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b1f expref: 10 pid: 8459 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.448569:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575966336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.448590:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c9f3800/0x8156357b7fdb8d29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b49 expref: 27 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.448597:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c9f3800/0x8156357b7fdb8d29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b49 expref: 27 pid: 8459 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.448604:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575966464:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.448622:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092f19c00/0x8156357b7fdb8cc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0afc expref: 32 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.448630:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092f19c00/0x8156357b7fdb8cc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0afc expref: 32 pid: 32377 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.448637:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575966592:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.448653:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140881.453607:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.453669:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575966336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.453677:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575966464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.453683:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960575966592:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.453701:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.453719:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575966080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.453727:0:24958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.453748:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573520256 00000100:00100000:1.0:1746140881.453754:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573520256 00002000:00100000:1.0:1746140881.453796:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1368064->1814527) req@ffff88009abddf80 x1830960573520256/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.453804:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abddf80 with x1830960573520256 ext(1368064->1814527) 00010000:00010000:1.0:1746140881.453810:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3400/0x8156357b7fdb8dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bb2 expref: 26 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.453818:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3400/0x8156357b7fdb8dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bb2 expref: 26 pid: 8460 timeout: 960 lvb_type: 0 00002000:00010000:1.0:1746140881.453823:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009abddf80 00000100:00100000:1.0:1746140881.453846:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1739 00000100:00100000:1.0:1746140881.453853:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573520256:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140881.458059:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.458098:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.458121:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.458136:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.458160:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573520384 00000100:00100000:0.0:1746140881.458181:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573520384 00010000:00010000:0.0:1746140881.458220:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb8e25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bea expref: 9 pid: 8458 timeout: 960 lvb_type: 1 00000100:00100000:0.0:1746140881.458244:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573520896 00000100:00100000:0.0:1746140881.458247:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573520896 00000100:00100000:1.0:1746140881.458250:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573520640 00000100:00100000:1.0:1746140881.458255:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573520640 00010000:00010000:0.0:1746140881.458258:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0b1e00/0x8156357b7fdb8cea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b11 expref: 11 pid: 32377 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.458270:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2ef400/0x8156357b7fdb8e1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0be3 expref: 12 pid: 8459 timeout: 960 lvb_type: 1 00000100:00100000:0.0:1746140881.458271:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8490 00000100:00100000:0.0:1746140881.458278:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573521152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140881.458284:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8491 00000100:00100000:1.0:1746140881.458289:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960573520896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140881.458291:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.458296:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.458331:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d0b1e00/0x8156357b7fdb8cea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b11 expref: 12 pid: 32377 timeout: 960 lvb_type: 1 00010000:00010000:0.0:1746140881.458331:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b57 expref: 28 pid: 32376 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.458342:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d0b1e00/0x8156357b7fdb8cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b11 expref: 12 pid: 32377 timeout: 960 lvb_type: 1 00010000:00010000:0.0:1746140881.458345:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b57 expref: 28 pid: 32376 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.458359:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d0b1e00/0x8156357b7fdb8cea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b11 expref: 12 pid: 32377 timeout: 960 lvb_type: 1 00010000:00010000:0.0:1746140881.458359:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f42ba00/0x8156357b7fdb8d37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b57 expref: 28 pid: 32376 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.458377:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140881.458377:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.458418:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573520896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.458418:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573521152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.458429:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8491 00000100:00100000:0.0:1746140881.458432:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8490 00000100:00100000:0.0:1746140881.458475:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.458512:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573521024 00000100:00100000:1.0:1746140881.458516:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573521024 00000100:00100000:0.0:1746140881.458520:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.458528:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb8c57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a8c expref: 27 pid: 32376 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.458540:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8493 00000100:00100000:0.0:1746140881.458540:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.458545:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573521024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.458554:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140881.458559:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.458560:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb8c57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a8c expref: 27 pid: 32376 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.458567:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb8c57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a8c expref: 27 pid: 32376 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.458575:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb8c57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a8c expref: 27 pid: 32376 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.458587:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140881.458597:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.458602:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573521024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.458608:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8493 00000100:00100000:1.0:1746140881.458618:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573520768 00000100:00100000:1.0:1746140881.458620:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573520768 00010000:00010000:1.0:1746140881.458629:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3c00/0x8156357b7fdb8dc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b9d expref: 35 pid: 8460 timeout: 960 lvb_type: 0 00000100:00100000:0.0:1746140881.458629:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.458637:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573521280 00000100:00100000:1.0:1746140881.458638:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573521280 00000100:00100000:0.0:1746140881.458638:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.458647:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb8cf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b1f expref: 9 pid: 8459 timeout: 960 lvb_type: 1 00000100:00100000:0.0:1746140881.458656:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.458838:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8496 00000100:00100000:1.0:1746140881.458843:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573520768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.458850:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.458861:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3c00/0x8156357b7fdb8dc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b9d expref: 36 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.458869:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936f3c00/0x8156357b7fdb8dc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b9d expref: 36 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.458881:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3c00/0x8156357b7fdb8dc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b9d expref: 36 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.458889:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.458891:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.458894:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.458901:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.458924:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.458936:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573520768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.458942:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8496 00000100:00100000:1.0:1746140881.458951:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8499 00000100:00100000:1.0:1746140881.458955:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573521280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.458961:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.458969:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb8cf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b1f expref: 7 pid: 8459 timeout: 960 lvb_type: 1 00010000:00010000:0.0:1746140881.459178:0:4782:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.459187:0:4782:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.459200:0:4782:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.459210:0:4782:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.459215:0:4782:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.459219:0:4782:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2ef200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140881.459222:0:4782:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.459227:0:4782:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459230:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb8cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b1f expref: 7 pid: 8459 timeout: 960 lvb_type: 1 00010000:00010000:0.0:1746140881.459236:0:4782:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.459242:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2ef200/0x8156357b7fdb8e80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459390:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb8cf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0b1f expref: 7 pid: 8459 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.459400:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.459402:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.459405:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459411:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459424:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140881.459594:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573520128:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11309us (12970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.459599:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573521280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 642us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.459601:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16378 00000100:00100000:1.0:1746140881.459609:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8499 00010000:00010000:1.0:1746140881.459628:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459636:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459649:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459655:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459666:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459671:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f42b000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140881.459673:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459679:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459686:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.459691:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f42b000/0x8156357b7fdb8e87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.459718:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960573519872:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11223us (13128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.459724:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16379 00000100:00100000:1.0:1746140881.463714:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573520256:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9849us (10095us total) trans 17179873972 rc 0/0 00000100:00100000:1.0:1746140881.463726:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1739 00002000:00100000:1.0:1746140881.463738:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1368064->1814527) req@ffff88009abddf80 x1830960573520256/t17179873972(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/448 e 0 to 0 dl 1746140892 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.463747:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abddf80 with x1830960573520256 ext(1368064->1814527) 00010000:00010000:1.0:1746140881.463758:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3400/0x8156357b7fdb8dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bb2 expref: 28 pid: 8460 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.463772:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3400/0x8156357b7fdb8dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0bb2 expref: 28 pid: 8460 timeout: 960 lvb_type: 0 00002000:00010000:1.0:1746140881.463778:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009abddf80 00000100:00100000:0.0:1746140881.466866:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.471196:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.472004:0:24958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.472013:0:24958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.472031:0:24958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.472037:0:24958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.472044:0:24958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.472050:0:24958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f42b200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140881.472053:0:24958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.472059:0:24958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.472073:0:24958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.472079:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f42b200/0x8156357b7fdb8e79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.472130:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960573519616:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 24711us (25560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.472136:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16377 00000100:00100000:0.0:1746140881.473680:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.477719:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.477750:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.477783:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.477807:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.477819:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573522816 00000100:00100000:1.0:1746140881.477822:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573522816 00000100:00100000:0.0:1746140881.477832:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.477851:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573523072 00000100:00100000:1.0:1746140881.477853:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573523072 00000100:00100000:0.0:1746140881.477859:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.477873:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4629 00000100:00100000:0.0:1746140881.477877:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4630 00000100:00100000:1.0:1746140881.477879:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:11714:x1830960573522816:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746140881.477883:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:7723:x1830960573523072:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746140881.477970:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573522432 00000100:00100000:1.0:1746140881.477973:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573522432 00010000:00010000:1.0:1746140881.477986:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092994800/0x8156357b7fdb88e5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a088d expref: 286 pid: 14741 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.478002:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573523328 00000100:00100000:1.0:1746140881.478003:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573523328 00010000:00010000:1.0:1746140881.478010:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60000/0x8156357b7fdb8875 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0832 expref: 288 pid: 14742 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.478019:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573523200 00000100:00100000:1.0:1746140881.478021:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573523200 00010000:00010000:1.0:1746140881.478028:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x8156357b7fdb887c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0839 expref: 26 pid: 14743 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.478036:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8502 00000100:00100000:1.0:1746140881.478040:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:1985:x1830960573522432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.478047:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.478051:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092994800/0x8156357b7fdb88e5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a088d expref: 288 pid: 14741 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.478060:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092994800/0x8156357b7fdb88e5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a088d expref: 288 pid: 14741 timeout: 960 lvb_type: 0 00000100:00100000:0.0:1746140881.478064:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:7723:x1830960573523072:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 182us (256us total) trans 8589944878 rc 0/0 00000100:00100000:0.0:1746140881.478070:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4630 00010000:00010000:1.0:1746140881.478423:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140881.478429:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ec000/0x8156357b7fdb8e8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140881.478437:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.478452:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1985:x1830960573522432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 411us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.478477:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.478578:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8502 00000100:00100000:1.0:1746140881.478589:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573523456 00000100:00100000:1.0:1746140881.478591:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573523456 00010000:00010000:1.0:1746140881.478599:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eece400/0x8156357b7fdb886e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a082b expref: 287 pid: 14741 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.478609:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8505 00000100:00100000:1.0:1746140881.478614:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573522560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.478619:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.478623:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb896a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08c5 expref: 26 pid: 14741 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.478794:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb896a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a08c5 expref: 26 pid: 14741 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.478804:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140881.478807:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ec000/0x8156357b7fdb8e8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140881.478812:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.478824:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573522560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 211us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.478829:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8505 00000100:00100000:1.0:1746140881.478919:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:11714:x1830960573522816:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 1041us (1135us total) trans 8589944879 rc 0/0 00000100:00100000:1.0:1746140881.478925:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4629 00000100:00100000:0.0:1746140881.479475:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.480534:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.480582:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573523712 00000100:00100000:1.0:1746140881.480586:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573523712 00010000:00010000:1.0:1746140881.480602:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63f000/0x8156357b7fdb8c42 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a85 expref: 23 pid: 14743 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.480630:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8508 00000100:00100000:1.0:1746140881.480635:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573523712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.480642:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.480646:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63f000/0x8156357b7fdb8c42 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a85 expref: 23 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.480655:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63f000/0x8156357b7fdb8c42 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a85 expref: 23 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.480666:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63f000/0x8156357b7fdb8c42 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0a85 expref: 23 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.480676:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140881.480679:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ec000/0x8156357b7fdb8e8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140881.480686:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ec000/0x8156357b7fdb8e8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140881.480692:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ec000/0x8156357b7fdb8e8e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140881.480717:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.480745:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573523712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.480750:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8508 00000001:00080000:1.0:1746140881.503263:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944878 is committed 00000001:00080000:1.0:1746140881.503279:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944848 is committed 00000001:00080000:1.0:1746140881.503289:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944879 is committed 00000001:00080000:1.0:1746140881.503295:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944870 is committed 00000001:00080000:1.0:1746140881.503322:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944880 is committed 00000004:00080000:1.0:1746140881.503327:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2604 committed 00000004:00080000:1.0:1746140881.503334:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2567 committed 00000004:00080000:1.0:1746140881.503339:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2566 committed 00000004:00080000:1.0:1746140881.503341:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2565 committed 00000004:00080000:1.0:1746140881.503343:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2564 committed 00000004:00080000:1.0:1746140881.503345:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2603 committed 00000004:00080000:1.0:1746140881.503347:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2563 committed 00000004:00080000:1.0:1746140881.503349:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2602 committed 00000004:00080000:1.0:1746140881.503351:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2562 committed 00000004:00080000:1.0:1746140881.503352:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2601 committed 00000004:00080000:1.0:1746140881.503354:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2600 committed 00000004:00080000:1.0:1746140881.503359:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2599 committed 00000004:00080000:1.0:1746140881.503361:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2561 committed 00000004:00080000:1.0:1746140881.503362:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2560 committed 00000004:00080000:1.0:1746140881.503363:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2598 committed 00000004:00080000:1.0:1746140881.503365:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2597 committed 00000004:00080000:1.0:1746140881.503367:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2559 committed 00000100:00100000:1.0:1746140881.503608:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575968000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.503682:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.503684:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575967872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.503707:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.503713:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575968512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.503720:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575968384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.503729:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.503733:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.503751:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575968000 00000100:00100000:1.0:1746140881.503758:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575968000 00000100:00100000:1.0:1746140881.503791:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575967872 00000100:00100000:1.0:1746140881.503792:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575967872 00000100:00100000:1.0:1746140881.503802:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575968512 00000100:00100000:1.0:1746140881.503804:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575968512 00000100:00100000:1.0:1746140881.503812:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575968384 00000100:00100000:1.0:1746140881.503813:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575968384 00000100:00100000:1.0:1746140881.503824:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16380 00000100:00100000:1.0:1746140881.503829:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3313:x1830960575968000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.503848:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575968128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.503865:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.503875:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575968640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.503888:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.503899:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746140881.503903:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575968256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.503916:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.503926:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575968768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.503938:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.503949:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575969152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.503964:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.503973:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575969664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.503989:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575968128 00000100:00100000:0.0:1746140881.503992:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575968128 00000100:00100000:0.0:1746140881.504003:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575968640 00000100:00100000:0.0:1746140881.504005:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575968640 00000100:00100000:1.0:1746140881.504009:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3313:x1830960575968000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (327us total) trans 17179873974 rc 0/0 00000100:00100000:0.0:1746140881.504010:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575968256 00000100:00100000:0.0:1746140881.504012:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575968256 00000100:00100000:1.0:1746140881.504015:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16380 00000100:00100000:0.0:1746140881.504019:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575968768 00000100:00100000:0.0:1746140881.504020:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575968768 00000100:00100000:1.0:1746140881.504023:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575969152 00000100:00100000:1.0:1746140881.504024:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575969152 00000100:00100000:0.0:1746140881.504026:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575969280 00000100:00100000:0.0:1746140881.504028:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575969280 00000100:00100000:1.0:1746140881.504036:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575969792 00000100:00100000:1.0:1746140881.504038:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575969792 00000100:00100000:0.0:1746140881.504038:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16381 00000100:00100000:0.0:1746140881.504043:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3312:x1830960575967872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.504054:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16383 00000100:00100000:1.0:1746140881.504058:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3312:x1830960575968384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.504117:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16385 00000100:00100000:1.0:1746140881.504121:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960575968640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.504136:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3312:x1830960575967872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (428us total) trans 17179873975 rc 0/0 00000100:00100000:0.0:1746140881.504141:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16381 00000100:00100000:0.0:1746140881.504149:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386 00000100:00100000:0.0:1746140881.504153:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960575968256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.504198:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16387 00000100:00100000:1.0:1746140881.504203:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960575968768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.504744:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575969024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.504767:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.504781:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575969536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.504795:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.504819:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575969024 00000100:00100000:0.0:1746140881.504822:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575969024 00000004:00080000:1.0:1746140881.504828:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f078a80/2, rc 0, transno 17179873974 00000100:00100000:1.0:1746140881.504833:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575968000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.504837:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575969536 00000100:00100000:1.0:1746140881.504839:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746140881.504839:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575969536 00000100:00100000:1.0:1746140881.504842:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575968896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.504848:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16391 00000100:00100000:0.0:1746140881.504852:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3313:x1830960575969024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.504856:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.504866:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575969408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.504877:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.504893:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16392 00000100:00100000:1.0:1746140881.504898:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3313:x1830960575969536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.504943:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3313:x1830960575969024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (175us total) trans 21474841244 rc 0/0 00000100:00100000:0.0:1746140881.504948:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16391 00000100:00100000:0.0:1746140881.504957:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16394 00000100:00100000:0.0:1746140881.504962:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3313:x1830960575969408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.504978:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.504986:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3313:x1830960575969536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (189us total) trans 21474841245 rc 0/0 00000100:00100000:1.0:1746140881.504990:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16392 00000004:00080000:0.0:1746140881.504996:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f079880/2, rc 0, transno 17179873977 00000100:00100000:1.0:1746140881.504998:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575969664 00000100:00100000:0.0:1746140881.504999:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575968128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.505000:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575969664 00000004:00080000:0.0:1746140881.505009:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0dc00/2, rc 0, transno 21474841241 00000100:00100000:1.0:1746140881.505010:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16395 00000100:00100000:0.0:1746140881.505012:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575969152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.505014:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3310:x1830960575969664:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140881.505029:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07a300/2, rc 0, transno 17179873975 00000100:00100000:0.0:1746140881.505032:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575967872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140881.505080:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0d500/2, rc 0, transno 21474841246 00000100:00100000:1.0:1746140881.505083:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575968896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140881.505090:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0ea00/2, rc 0, transno 21474841247 00000100:00100000:1.0:1746140881.505093:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575969408:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140881.505097:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0ed80/2, rc 0, transno 21474841244 00000100:00100000:1.0:1746140881.505100:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575969024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140881.505104:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0e300/2, rc 0, transno 21474841245 00000100:00100000:1.0:1746140881.505106:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575969536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.506169:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746140881.506179:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575969920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.506206:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.506273:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3312:x1830960575968384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2214us (2537us total) trans 17179873976 rc 0/0 00000100:00100000:1.0:1746140881.506278:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16383 00000100:00100000:1.0:1746140881.506287:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575969920 00000100:00100000:1.0:1746140881.506290:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575969920 00000100:00100000:1.0:1746140881.506323:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16396 00000100:00100000:1.0:1746140881.506328:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3313:x1830960575969920:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140881.506543:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0d180/2, rc 0, transno 21474841248 00000100:00100000:0.0:1746140881.506548:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575969664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140881.506558:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baf480/2, rc 0, transno 17179873978 00000100:00100000:0.0:1746140881.506562:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575968640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140881.506577:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07ad80/2, rc 0, transno 17179873976 00000100:00100000:0.0:1746140881.506580:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575968384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.506594:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3313:x1830960575969920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 266us (387us total) trans 21474841249 rc 0/0 00000100:00100000:1.0:1746140881.506599:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16396 00000004:00080000:0.0:1746140881.506604:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0ce00/2, rc 0, transno 21474841249 00000100:00100000:0.0:1746140881.506607:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575969920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.506696:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3310:x1830960575968768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2492us (2756us total) trans 17179873981 rc 0/0 00000100:00100000:1.0:1746140881.506702:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16387 00000100:00100000:1.0:1746140881.506753:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3313:x1830960575968512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2704us (3022us total) trans 17179873979 rc 0/0 00000100:00100000:1.0:1746140881.506758:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16382 00000004:00080000:0.0:1746140881.507074:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f078e00/2, rc 0, transno 17179873979 00000100:00100000:0.0:1746140881.507082:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575968512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140881.507094:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07bb80/2, rc 0, transno 17179873980 00000100:00100000:0.0:1746140881.507097:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575968256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140881.507107:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bad880/2, rc 0, transno 17179873981 00000100:00100000:0.0:1746140881.507109:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575968768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.507171:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573523840 00000100:00100000:0.0:1746140881.507174:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573523840 00000100:00100000:0.0:1746140881.507212:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10602 00000100:00100000:0.0:1746140881.507216:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:32452:x1830960573523840:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140881.507234:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.507249:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c0d expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.507330:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.507343:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.507360:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140881.507362:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140881.507365:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009272cc00, rc 0) 00000100:00100000:0.0:1746140881.507403:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:32452:x1830960573523840:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 186us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.507408:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10602 00000100:00100000:0.0:1746140881.510878:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.516391:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.516432:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.516444:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.516469:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.516484:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.516842:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.516843:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573524352 00000100:00100000:1.0:1746140881.516848:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573524352 00000100:00100000:1.0:1746140881.516869:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573524608 00000100:00100000:1.0:1746140881.516871:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573524608 00000100:00100000:1.0:1746140881.516897:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16397 00000100:00100000:1.0:1746140881.516905:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573524096:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140881.516921:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.516937:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c1b expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140881.516960:0:8460:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fed1, atime: 0x6813fecd, ctime: 0x6813fed1, blocks: 0x81f 00010000:00010000:1.0:1746140881.516977:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.516979:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.516986:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.517000:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.517008:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f2600, rc 0) 00000100:00100000:1.0:1746140881.517047:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573524096:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 144us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.517055:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16397 00000100:00100000:1.0:1746140881.517069:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16400 00000100:00100000:1.0:1746140881.517075:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573524480:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140881.517080:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.517089:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f2000/0x8156357b7fdb8ebf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c30 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140881.517100:0:8460:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed1, atime: 0x6813fed1, ctime: 0x6813fed1, blocks: 0x821 00010000:00010000:1.0:1746140881.517107:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.517109:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.517113:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f2000/0x8156357b7fdb8ebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c30 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.517122:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936f2000/0x8156357b7fdb8ebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c30 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.517128:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f2000, rc 0) 00000100:00100000:1.0:1746140881.517143:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573524480:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 70us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.517151:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16400 00000100:00100000:0.0:1746140881.517155:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16402 00000100:00100000:0.0:1746140881.517180:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573524736:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140881.517186:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.517194:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009272d000/0x8156357b7fdb8ec6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c3e expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140881.517207:0:4785:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fed1, atime: 0x6813fed2, ctime: 0x6813fed1, blocks: 0x102b 00010000:00010000:0.0:1746140881.517215:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.517216:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.517221:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009272d000/0x8156357b7fdb8ec6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c3e expref: 9 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140881.517230:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009272d000/0x8156357b7fdb8ec6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c3e expref: 9 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140881.517236:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009272d000, rc 0) 00000100:00100000:0.0:1746140881.517251:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573524736:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 91us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.517256:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16402 00000100:00100000:0.0:1746140881.522909:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.522964:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.523016:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573524992 00000100:00100000:1.0:1746140881.523025:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573524992 00000100:00100000:1.0:1746140881.523095:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573525248 00000100:00100000:1.0:1746140881.523098:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573525248 00000100:00100000:1.0:1746140881.523120:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8434 00000100:00100000:1.0:1746140881.523127:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573524992:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140881.523173:0:32429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.523185:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.523187:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.523190:0:32429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.523200:0:32429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.530089:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.530131:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.530186:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.530231:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.530328:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8436 00000100:00100000:0.0:1746140881.530338:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573525504:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140881.530374:0:21690:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.530380:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8438 00010000:00010000:0.0:1746140881.530388:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140881.530389:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573526016:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140881.530389:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.530393:0:21690:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.530405:0:21690:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.530406:0:8465:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.530414:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.530415:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.530418:0:8465:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.530427:0:8465:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.533673:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.535786:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.535853:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573526784 00000100:00100000:1.0:1746140881.535860:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573526784 00000100:00100000:1.0:1746140881.535905:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8441 00000100:00100000:1.0:1746140881.535912:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1982:x1830960573526784:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140881.535943:0:21640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.535956:0:21640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.535958:0:21640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.535963:0:21640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.535974:0:21640:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.541177:0:32429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.541194:0:32429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.541202:0:32429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.541207:0:32429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936f2a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140881.541211:0:32429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.541217:0:32429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.541233:0:32429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.541243:0:32429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f2a00/0x8156357b7fdb8ed4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.541271:0:21690:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.541278:0:21690:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.541283:0:21690:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.541288:0:21690:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f20000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140881.541290:0:21690:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.541296:0:21690:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.541329:0:21690:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.541335:0:21690:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f20000/0x8156357b7fdb8ee9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.541427:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+14:1982:x1830960573524992:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18296us (18526us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140881.541427:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573525504:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 11087us (11347us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140881.541436:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8436 00000100:00100000:1.0:1746140881.541463:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8434 00010000:00010000:1.0:1746140881.551051:0:8465:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.551066:0:8465:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.551072:0:8465:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.551077:0:8465:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936f3600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140881.551080:0:8465:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.551085:0:8465:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.551099:0:8465:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.551104:0:8465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8ef0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.551279:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573526016:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 20886us (21087us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140881.551288:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8438 00010000:00010000:1.0:1746140881.564638:0:21640:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.564647:0:21640:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.564653:0:21640:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.564659:0:21640:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936f3200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140881.564661:0:21640:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.564667:0:21640:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.564677:0:21640:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.564682:0:21640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdb8f05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.564727:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573526784:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 28816us (28949us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140881.564734:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8441 00000100:00100000:0.0:1746140881.567567:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140881.571133:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5200/0x8156357b7fdb8f0c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.571146:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5200/0x8156357b7fdb8f0c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.571153:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5200/0x8156357b7fdb8f0c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.571158:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cd5200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140881.571171:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5200/0x8156357b7fdb8f0c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.571178:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5200/0x8156357b7fdb8f0c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.571192:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140881.571195:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140881.571199:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5200/0x8156357b7fdb8f0c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140881.571205:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5200/0x8156357b7fdb8f0c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00000100:00100000:0.0:1746140881.571572:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573527168 00000100:00100000:0.0:1746140881.571580:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573527168 00000100:00100000:0.0:1746140881.571987:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16403 00000100:00100000:0.0:1746140881.571995:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573527168:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746140881.572191:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140881.572195:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140881 -> 1746140882 00002000:00010000:0.0:1746140881.572197:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140877 -> 1746140882 00002000:00010000:0.0:1746140881.572199:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140881 -> 1746140882 00002000:00010000:0.0:1746140881.572201:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140881.572237:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573527168:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 243us (767us total) trans 21474841250 rc 0/0 00000100:00100000:0.0:1746140881.572243:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16403 00000100:00100000:0.0:1746140881.572275:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.572353:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.572374:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.572386:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573527552 00000100:00100000:0.0:1746140881.572389:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573527552 00000100:00100000:0.0:1746140881.572958:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573527808 00000100:00100000:0.0:1746140881.572961:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573527808 00000100:00100000:0.0:1746140881.573186:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16408 00000100:00100000:0.0:1746140881.573192:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573527808:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746140881.573265:0:4785:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140881.573268:0:4785:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140881 -> 1746140882 00002000:00010000:0.0:1746140881.573271:0:4785:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140881.573272:0:4785:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140881 -> 1746140882 00002000:00010000:0.0:1746140881.573274:0:4785:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140881.573293:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573527808:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 101us (918us total) trans 17179873984 rc 0/0 00000100:00100000:0.0:1746140881.573300:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16408 00000100:00100000:0.0:1746140881.577020:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.577120:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573528064 00000100:00100000:1.0:1746140881.577129:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573528064 00000100:00100000:1.0:1746140881.577194:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4631 00000100:00100000:1.0:1746140881.577201:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a978c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32452:x1830960573528064:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:1.0:1746140881.577259:0:21104:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x31d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2eea00/0x8156357b7fdb8e56 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c06 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.577361:0:21104:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21104 initiator: MDT0 00010000:00010000:1.0:1746140881.577374:0:21104:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.577381:0:21104:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21104 initiator: MDT0 00010000:00010000:1.0:1746140881.577414:0:21104:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.577425:0:21104:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 9 pid: 14743 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.577437:0:21104:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6badf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:21104:1830960575970048:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.577525:0:21104:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719300 going to sleep for 11 seconds 00000100:00100000:1.0:1746140881.578969:0:21104:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6badf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:21104:1830960575970048:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.578988:0:21104:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00000100:00100000:0.0:1746140881.579394:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.579470:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573528192 00000100:00100000:1.0:1746140881.579476:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573528192 00010000:00010000:1.0:1746140881.579506:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 10 pid: 14743 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.579543:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8509 00000100:00100000:1.0:1746140881.579550:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573528192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.579561:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.579566:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 10 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.579576:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 10 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.579593:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272cc00/0x8156357b7fdb8e95 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c0d expref: 10 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.579623:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:1.0:1746140881.579627:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00010000:00010000:1.0:1746140881.579634:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21104 initiator: MDT0 00010000:00010000:1.0:1746140881.579641:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21104 initiator: MDT0 00010000:00010000:1.0:1746140881.579721:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.579765:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573528192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 215us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.579772:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8509 00010000:00010000:0.0:1746140881.579850:0:21104:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00010000:00010000:0.0:1746140881.579857:0:21104:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00000040:00080000:1.0:1746140881.580499:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3321, 88 off280904 00000004:00080000:1.0:1746140881.580506:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656200863ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580559:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3361, 88 off284600 00000004:00080000:1.0:1746140881.580563:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860656258291ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.580587:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3362, 88 off284688 00000004:00080000:1.0:1746140881.580590:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860656285065ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.580597:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3322, 88 off280992 00000004:00080000:1.0:1746140881.580600:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656294864ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580606:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3323, 88 off281080 00000004:00080000:1.0:1746140881.580608:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656303071ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580617:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3363, 88 off284776 00000004:00080000:1.0:1746140881.580621:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860656315961ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.580629:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3364, 88 off284864 00000004:00080000:1.0:1746140881.580632:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860656327235ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.580674:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3365, 88 off284952 00000004:00080000:1.0:1746140881.580678:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860656373076ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.580692:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3324, 88 off281168 00000004:00080000:1.0:1746140881.580696:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656390903ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580702:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3366, 88 off285040 00000004:00080000:1.0:1746140881.580705:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860656400286ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.580743:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3325, 88 off281256 00000004:00080000:1.0:1746140881.580747:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656441944ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580756:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3367, 88 off285128 00000004:00080000:1.0:1746140881.580759:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860656454305ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.580767:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3326, 88 off281344 00000004:00080000:1.0:1746140881.580770:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656464965ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580777:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3327, 88 off281432 00000004:00080000:1.0:1746140881.580779:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656474414ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580786:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3328, 88 off281520 00000004:00080000:1.0:1746140881.580789:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656484011ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580803:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3329, 88 off281608 00000004:00080000:1.0:1746140881.580806:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860656501771ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.580816:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3368, 88 off285216 00000004:00080000:1.0:1746140881.580818:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860656513776ns, next at 809142599738ns, rc = 0 00000004:00010000:0.0:1746140881.603286:0:21104:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a978c50 reply state ffff88012c947800 transno 8589944882 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f2200/0x8156357b7fdb8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00000100:00100000:0.0:1746140881.603302:0:21104:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746140881.603333:0:21104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008b4d8300) 00010000:00010000:0.0:1746140881.603336:0:21104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140881.603346:0:21104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2eea00/0x8156357b7fdb8e56 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c06 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.603480:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a978c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32452:x1830960573528064:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 26278us (26469us total) trans 8589944882 rc 0/0 00000100:00100000:0.0:1746140881.603490:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4631 00000001:00080000:1.0:1746140881.603683:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944882 is committed 00000004:00080000:1.0:1746140881.603690:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2612 committed 00000004:00080000:1.0:1746140881.603698:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2576 committed 00000004:00080000:1.0:1746140881.603704:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2575 committed 00000004:00080000:1.0:1746140881.603706:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2574 committed 00000004:00080000:1.0:1746140881.603708:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2573 committed 00000004:00080000:1.0:1746140881.603709:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2611 committed 00000004:00080000:1.0:1746140881.603711:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2572 committed 00000004:00080000:1.0:1746140881.603712:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2610 committed 00000004:00080000:1.0:1746140881.603714:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2571 committed 00000004:00080000:1.0:1746140881.603715:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2609 committed 00000004:00080000:1.0:1746140881.603718:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2608 committed 00000004:00080000:1.0:1746140881.603719:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2607 committed 00000004:00080000:1.0:1746140881.603721:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2570 committed 00000004:00080000:1.0:1746140881.603736:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2569 committed 00000004:00080000:1.0:1746140881.603738:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2606 committed 00000004:00080000:1.0:1746140881.603740:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2605 committed 00000004:00080000:1.0:1746140881.603742:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2568 committed 00000100:00100000:1.0:1746140881.605210:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16414 00000100:00100000:1.0:1746140881.605217:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3310:x1830960575970816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.605334:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16415 00000100:00100000:1.0:1746140881.605340:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3310:x1830960575970432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140881.605409:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:1.0:1746140881.605412:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.605413:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.605415:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.605417:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5519 -> 5519 00000100:00100000:1.0:1746140881.605442:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3310:x1830960575970432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (1166us total) trans 21474841259 rc 0/0 00000100:00100000:1.0:1746140881.605448:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16415 00000100:00100000:1.0:1746140881.605581:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3310:x1830960575970816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (1234us total) trans 21474841258 rc 0/0 00000100:00100000:1.0:1746140881.605587:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16414 00000100:00100000:1.0:1746140881.605597:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16418 00000100:00100000:1.0:1746140881.605602:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3311:x1830960575971968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.605706:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3311:x1830960575971968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (138us total) trans 17179873985 rc 0/0 00000100:00100000:1.0:1746140881.605712:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16418 00000100:00100000:0.0:1746140881.606193:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.608548:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.621538:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.622820:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.622895:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573529088 00000100:00100000:1.0:1746140881.622900:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573529088 00000100:00100000:0.0:1746140881.627715:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.632419:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.632463:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.637034:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140881.637673:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140881.637931:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.638256:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.638293:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.638332:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573530240 00000100:00100000:0.0:1746140881.638339:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573530240 00002000:00100000:0.0:1746140881.638380:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801359b1c00 x1830960573530240/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.638390:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b1c00 with x1830960573530240 ext(0->1048575) 00002000:00010000:0.0:1746140881.638396:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b1c00 00000100:00100000:0.0:1746140881.638426:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8442 00000100:00100000:0.0:1746140881.638433:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573530240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140881.638523:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573529856 00000100:00100000:1.0:1746140881.638527:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573529856 00010000:00010000:1.0:1746140881.638548:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093877800/0x8156357b7fdb8f59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c53 expref: 10 pid: 14743 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.638564:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573529984 00000100:00100000:1.0:1746140881.638566:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573529984 00010000:00010000:1.0:1746140881.638573:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5e00/0x8156357b7fdb8f36 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c4c expref: 270 pid: 14743 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.638595:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8510 00000100:00100000:1.0:1746140881.638599:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573529856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.638609:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.638614:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093877800/0x8156357b7fdb8f59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c53 expref: 10 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.638623:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093877800/0x8156357b7fdb8f59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c53 expref: 10 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.638644:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093877800/0x8156357b7fdb8f59 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c53 expref: 10 pid: 14743 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.638661:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140881.638770:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.638779:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.638785:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.638962:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960573529856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 360us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.638968:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8510 00000100:00100000:1.0:1746140881.639000:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573530368 00000100:00100000:1.0:1746140881.639002:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573530368 00000100:00100000:1.0:1746140881.639019:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10610 00000100:00100000:1.0:1746140881.639024:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32465:x1830960573530368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140881.639037:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.639047:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3400/0x8156357b7fdb8f91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c6f expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.640222:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.640233:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.640238:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.640252:0:14741:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 5/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.640260:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140881.642597:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140881.642609:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140881.642631:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140881.642761:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61800/0x8156357b7fdb8f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c68 expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.642794:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c68 expref: 269 pid: 14742 timeout: 960 lvb_type: 0 00010000:00010000:3.0:1746140881.642802:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61c00/0x8156357b7fdb8f8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c68 expref: 269 pid: 14742 timeout: 960 lvb_type: 0 00010000:00010000:3.0:1746140881.642808:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f61c00, rc 0) 00000100:00100000:3.0:1746140881.642865:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32459:x1830960573529728:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9778us (10400us total) trans 8589944887 rc 0/0 00000100:00100000:3.0:1746140881.642874:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10609 00000100:00100000:0.0:1746140881.654736:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.654939:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.655027:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573530624 00000100:00100000:3.0:1746140881.655032:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573530624 00000100:00100000:3.0:1746140881.655057:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16427 00000100:00100000:3.0:1746140881.655062:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:32464:x1830960573530624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.655077:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.655090:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009252b200/0x8156357b7fdb8fa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c76 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.655111:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.655113:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.655119:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009252b200/0x8156357b7fdb8fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c76 expref: 36 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.655132:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009252b200/0x8156357b7fdb8fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c76 expref: 36 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.655190:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.655199:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140881.655215:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009252b200, rc 0) 00000100:00100000:3.0:1746140881.655235:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32464:x1830960573530624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 172us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.655240:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16427 00000004:00200000:1.0:1746140881.655244:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140881.655249:0:14741:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140881.655267:0:14741:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.655338:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3400/0x8156357b7fdb8f91 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c6f expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.655916:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c6f expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.655924:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140881.655926:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140881.655928:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3a00, rc 0) 00000100:00100000:1.0:1746140881.655969:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32465:x1830960573530368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 16944us (17675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.655976:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10610 00000100:00100000:0.0:1746140881.656757:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.657155:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.657341:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573530880 00000100:00100000:3.0:1746140881.657349:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573530880 00000100:00100000:3.0:1746140881.657385:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16428 00000100:00100000:3.0:1746140881.657393:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+25:32465:x1830960573530880:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.657408:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.657425:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009252ac00/0x8156357b7fdb8fad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c84 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.657448:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.657449:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140881.657456:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573530752 00010000:00010000:3.0:1746140881.657458:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009252ac00/0x8156357b7fdb8fad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c84 expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.657460:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573530752 00010000:00010000:3.0:1746140881.657472:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009252ac00/0x8156357b7fdb8fad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c84 expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.657482:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009252ac00, rc 0) 00000100:00100000:1.0:1746140881.657498:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10611 00000100:00100000:1.0:1746140881.657503:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32464:x1830960573530752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140881.657516:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140881.657522:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32465:x1830960573530880:12345-192.168.204.16@tcp:101:cat.0 Request processed in 129us (365us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140881.657527:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8fb4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c7d expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140881.657528:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16428 00010000:00010000:1.0:1746140881.657568:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c7d expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.657577:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3600/0x8156357b7fdb8fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c7d expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.657589:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140881.657591:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140881.657593:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3600, rc 0) 00000100:00100000:1.0:1746140881.657613:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32464:x1830960573530752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 110us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.657618:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10611 00000100:00100000:0.0:1746140881.663067:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140881.671544:0:1272:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140881.675704:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.694731:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.694780:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.694848:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573531520 00000100:00100000:3.0:1746140881.694857:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573531520 00000100:00100000:3.0:1746140881.694896:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573531648 00000100:00100000:3.0:1746140881.694898:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573531648 00000100:00100000:3.0:1746140881.694979:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16429 00000100:00100000:0.0:1746140881.694986:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16430 00000100:00100000:3.0:1746140881.694987:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32464:x1830960573531520:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140881.694995:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32465:x1830960573531648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.695006:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.695006:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.695023:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb8fbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c8b expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.695024:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fcef400/0x8156357b7fdb8fc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0c92 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.695046:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.695046:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.695047:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.695047:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.695054:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb8fbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c8b expref: 37 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.695054:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fcef400/0x8156357b7fdb8fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c92 expref: 28 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.695068:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fcef400/0x8156357b7fdb8fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c92 expref: 28 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.695078:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fcef400, rc 0) 00000100:00100000:0.0:1746140881.695134:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32465:x1830960573531648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 141us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.695139:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16430 00010000:00010000:3.0:1746140881.695237:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb8fbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c8b expref: 37 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.695256:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f60400, rc 0) 00000100:00100000:3.0:1746140881.695347:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:32464:x1830960573531520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 317us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.695358:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16429 00000100:00100000:0.0:1746140881.699911:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.700615:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.700691:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573532160 00000100:00100000:3.0:1746140881.700696:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573532160 00002000:00100000:3.0:1746140881.700714:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800a6badf80 x1830960573532160/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.700722:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6badf80 with x1830960573532160 ext(1048576->2097151) 00002000:00010000:3.0:1746140881.700725:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6badf80 00000100:00100000:3.0:1746140881.700756:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8446 00000100:00100000:3.0:1746140881.700761:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573532160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140881.712825:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573532160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12054us (12201us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140881.712838:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8446 00002000:00100000:3.0:1746140881.712850:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800a6badf80 x1830960573532160/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.712860:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6badf80 with x1830960573532160 ext(1048576->2097151) 00002000:00010000:3.0:1746140881.712866:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6badf80 00000100:00100000:0.0:1746140881.717142:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.717488:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.717819:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16432 00000100:00100000:3.0:1746140881.717837:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32465:x1830960573532416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.717857:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.717874:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f60200/0x8156357b7fdb8fd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ca0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.717896:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.717898:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.717905:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f60200/0x8156357b7fdb8fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca0 expref: 29 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.717918:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f60200/0x8156357b7fdb8fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca0 expref: 29 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.717927:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f60200, rc 0) 00000100:00100000:3.0:1746140881.717969:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+29:32465:x1830960573532416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 140us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.717976:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16432 00000100:00100000:0.0:1746140881.723498:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.723555:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.723652:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573532800 00000100:00100000:3.0:1746140881.723667:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573532800 00002000:00100000:3.0:1746140881.723718:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801359b1500 x1830960573532800/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.723729:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b1500 with x1830960573532800 ext(1048576->2097151) 00002000:00010000:3.0:1746140881.723734:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b1500 00000100:00100000:0.0:1746140881.724682:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8448 00000100:00100000:0.0:1746140881.724690:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573532800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140881.735914:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573532800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11219us (12422us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140881.735926:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8448 00002000:00100000:0.0:1746140881.735935:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801359b1500 x1830960573532800/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140881.735944:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b1500 with x1830960573532800 ext(1048576->2097151) 00002000:00010000:0.0:1746140881.735948:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b1500 00000100:00100000:0.0:1746140881.740178:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.740607:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573533056 00000100:00100000:3.0:1746140881.740619:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573533056 00000100:00100000:3.0:1746140881.740684:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16433 00000100:00100000:3.0:1746140881.740692:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32465:x1830960573533056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.740710:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.740725:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ca7 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.740748:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.740750:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.740759:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.740778:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.740787:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f61800, rc 0) 00000100:00100000:3.0:1746140881.740851:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32465:x1830960573533056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 161us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.740858:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16433 00000100:00100000:0.0:1746140881.743243:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.743357:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573533184 00000100:00100000:3.0:1746140881.743369:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573533184 00000100:00100000:0.0:1746140881.743416:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.743424:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16434 00000100:00100000:3.0:1746140881.743431:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573533184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.743447:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.743462:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f61e00/0x8156357b7fdb8fde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0cae expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.743481:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.743483:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.743491:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f61e00/0x8156357b7fdb8fde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cae expref: 33 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140881.743505:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f61e00/0x8156357b7fdb8fde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cae expref: 33 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140881.743513:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f61e00, rc 0) 00000100:00100000:3.0:1746140881.743556:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573533184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.743563:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16434 00000100:00100000:3.0:1746140881.743574:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573533312 00000100:00100000:3.0:1746140881.743576:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573533312 00000100:00100000:3.0:1746140881.743590:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16435 00000100:00100000:3.0:1746140881.743594:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573533312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.743601:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.743610:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0cb5 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.743619:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.743620:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140881.743624:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cb5 expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140881.743632:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cb5 expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140881.743638:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f60e00, rc 0) 00000100:00100000:3.0:1746140881.743651:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573533312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.743656:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16435 00000100:00100000:0.0:1746140881.745675:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.758662:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.758700:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.758728:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.758762:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.759759:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8451 00000100:00100000:1.0:1746140881.759775:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573534080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140881.760132:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8452 00000100:00100000:0.0:1746140881.760141:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573534336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140881.760648:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8453 00000100:00100000:3.0:1746140881.760657:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573534592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140881.769998:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573534592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9335us (11227us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140881.770010:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8453 00002000:00100000:3.0:1746140881.770021:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880094450e00 x1830960573534592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.770030:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094450e00 with x1830960573534592 ext(3145728->4194303) 00002000:00010000:3.0:1746140881.770036:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094450e00 00000100:00100000:0.0:1746140881.777458:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.777490:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.777533:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573534720 00000100:00100000:1.0:1746140881.777546:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573534720 00000100:00100000:1.0:1746140881.777597:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573534848 00000100:00100000:1.0:1746140881.777599:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573534848 00000100:00100000:1.0:1746140881.777621:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16436 00000100:00100000:1.0:1746140881.777629:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573534720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140881.777645:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.777661:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0cbc expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.777684:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.777686:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.777695:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.777709:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140881.777719:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfd4e00, rc 0) 00000100:00100000:1.0:1746140881.777757:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573534720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.777766:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16436 00000100:00100000:1.0:1746140881.778069:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573534080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18300us (19367us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140881.778075:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8451 00002000:00100000:1.0:1746140881.778079:0:21691:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880094450000 x1830960573534080/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.778086:0:21691:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094450000 with x1830960573534080 ext(3145728->4194303) 00002000:00010000:1.0:1746140881.778089:0:21691:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094450000 00000100:00100000:0.0:1746140881.782068:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.784523:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573535360 00000100:00100000:1.0:1746140881.784529:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573535360 00000100:00100000:1.0:1746140881.784570:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10613 00000100:00100000:1.0:1746140881.784577:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32461:x1830960573535360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140881.784706:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.784709:0:14741:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746140881.784719:0:14741:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c6f expref: 10 pid: 14741 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.784738:0:14741:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60a00/0x8156357b7fdb8f75 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c61 expref: 10 pid: 14742 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.784745:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140881.784749:0:14741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.784755:0:14741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.784762:0:14741:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140881.784770:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d28e00/0x8156357b7fdb9008 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0cd1 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.784809:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.784816:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.784821:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.784832:0:14741:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.784841:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140881.785426:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573535488 00000100:00100000:0.0:1746140881.785434:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573535488 00000100:00100000:0.0:1746140881.785457:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10614 00000100:00100000:0.0:1746140881.785462:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32465:x1830960573535488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140881.785469:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.785476:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0cd8 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.785503:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140881.785510:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 13 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.785518:0:14743:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140881.785525:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 13 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.785534:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:0.0:1746140881.785536:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140881.785538:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140881.785542:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009272dc00, rc 0) 00000100:00100000:0.0:1746140881.785582:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32465:x1830960573535488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 120us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.785587:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10614 00000100:00100000:1.0:1746140881.785788:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573534336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25648us (27058us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140881.785795:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8452 00002000:00100000:1.0:1746140881.785803:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880094451180 x1830960573534336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.785812:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094451180 with x1830960573534336 ext(2097152->3145727) 00002000:00010000:1.0:1746140881.785815:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094451180 00000100:00100000:0.0:1746140881.786540:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140881.787282:0:14742:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from blocking AST (req@ffff880093131f80 x1830960575972608) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c6f expref: 12 pid: 14741 timeout: 960 lvb_type: 0 00010000:00010000:0.0:1746140881.787294:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdb8f98 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c6f expref: 12 pid: 14741 timeout: 960 lvb_type: 0 00000100:00100000:0.0:1746140881.787345:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575972608:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140881.787358:0:14742:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from blocking AST (req@ffff880093130380 x1830960575972736) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60a00/0x8156357b7fdb8f75 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c61 expref: 11 pid: 14742 timeout: 960 lvb_type: 0 00010000:00010000:0.0:1746140881.787367:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60a00/0x8156357b7fdb8f75 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c61 expref: 11 pid: 14742 timeout: 960 lvb_type: 0 00000100:00100000:0.0:1746140881.787375:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575972736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140881.787383:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575972864:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140881.787401:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:0.0:1746140881.787404:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140881.787409:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140881.787416:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140881.788658:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.789609:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140881.789618:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00000040:00080000:1.0:1746140881.790176:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3330, 88 off281696 00000004:00080000:1.0:1746140881.790181:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860865876210ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790220:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3369, 88 off285304 00000004:00080000:1.0:1746140881.790223:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860865918088ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.790233:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3370, 88 off285392 00000004:00080000:1.0:1746140881.790235:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860865930128ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.790241:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3331, 88 off281784 00000004:00080000:1.0:1746140881.790244:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860865938913ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790249:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3332, 88 off281872 00000004:00080000:1.0:1746140881.790251:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860865946064ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790256:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3371, 88 off285480 00000004:00080000:1.0:1746140881.790258:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860865953446ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.790264:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3372, 88 off285568 00000004:00080000:1.0:1746140881.790266:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860865961345ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.790272:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3373, 88 off285656 00000004:00080000:1.0:1746140881.790274:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860865969735ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.790281:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3333, 88 off281960 00000004:00080000:1.0:1746140881.790285:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860865979815ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790291:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3374, 88 off285744 00000004:00080000:1.0:1746140881.790293:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860865988831ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.790299:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3334, 88 off282048 00000004:00080000:1.0:1746140881.790301:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860865996030ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790321:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3375, 88 off285832 00000004:00080000:1.0:1746140881.790323:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860866018796ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.790329:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3335, 88 off282136 00000004:00080000:1.0:1746140881.790332:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860866027170ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790338:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3336, 88 off282224 00000004:00080000:1.0:1746140881.790341:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860866035858ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790346:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3337, 88 off282312 00000004:00080000:1.0:1746140881.790348:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860866043141ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790353:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3338, 88 off282400 00000004:00080000:1.0:1746140881.790355:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860866050504ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.790361:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3376, 88 off285920 00000004:00080000:1.0:1746140881.790363:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860866058135ns, next at 809142599738ns, rc = 0 00010000:00010000:1.0:1746140881.812247:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cca expref: 272 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.812261:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140881.812263:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746140881.812267:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.812275:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cca expref: 272 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.812282:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.812341:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cca expref: 272 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.812388:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cca expref: 272 pid: 14742 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.812402:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575972992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.812552:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387300 going to sleep for 11 seconds 00000001:00080000:1.0:1746140881.812568:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944888 is committed 00000004:00080000:1.0:1746140881.812574:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2620 committed 00000004:00080000:1.0:1746140881.812581:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2585 committed 00000004:00080000:1.0:1746140881.812588:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2584 committed 00000004:00080000:1.0:1746140881.812589:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2583 committed 00000004:00080000:1.0:1746140881.812591:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2582 committed 00000004:00080000:1.0:1746140881.812592:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2619 committed 00000004:00080000:1.0:1746140881.812594:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2581 committed 00000004:00080000:1.0:1746140881.812596:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2618 committed 00000004:00080000:1.0:1746140881.812597:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2580 committed 00000004:00080000:1.0:1746140881.812599:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2617 committed 00000004:00080000:1.0:1746140881.812600:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2616 committed 00000004:00080000:1.0:1746140881.812602:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2615 committed 00000004:00080000:1.0:1746140881.812603:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2579 committed 00000004:00080000:1.0:1746140881.812605:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2578 committed 00000004:00080000:1.0:1746140881.812606:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2614 committed 00000004:00080000:1.0:1746140881.812608:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2613 committed 00000004:00080000:1.0:1746140881.812609:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2577 committed 00000001:00080000:1.0:1746140881.812617:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944885 is committed 00000001:00080000:1.0:1746140881.812626:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944883 is committed 00000001:00080000:1.0:1746140881.812638:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944886 is committed 00000100:00100000:1.0:1746140881.812714:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575973376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.812749:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812766:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575973888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.812775:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812786:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746140881.812789:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575973504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.812797:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812804:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575974016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.812813:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812821:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575974400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.812831:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812838:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575974912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.812845:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812851:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746140881.812854:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575974528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140881.812857:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575973120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.812862:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812879:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575975040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140881.812886:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812899:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575973376 00000100:00100000:1.0:1746140881.812905:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575973376 00000100:00100000:3.0:1746140881.812906:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575973632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140881.812920:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140881.812930:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575974144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.812930:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575973888 00000100:00100000:1.0:1746140881.812932:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575973888 00000100:00100000:1.0:1746140881.812938:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575973504 00000100:00100000:1.0:1746140881.812940:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575973504 00000100:00100000:3.0:1746140881.812943:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812949:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575974016 00000100:00100000:1.0:1746140881.812950:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575974016 00000100:00100000:3.0:1746140881.812954:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575974656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.812954:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575974400 00000100:00100000:1.0:1746140881.812955:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575974400 00000100:00100000:1.0:1746140881.812961:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575974912 00000100:00100000:1.0:1746140881.812962:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575974912 00000100:00100000:1.0:1746140881.812966:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575974528 00000100:00100000:3.0:1746140881.812967:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812968:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575974528 00000100:00100000:1.0:1746140881.812973:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575973120 00000100:00100000:1.0:1746140881.812974:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575973120 00000100:00100000:3.0:1746140881.812976:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746140881.812981:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575973248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.812981:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575973632 00000100:00100000:1.0:1746140881.812983:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575973632 00000100:00100000:1.0:1746140881.812989:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575974144 00000100:00100000:1.0:1746140881.812990:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575974144 00000100:00100000:3.0:1746140881.812994:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.812997:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575974656 00000100:00100000:1.0:1746140881.812999:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575974656 00000100:00100000:3.0:1746140881.813001:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575973760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.813004:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575973248 00000100:00100000:1.0:1746140881.813006:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575973248 00000100:00100000:3.0:1746140881.813012:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.813015:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16438 00000100:00100000:3.0:1746140881.813018:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575974272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.813021:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3312:x1830960575973376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140881.813029:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140881.813034:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575974784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140881.813045:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140881.813066:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575973760 00000100:00100000:3.0:1746140881.813069:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575973760 00000100:00100000:3.0:1746140881.813082:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575974272 00000100:00100000:3.0:1746140881.813084:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575974272 00000100:00100000:3.0:1746140881.813090:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575974784 00000100:00100000:3.0:1746140881.813091:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575974784 00000100:00100000:3.0:1746140881.813099:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16439 00000100:00100000:3.0:1746140881.813103:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+48:3312:x1830960575973888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140881.813219:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:1.0:1746140881.813223:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.813225:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.813227:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.813229:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5519 -> 5519 00000100:00100000:1.0:1746140881.813259:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3312:x1830960575973376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (509us total) trans 21474841262 rc 0/0 00000100:00100000:1.0:1746140881.813266:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16438 00000100:00100000:1.0:1746140881.813281:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16440 00000100:00100000:1.0:1746140881.813286:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3312:x1830960575973504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.813384:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3312:x1830960575973504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (585us total) trans 21474841263 rc 0/0 00000100:00100000:1.0:1746140881.813388:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16440 00000100:00100000:1.0:1746140881.813396:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16441 00000100:00100000:1.0:1746140881.813400:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3312:x1830960575974016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.813479:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3312:x1830960575974016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (663us total) trans 21474841264 rc 0/0 00000100:00100000:1.0:1746140881.813484:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16441 00000100:00100000:1.0:1746140881.813505:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16443 00000100:00100000:1.0:1746140881.813510:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3312:x1830960575974912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.813599:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16445 00000100:00100000:1.0:1746140881.813604:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3310:x1830960575973120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.813619:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140881.813649:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bae300/2, rc 0, transno 21474841263 00000100:00100000:0.0:1746140881.813656:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575973504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140881.813664:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bad500/2, rc 0, transno 21474841264 00000100:00100000:0.0:1746140881.813667:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575974016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140881.813672:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bae680/2, rc 0, transno 21474841262 00002000:00010000:1.0:1746140881.813673:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746140881.813675:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00000100:00100000:0.0:1746140881.813675:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575973376:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140881.813677:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.813678:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.813680:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746140881.813702:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3310:x1830960575973120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (816us total) trans 21474841265 rc 0/0 00000100:00100000:0.0:1746140881.813702:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746140881.813707:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16445 00000100:00100000:0.0:1746140881.813709:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575975168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.813714:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575975040 00000100:00100000:1.0:1746140881.813717:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575975040 00000100:00100000:1.0:1746140881.813727:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16446 00000100:00100000:1.0:1746140881.813730:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3310:x1830960575973632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.813733:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.813803:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3310:x1830960575973632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (881us total) trans 21474841266 rc 0/0 00000100:00100000:1.0:1746140881.813808:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16446 00000100:00100000:1.0:1746140881.813814:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575975168 00000100:00100000:1.0:1746140881.813817:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575975168 00000100:00100000:1.0:1746140881.813826:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16447 00000100:00100000:1.0:1746140881.813829:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3310:x1830960575974144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746140881.813898:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140881.813900:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.813902:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.813904:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.813906:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746140881.813925:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3310:x1830960575974144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (981us total) trans 17179873995 rc 0/0 00000100:00100000:1.0:1746140881.813930:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16447 00000100:00100000:1.0:1746140881.813940:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16449 00000100:00100000:1.0:1746140881.813944:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3310:x1830960575973248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140881.814018:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140881.814021:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.814023:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.814024:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140881.814026:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140881.814044:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3310:x1830960575973248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (1048us total) trans 21474841267 rc 0/0 00000100:00100000:1.0:1746140881.814049:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16449 00000100:00100000:1.0:1746140881.814063:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16452 00000100:00100000:1.0:1746140881.814067:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3310:x1830960575974784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.814081:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16453 00000100:00100000:1.0:1746140881.814085:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3312:x1830960575975040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.814384:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3312:x1830960575974912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 873us (1536us total) trans 17179873993 rc 0/0 00000100:00100000:0.0:1746140881.814390:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16443 00000100:00100000:0.0:1746140881.814400:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16454 00000100:00100000:0.0:1746140881.814406:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3311:x1830960575975168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140881.814636:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+51:3312:x1830960575973888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1531us (1858us total) trans 21474841269 rc 0/0 00000100:00100000:3.0:1746140881.814642:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16439 00000004:00080000:3.0:1746140881.814677:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6badc00/2, rc 0, transno 21474841267 00000100:00100000:3.0:1746140881.814681:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575973248:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140881.814689:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baea00/2, rc 0, transno 21474841265 00000100:00100000:3.0:1746140881.814692:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575973120:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140881.814699:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baca80/2, rc 0, transno 21474841266 00000100:00100000:3.0:1746140881.814702:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575973632:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140881.814711:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f173480/2, rc 0, transno 17179873995 00000100:00100000:3.0:1746140881.814714:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575974144:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140881.814720:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f170380/2, rc 0, transno 17179873996 00000100:00100000:3.0:1746140881.814723:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575974656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.814964:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3312:x1830960575975040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 877us (1344us total) trans 17179873999 rc 0/0 00000100:00100000:1.0:1746140881.814969:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16453 00000004:00080000:3.0:1746140881.815204:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baed80/2, rc 0, transno 21474841270 00000100:00100000:3.0:1746140881.815208:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575973760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140881.815215:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172680/2, rc 0, transno 17179873997 00000100:00100000:3.0:1746140881.815218:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575974272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.815328:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960575975168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (761us total) trans 21474841268 rc 0/0 00000100:00100000:0.0:1746140881.815335:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16454 00000004:00080000:0.0:1746140881.815360:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f170a80/2, rc 0, transno 21474841268 00000100:00100000:0.0:1746140881.815363:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575975168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140881.815381:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f171c00/2, rc 0, transno 17179873994 00000100:00100000:0.0:1746140881.815383:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575974528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140881.815389:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f171880/2, rc 0, transno 17179873999 00000100:00100000:0.0:1746140881.815392:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575975040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140881.815398:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172300/2, rc 0, transno 17179873998 00000100:00100000:0.0:1746140881.815401:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575974400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140881.815406:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f170700/2, rc 0, transno 17179873993 00000100:00100000:0.0:1746140881.815409:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575974912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140881.815415:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bac700/2, rc 0, transno 21474841269 00000100:00100000:0.0:1746140881.815417:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575973888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.815447:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3310:x1830960575974784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1378us (2399us total) trans 17179874000 rc 0/0 00000100:00100000:1.0:1746140881.815454:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16452 00000004:00080000:3.0:1746140881.815478:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f170e00/2, rc 0, transno 17179874000 00000100:00100000:3.0:1746140881.815482:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575974784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.815702:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575972992:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.815733:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f61200/0x8156357b7fdb8ffa lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cca expref: 269 pid: 14742 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746140881.815747:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cca expref: 268 pid: 14742 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.815754:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f60800/0x8156357b7fdb9001 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cca expref: 268 pid: 14742 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.815777:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f60800, rc 0) 00000100:00100000:1.0:1746140881.816006:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32459:x1830960573535104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 33408us (33945us total) trans 8589944888 rc 0/0 00000100:00100000:1.0:1746140881.816011:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10612 00000100:00100000:0.0:1746140881.818065:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.818609:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140881.818617:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00000040:00080000:1.0:1746140881.819641:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3339, 88 off282488 00000004:00080000:1.0:1746140881.819650:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895344923ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819714:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3377, 88 off286008 00000004:00080000:1.0:1746140881.819718:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860895413345ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.819745:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3378, 88 off286096 00000004:00080000:1.0:1746140881.819748:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860895443138ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.819755:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3340, 88 off282576 00000004:00080000:1.0:1746140881.819757:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895452600ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819763:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3341, 88 off282664 00000004:00080000:1.0:1746140881.819766:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895460980ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819772:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3379, 88 off286184 00000004:00080000:1.0:1746140881.819774:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860895469221ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.819780:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3380, 88 off286272 00000004:00080000:1.0:1746140881.819782:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860895477465ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.819787:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3381, 88 off286360 00000004:00080000:1.0:1746140881.819789:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860895484775ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.819795:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3342, 88 off282752 00000004:00080000:1.0:1746140881.819798:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895493026ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819803:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3382, 88 off286448 00000004:00080000:1.0:1746140881.819806:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860895501221ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.819812:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3343, 88 off282840 00000004:00080000:1.0:1746140881.819815:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895510366ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819821:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3383, 88 off286536 00000004:00080000:1.0:1746140881.819824:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860895519460ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140881.819830:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3344, 88 off282928 00000004:00080000:1.0:1746140881.819832:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895527616ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819837:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3345, 88 off283016 00000004:00080000:1.0:1746140881.819840:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895535660ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819846:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3346, 88 off283104 00000004:00080000:1.0:1746140881.819848:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895543428ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819853:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3347, 88 off283192 00000004:00080000:1.0:1746140881.819855:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860895550683ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140881.819860:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3384, 88 off286624 00000004:00080000:1.0:1746140881.819862:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860895557788ns, next at 809142599738ns, rc = 0 00000001:00080000:0.0:1746140881.836971:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944889 is committed 00000004:00080000:0.0:1746140881.836981:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2628 committed 00000004:00080000:0.0:1746140881.836998:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2594 committed 00000004:00080000:0.0:1746140881.837004:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2593 committed 00000004:00080000:0.0:1746140881.837006:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2592 committed 00000004:00080000:0.0:1746140881.837008:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2591 committed 00000004:00080000:0.0:1746140881.837010:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2627 committed 00000004:00080000:0.0:1746140881.837011:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2590 committed 00000004:00080000:0.0:1746140881.837014:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2626 committed 00000004:00080000:0.0:1746140881.837016:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2589 committed 00000004:00080000:0.0:1746140881.837018:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2625 committed 00000004:00080000:0.0:1746140881.837019:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2624 committed 00000004:00080000:0.0:1746140881.837021:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2623 committed 00000004:00080000:0.0:1746140881.837023:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2588 committed 00000004:00080000:0.0:1746140881.837024:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2587 committed 00000004:00080000:0.0:1746140881.837026:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2622 committed 00000004:00080000:0.0:1746140881.837028:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2621 committed 00000004:00080000:0.0:1746140881.837029:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2586 committed 00000100:00100000:0.0:1746140881.837111:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575975296:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746140881.837184:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.837186:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140881.837198:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575975680:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746140881.837202:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140881.837205:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746140881.837210:0:14741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.837216:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575975808:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746140881.837219:0:14741:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140881.837225:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746140881.837226:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.837233:0:14741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 266 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.837237:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575975424:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746140881.837240:0:14741:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 266 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140881.837246:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575976192:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746140881.837246:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 266 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.837254:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140881.837262:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575975552:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746140881.837269:0:14741:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 266 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.837269:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575975936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140881.837279:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.837279:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575977344:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140881.837292:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575975296 00000100:00100000:3.0:1746140881.837293:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575976064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.837299:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575975296 00000100:00100000:0.0:1746140881.837344:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575975680 00000100:00100000:0.0:1746140881.837346:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575975680 00000100:00100000:0.0:1746140881.837359:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575975552 00000100:00100000:0.0:1746140881.837361:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575975552 00000100:00100000:0.0:1746140881.837377:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16456 00000100:00100000:0.0:1746140881.837383:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3310:x1830960575975680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140881.837550:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140881.837553:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140881.837555:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140881.837558:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140881.837559:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140881.837626:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746140881.837631:0:14741:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.837632:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3310:x1830960575975680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (405us total) trans 21474841271 rc 0/0 00000100:00100000:0.0:1746140881.837638:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16456 00000100:00100000:3.0:1746140881.837639:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575976576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.837644:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575977472:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140881.837653:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575976064 00000100:00100000:3.0:1746140881.837654:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.837655:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575976064 00000100:00100000:1.0:1746140881.837661:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387180 going to sleep for 11 seconds 00000100:00100000:3.0:1746140881.837663:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575977088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.837666:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575976576 00000100:00100000:0.0:1746140881.837668:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575976576 00000100:00100000:3.0:1746140881.837676:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.837677:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16457 00000100:00100000:0.0:1746140881.837681:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3312:x1830960575975424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140881.837695:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575977088 00000100:00100000:3.0:1746140881.837698:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575977088 00000100:00100000:3.0:1746140881.837712:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16458 00000100:00100000:3.0:1746140881.837716:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3313:x1830960575975552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140881.837753:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140881.837756:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140881.837792:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140881.837794:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140881.837796:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140881.837797:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140881.837799:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140881.837816:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3313:x1830960575975552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (538us total) trans 17179874002 rc 0/0 00000100:00100000:3.0:1746140881.837821:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16458 00000100:00100000:3.0:1746140881.837828:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16459 00000100:00100000:3.0:1746140881.837832:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3313:x1830960575976064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140881.837857:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140881.837859:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140881.837861:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140881.837881:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3312:x1830960575975424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (627us total) trans 21474841272 rc 0/0 00000100:00100000:0.0:1746140881.837887:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16457 00000100:00100000:0.0:1746140881.837912:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.837924:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575976448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.837940:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.837950:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575976960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.837963:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140881.837989:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172a00/2, rc 0, transno 21474841272 00000100:00100000:0.0:1746140881.837995:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575975424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.838007:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575976448 00000100:00100000:0.0:1746140881.838010:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575976448 00000100:00100000:0.0:1746140881.838021:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575976960 00000100:00100000:0.0:1746140881.838022:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575976960 00000100:00100000:0.0:1746140881.838030:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16463 00000100:00100000:0.0:1746140881.838034:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3312:x1830960575976448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.838119:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3312:x1830960575976448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (178us total) trans 21474841274 rc 0/0 00000100:00100000:3.0:1746140881.838122:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3313:x1830960575976064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 290us (496us total) trans 17179874003 rc 0/0 00000100:00100000:0.0:1746140881.838124:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16463 00000100:00100000:3.0:1746140881.838128:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16459 00000100:00100000:3.0:1746140881.838171:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.838171:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140881.838186:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575976320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140881.838189:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575976704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.838205:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140881.838209:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575975808 00000100:00100000:3.0:1746140881.838212:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575975808 00000100:00100000:0.0:1746140881.838217:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575976832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140881.838223:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575976192 00000100:00100000:3.0:1746140881.838224:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575976192 00000100:00100000:0.0:1746140881.838231:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140881.838236:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575976320 00000100:00100000:3.0:1746140881.838238:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575976320 00000100:00100000:3.0:1746140881.838245:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575976832 00000100:00100000:0.0:1746140881.838245:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575977600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140881.838247:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575976832 00000100:00100000:3.0:1746140881.838256:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16465 00000100:00100000:3.0:1746140881.838260:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3311:x1830960575975808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.838261:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140881.838277:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093132d80/2, rc 0, transno 17179874001 00000100:00100000:0.0:1746140881.838280:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575975296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.838296:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16467 00000100:00100000:0.0:1746140881.838302:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3311:x1830960575976320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746140881.838343:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746140881.838346:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140881.838348:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140881.838349:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140881.838350:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746140881.838369:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3311:x1830960575975808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (199us total) trans 17179874005 rc 0/0 00000100:00100000:3.0:1746140881.838374:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16465 00000100:00100000:3.0:1746140881.838488:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16469 00000100:00100000:3.0:1746140881.838493:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3311:x1830960575977600:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140881.838548:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093131180/2, rc 0, transno 17179874005 00000100:00100000:0.0:1746140881.838553:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575975808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140881.838583:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3311:x1830960575977600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (320us total) trans 21474841277 rc 0/0 00000100:00100000:3.0:1746140881.838591:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16469 00000004:00080000:0.0:1746140881.838595:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece2a00/2, rc 0, transno 21474841277 00000100:00100000:0.0:1746140881.838598:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575977600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140881.838609:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140881.838621:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575977216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.838622:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575976704 00000100:00100000:1.0:1746140881.838627:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575976704 00000100:00100000:3.0:1746140881.838636:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140881.838644:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575977216 00000100:00100000:1.0:1746140881.838645:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575977216 00000100:00100000:0.0:1746140881.838654:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16470 00000004:00080000:3.0:1746140881.838657:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f171180/2, rc 0, transno 21474841271 00000100:00100000:1.0:1746140881.838658:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16471 00000100:00100000:3.0:1746140881.838660:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575975680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.838660:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3310:x1830960575976704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140881.838663:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3310:x1830960575977216:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140881.838666:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece1500/2, rc 0, transno 21474841276 00000100:00100000:3.0:1746140881.838668:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575976192:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140881.838683:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093131c00/2, rc 0, transno 17179874002 00000100:00100000:3.0:1746140881.838686:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575975552:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140881.838691:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093130380/2, rc 0, transno 17179874003 00000100:00100000:3.0:1746140881.838693:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575976064:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140881.838697:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093130a80/2, rc 0, transno 17179874004 00000100:00100000:3.0:1746140881.838699:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575976576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140881.838765:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960575977216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (126us total) trans 21474841278 rc 0/0 00000100:00100000:1.0:1746140881.838770:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16471 00000004:00080000:3.0:1746140881.838772:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece0380/2, rc 0, transno 21474841278 00000100:00100000:0.0:1746140881.838774:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960575976704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (163us total) trans 21474841279 rc 0/0 00000100:00100000:3.0:1746140881.838775:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575977216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.838779:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16470 00000004:00080000:3.0:1746140881.838781:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece0a80/2, rc 0, transno 21474841279 00000100:00100000:3.0:1746140881.838786:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575976704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140881.839478:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3311:x1830960575976320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1175us (1271us total) trans 17179874006 rc 0/0 00000100:00100000:0.0:1746140881.839483:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16467 00000004:00080000:1.0:1746140881.839545:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093131f80/2, rc 0, transno 17179874006 00000100:00100000:1.0:1746140881.839548:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575976320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140881.839696:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093133800/2, rc 0, transno 17179874008 00000100:00100000:1.0:1746140881.839700:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575976832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140881.842458:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.842485:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575977344:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140881.842496:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.842499:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575977472:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.842537:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d28e00/0x8156357b7fdb9008 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 9 pid: 14741 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746140881.842555:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.842576:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.842589:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b67200, rc 0) 00000100:00100000:0.0:1746140881.842593:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573536256 00000100:00100000:0.0:1746140881.842599:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573536256 00000100:00100000:1.0:1746140881.842643:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32461:x1830960573535360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 58066us (58156us total) trans 8589944889 rc 0/0 00000100:00100000:1.0:1746140881.842654:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10613 00000100:00100000:1.0:1746140881.842703:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573536128 00000100:00100000:1.0:1746140881.842706:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573536128 00000100:00100000:1.0:1746140881.842726:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10616 00000100:00100000:1.0:1746140881.842731:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32459:x1830960573536128:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:0.0:1746140881.842748:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4633 00010000:00010000:1.0:1746140881.842750:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140881.842753:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32465:x1830960573536256:12345-192.168.204.16@tcp:49:cat.0 00010000:00010000:1.0:1746140881.842761:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977400/0x8156357b7fdb9024 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ce6 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.842792:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977400/0x8156357b7fdb9024 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ce6 expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.842802:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f977400/0x8156357b7fdb9024 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ce6 expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.842808:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32465:x1830960573536256:12345-192.168.204.16@tcp:49:cat.0 Request processed in 55us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140881.842811:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140881.842814:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746140881.842814:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4633 00010000:00010000:1.0:1746140881.842816:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f977400, rc 0) 00000100:00100000:1.0:1746140881.842829:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32459:x1830960573536128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 98us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.842834:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10616 00000100:00100000:0.0:1746140881.844893:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.849998:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.853049:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.853098:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.853229:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573536640 00000100:00100000:1.0:1746140881.853236:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573536640 00010000:00010000:1.0:1746140881.853266:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f61e00/0x8156357b7fdb8fde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cae expref: 33 pid: 9872 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.853298:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573536768 00000100:00100000:1.0:1746140881.853300:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573536768 00010000:00010000:1.0:1746140881.853327:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f78a00/0x8156357b7fdb8ecd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c37 expref: 11 pid: 4782 timeout: 960 lvb_type: 1 00000100:00100000:3.0:1746140881.853337:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8515 00000100:00100000:3.0:1746140881.853346:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573536640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140881.853351:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8516 00010000:00010000:3.0:1746140881.853357:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140881.853357:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573536768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.853363:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140881.853380:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f61e00/0x8156357b7fdb8fde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cae expref: 33 pid: 9872 timeout: 960 lvb_type: 1 00010000:00010000:3.0:1746140881.853393:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f61e00/0x8156357b7fdb8fde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cae expref: 33 pid: 9872 timeout: 960 lvb_type: 1 00010000:00010000:3.0:1746140881.853411:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f61e00/0x8156357b7fdb8fde lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cae expref: 33 pid: 9872 timeout: 960 lvb_type: 1 00010000:00010000:3.0:1746140881.853421:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140881.853438:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573536640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.853443:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8515 00010000:00010000:1.0:1746140881.853516:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f78a00/0x8156357b7fdb8ecd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c37 expref: 11 pid: 4782 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.853525:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f78a00/0x8156357b7fdb8ecd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c37 expref: 11 pid: 4782 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.853543:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f78a00/0x8156357b7fdb8ecd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c37 expref: 11 pid: 4782 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.853554:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.853571:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573536768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 215us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.853576:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8516 00000100:00100000:0.0:1746140881.854274:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.855581:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.855614:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.855677:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573537152 00000100:00100000:1.0:1746140881.855683:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573537152 00002000:00100000:1.0:1746140881.855712:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8800a55e0e00 x1830960573537152/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.855727:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e0e00 with x1830960573537152 ext(2097152->3145727) 00010000:00010000:1.0:1746140881.855735:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 29 pid: 8460 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.855747:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 29 pid: 8460 timeout: 960 lvb_type: 1 00002000:00010000:1.0:1746140881.855754:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55e0e00 00000100:00100000:1.0:1746140881.855777:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573537280 00000100:00100000:1.0:1746140881.855780:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573537280 00002000:00100000:1.0:1746140881.855790:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a55e3100 x1830960573537280/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.855797:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e3100 with x1830960573537280 ext(3145728->4194303) 00010000:00010000:1.0:1746140881.855801:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 30 pid: 8460 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.855809:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 30 pid: 8460 timeout: 960 lvb_type: 1 00002000:00010000:1.0:1746140881.855814:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55e3100 00000100:00100000:1.0:1746140881.855822:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1741 00000100:00100000:1.0:1746140881.855828:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573537152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140881.855829:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1742 00000100:00100000:3.0:1746140881.855837:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573537280:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140881.857286:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.857723:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.857745:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.857960:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573537664 00000100:00100000:3.0:1746140881.857967:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573537664 00002000:00100000:3.0:1746140881.857996:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8800a55e0000 x1830960573537664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.858005:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e0000 with x1830960573537664 ext(2097152->3145727) 00010000:00010000:3.0:1746140881.858012:0:21640:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 30 pid: 20960 timeout: 960 lvb_type: 1 00010000:00010000:3.0:1746140881.858024:0:21640:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 30 pid: 20960 timeout: 960 lvb_type: 1 00002000:00010000:3.0:1746140881.858031:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a55e0000 00000100:00100000:3.0:1746140881.858045:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573537792 00000100:00100000:3.0:1746140881.858047:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573537792 00002000:00100000:3.0:1746140881.858057:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012bf11c00 x1830960573537792/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.858063:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11c00 with x1830960573537792 ext(3145728->4194303) 00010000:00010000:3.0:1746140881.858066:0:21640:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 31 pid: 20960 timeout: 960 lvb_type: 1 00010000:00010000:3.0:1746140881.858073:0:21640:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 31 pid: 20960 timeout: 960 lvb_type: 1 00002000:00010000:3.0:1746140881.858078:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bf11c00 00000100:00100000:3.0:1746140881.858085:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573538176 00000100:00100000:3.0:1746140881.858087:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573538176 00002000:00100000:3.0:1746140881.858096:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012bf10700 x1830960573538176/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.858102:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf10700 with x1830960573538176 ext(2097152->3145727) 00010000:00010000:3.0:1746140881.858106:0:21640:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cb5 expref: 40 pid: 9872 timeout: 960 lvb_type: 1 00010000:00010000:3.0:1746140881.858111:0:21640:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cb5 expref: 40 pid: 9872 timeout: 960 lvb_type: 1 00002000:00010000:3.0:1746140881.858115:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bf10700 00000100:00100000:3.0:1746140881.858124:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1743 00000100:00100000:3.0:1746140881.858128:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573537664:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140881.860231:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092612680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575978112:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.860243:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092610000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575978240:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140881.860251:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092610a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575978368:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.860284:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3686400->4194303] (req 3686400->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.860298:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3600, rc 0) 00000100:00100000:1.0:1746140881.860355:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:32459:x1830960573536896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5996us (6082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.860363:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16473 00000100:00100000:1.0:1746140881.860778:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.862369:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573538304 00000100:00100000:1.0:1746140881.862379:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573538304 00010000:00010000:1.0:1746140881.862415:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009272d000/0x8156357b7fdb8ec6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c3e expref: 11 pid: 4785 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.862443:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8517 00000100:00100000:1.0:1746140881.862450:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573538304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.862463:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.862483:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009272d000/0x8156357b7fdb8ec6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c3e expref: 11 pid: 4785 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.862494:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009272d000/0x8156357b7fdb8ec6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c3e expref: 11 pid: 4785 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.862518:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009272d000/0x8156357b7fdb8ec6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c3e expref: 11 pid: 4785 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.862538:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.862560:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573538304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 110us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.862567:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8517 00000100:00100000:3.0:1746140881.867793:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573537280:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11946us (12167us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140881.867804:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1742 00002000:00100000:3.0:1746140881.867816:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a55e3100 x1830960573537280/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.867825:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e3100 with x1830960573537280 ext(3145728->4194303) 00010000:00010000:3.0:1746140881.867835:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 29 pid: 8460 timeout: 960 lvb_type: 1 00010000:00010000:3.0:1746140881.867846:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 29 pid: 8460 timeout: 960 lvb_type: 1 00002000:00010000:3.0:1746140881.867853:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55e3100 00000100:00100000:0.0:1746140881.868720:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.868769:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573538432 00000100:00100000:1.0:1746140881.868777:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573538432 00000100:00100000:0.0:1746140881.868842:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16474 00000100:00100000:0.0:1746140881.868851:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+34:32465:x1830960573538432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140881.868865:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.868880:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0cfb expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.868908:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.868910:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140881.868917:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 35 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.868931:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 35 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.868942:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f61c00, rc 0) 00000100:00100000:0.0:1746140881.868980:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+35:32465:x1830960573538432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 131us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140881.868985:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16474 00000100:00100000:0.0:1746140881.873037:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.873104:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573538560 00000100:00100000:1.0:1746140881.873112:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573538560 00010000:00010000:1.0:1746140881.873142:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 29 pid: 8460 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.873189:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8518 00000100:00100000:1.0:1746140881.873195:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573538560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.873207:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.873227:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 29 pid: 8460 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.873236:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 29 pid: 8460 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.873257:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dfd4e00/0x8156357b7fdb8fec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cbc expref: 29 pid: 8460 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.873284:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140881.873286:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573537664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15156us (16001us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746140881.873286:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140881.873293:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1743 00010000:00010000:1.0:1746140881.873293:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140881.873299:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8800a55e0000 x1830960573537664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746140881.873318:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140881.873322:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e0000 with x1830960573537664 ext(2097152->3145727) 00010000:00010000:3.0:1746140881.873328:0:21640:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 31 pid: 20960 timeout: 960 lvb_type: 1 00010000:00010000:3.0:1746140881.873336:0:21640:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 31 pid: 20960 timeout: 960 lvb_type: 1 00002000:00010000:3.0:1746140881.873347:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a55e0000 00010000:00010000:1.0:1746140881.873355:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.873366:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575978496:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.873500:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387180 going to sleep for 11 seconds 00000100:00100000:0.0:1746140881.877608:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.877708:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575978496:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.877731:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.877775:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573538560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4579us (4738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.877785:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8518 00000100:00100000:3.0:1746140881.878153:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573538816 00000100:00100000:3.0:1746140881.878172:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573538816 00002000:00100000:3.0:1746140881.878206:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3215360->3219455) req@ffff8801355bc700 x1830960573538816/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.878213:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bc700 with x1830960573538816 ext(3215360->3219455) 00002000:00010000:3.0:1746140881.878216:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bc700 00000100:00100000:3.0:1746140881.878229:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8454 00000100:00100000:3.0:1746140881.878235:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573538816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140881.878424:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573538816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 188us (826us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140881.878430:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8454 00002000:00100000:3.0:1746140881.878435:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3215360->3219455) req@ffff8801355bc700 x1830960573538816/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.878442:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bc700 with x1830960573538816 ext(3215360->3219455) 00002000:00010000:3.0:1746140881.878444:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bc700 00000100:00100000:0.0:1746140881.880922:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.880955:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.880985:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573539328 00000100:00100000:0.0:1746140881.880992:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.880995:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573539328 00002000:00100000:3.0:1746140881.881033:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801355bea00 x1830960573539328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 504/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.881042:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bea00 with x1830960573539328 ext(3145728->4194303) 00002000:00010000:3.0:1746140881.881046:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bea00 00000100:00100000:3.0:1746140881.881069:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8456 00000100:00100000:3.0:1746140881.881074:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573539328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140881.881525:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573539456 00000100:00100000:1.0:1746140881.881533:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573539456 00010000:00010000:1.0:1746140881.881555:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 32 pid: 20960 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.881576:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8519 00000100:00100000:1.0:1746140881.881580:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1982:x1830960573539456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.881589:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.881604:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 32 pid: 20960 timeout: 960 lvb_type: 1 00000100:00100000:0.0:1746140881.881614:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.881619:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 32 pid: 20960 timeout: 960 lvb_type: 1 00000100:00100000:0.0:1746140881.881634:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573539584 00000100:00100000:0.0:1746140881.881637:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573539584 00010000:00010000:1.0:1746140881.881640:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f60c00/0x8156357b7fdb8ff3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cc3 expref: 32 pid: 20960 timeout: 960 lvb_type: 1 00000100:00100000:0.0:1746140881.881656:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16475 00010000:00010000:1.0:1746140881.881657:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140881.881661:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:32464:x1830960573539584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140881.881669:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.881680:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d02 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.881699:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.881704:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140881.881706:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140881.881709:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d02 expref: 33 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.881733:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140881.881742:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 28 pid: 20960 timeout: 960 lvb_type: 0 00000100:00100000:0.0:1746140881.881752:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575978624:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140881.881809:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3faf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140881.882372:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1982:x1830960573539456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 789us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.882379:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8519 00000100:00100000:1.0:1746140881.883251:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575978624:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140881.883272:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d02 expref: 33 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.883274:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140881.883284:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f60a00, rc 0) 00000100:00100000:1.0:1746140881.883320:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:32464:x1830960573539584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1659us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.883327:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16475 00000100:00100000:1.0:1746140881.883346:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573539712 00000100:00100000:1.0:1746140881.883350:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573539712 00010000:00010000:1.0:1746140881.883365:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cb5 expref: 39 pid: 9872 timeout: 960 lvb_type: 1 00000100:00100000:1.0:1746140881.883392:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8520 00000100:00100000:1.0:1746140881.883398:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1983:x1830960573539712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.883409:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.883424:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cb5 expref: 39 pid: 9872 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.883433:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cb5 expref: 39 pid: 9872 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.883447:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f60e00/0x8156357b7fdb8fe5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cb5 expref: 39 pid: 9872 timeout: 960 lvb_type: 1 00010000:00010000:1.0:1746140881.883456:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.883458:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.883463:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 38 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.883471:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 38 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.883495:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 38 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.883505:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575978752:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.883559:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387180 going to sleep for 11 seconds 00000100:00100000:0.0:1746140881.887837:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.888039:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575978752:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.888060:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.888108:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1983:x1830960573539712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4709us (4832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.888118:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8520 00000100:00100000:3.0:1746140881.889795:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573539328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8716us (8878us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746140881.889803:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8456 00002000:00100000:3.0:1746140881.889810:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801355bea00 x1830960573539328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 504/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.889818:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bea00 with x1830960573539328 ext(3145728->4194303) 00010000:00010000:3.0:1746140881.889826:0:21640:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 28 pid: 20960 timeout: 960 lvb_type: 0 00010000:00010000:3.0:1746140881.889840:0:21640:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 28 pid: 20960 timeout: 960 lvb_type: 0 00002000:00010000:3.0:1746140881.889847:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801355bea00 00000100:00100000:0.0:1746140881.895700:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.895772:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573540096 00000100:00100000:1.0:1746140881.895783:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573540096 00000100:00100000:1.0:1746140881.895838:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16476 00000100:00100000:1.0:1746140881.895845:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:32459:x1830960573540096:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140881.895862:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140881.895878:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d09 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.895906:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140881.895908:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140881.895912:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4194304->4595711] (req 4194304->4595711) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 34 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.895923:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4194304->4595711] (req 4194304->4595711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 34 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.895933:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff11400, rc 0) 00000100:00100000:1.0:1746140881.895990:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:32459:x1830960573540096:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 145us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.895997:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16476 00000100:00100000:0.0:1746140881.896508:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.898847:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.902965:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573540736 00000100:00100000:3.0:1746140881.902975:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573540736 00000100:00100000:3.0:1746140881.903037:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4635 00000100:00100000:3.0:1746140881.903045:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32461:x1830960573540736:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140881.903793:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32461:x1830960573540736:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 748us (917us total) trans 8589944890 rc 0/0 00000100:00100000:3.0:1746140881.903801:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4635 00000100:00100000:0.0:1746140881.914297:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.914365:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573540864 00000100:00100000:1.0:1746140881.914375:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573540864 00010000:00010000:1.0:1746140881.914410:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 31 pid: 20960 timeout: 960 lvb_type: 0 00000100:00100000:1.0:1746140881.914449:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8521 00000100:00100000:1.0:1746140881.914456:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573540864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.914468:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.914491:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 31 pid: 20960 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.914503:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 31 pid: 20960 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.914524:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2ee200/0x8156357b7fdb902b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3215360->4124671) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ced expref: 31 pid: 20960 timeout: 960 lvb_type: 0 00010000:00010000:1.0:1746140881.914555:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.914604:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.914611:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d02 expref: 33 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.914619:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d02 expref: 33 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.914627:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.914628:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.914631:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 33 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.914637:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 33 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.914642:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.914644:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.914646:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa48400/0x8156357b7fdb904e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d10 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.914652:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48400/0x8156357b7fdb904e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d10 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.914682:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa48400/0x8156357b7fdb904e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d10 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.914694:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575978880:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.914782:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 33 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.914790:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575979008:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.914813:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d02 expref: 33 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.914819:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575979136:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.914832:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387180 going to sleep for 11 seconds 00000100:00100000:1.0:1746140881.916668:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575978880:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.916679:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575979008:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.916686:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575979136:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.916705:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.916750:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573540864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2293us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.916761:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8521 00000100:00100000:0.0:1746140881.920294:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.920378:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.920634:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573541120 00000100:00100000:3.0:1746140881.920644:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573541120 00002000:00100000:3.0:1746140881.920873:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801355bf480 x1830960573541120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.920890:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bf480 with x1830960573541120 ext(3145728->4194303) 00002000:00010000:3.0:1746140881.920896:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bf480 00000100:00100000:3.0:1746140881.920923:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573541376 00000100:00100000:3.0:1746140881.920926:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573541376 00002000:00100000:3.0:1746140881.920939:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801355be680 x1830960573541376/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.920946:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355be680 with x1830960573541376 ext(3145728->4194303) 00002000:00010000:3.0:1746140881.920949:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355be680 00000100:00100000:3.0:1746140881.920970:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8458 00000100:00100000:3.0:1746140881.920977:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573541120:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140881.921081:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8459 00000100:00100000:0.0:1746140881.921088:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573541376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140881.921500:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.928656:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.928783:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573541888 00000100:00100000:3.0:1746140881.928792:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573541888 00000100:00100000:3.0:1746140881.928847:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4636 00000100:00100000:3.0:1746140881.928854:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a97b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32459:x1830960573541888:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140881.929086:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a97b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32459:x1830960573541888:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 231us (439us total) trans 8589944891 rc 0/0 00000100:00100000:3.0:1746140881.929093:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4636 00000100:00100000:1.0:1746140881.938686:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573541120:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 17700us (18393us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140881.938697:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8458 00002000:00100000:1.0:1746140881.938707:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801355bf480 x1830960573541120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.938716:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bf480 with x1830960573541120 ext(3145728->4194303) 00002000:00010000:1.0:1746140881.938720:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bf480 00000100:00100000:0.0:1746140881.940445:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.943494:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.943595:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.943625:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573542272 00000100:00100000:3.0:1746140881.943635:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573542272 00000100:00100000:3.0:1746140881.943677:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16479 00000100:00100000:3.0:1746140881.943683:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:32464:x1830960573542272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.943697:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.943711:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d1e expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.943732:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140881.943737:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 39 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.943745:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 39 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.943752:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c9f2e00, rc 0) 00000100:00100000:3.0:1746140881.943770:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:32464:x1830960573542272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.943775:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16479 00000100:00100000:1.0:1746140881.943827:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573542144 00000100:00100000:1.0:1746140881.943832:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573542144 00002000:00100000:1.0:1746140881.943859:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3686400->4194303) req@ffff8800a51cd180 x1830960573542144/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.943868:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cd180 with x1830960573542144 ext(3686400->4194303) 00010000:00010000:1.0:1746140881.943873:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 39 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140881.943885:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 39 pid: 20960 timeout: 961 lvb_type: 0 00002000:00010000:1.0:1746140881.943891:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a51cd180 00000100:00100000:1.0:1746140881.943915:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1747 00000100:00100000:1.0:1746140881.943921:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573542144:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140881.951296:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573542144:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7366us (7691us total) trans 17179874009 rc 0/0 00000100:00100000:1.0:1746140881.951330:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1747 00002000:00100000:1.0:1746140881.951342:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3686400->4194303) req@ffff8800a51cd180 x1830960573542144/t17179874009(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/448 e 0 to 0 dl 1746140892 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.951351:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cd180 with x1830960573542144 ext(3686400->4194303) 00010000:00010000:1.0:1746140881.951361:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 41 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140881.951375:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 41 pid: 20960 timeout: 961 lvb_type: 0 00002000:00010000:1.0:1746140881.951381:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a51cd180 00000100:00100000:0.0:1746140881.956468:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.956559:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573542400 00000100:00100000:1.0:1746140881.956568:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573542400 00010000:00010000:1.0:1746140881.956603:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 41 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140881.956630:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8522 00000100:00100000:1.0:1746140881.956638:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1982:x1830960573542400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.956652:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.956670:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 41 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140881.956679:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 41 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140881.956705:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3600/0x8156357b7fdb9032 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cf4 expref: 41 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140881.956736:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.956738:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.956744:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e305800/0x8156357b7fdb9055 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d17 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.956751:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e305800/0x8156357b7fdb9055 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d17 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.956758:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.956759:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.956762:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.956768:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.956894:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.956906:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575979392:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.957425:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e305800/0x8156357b7fdb9055 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d17 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.957437:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575979520:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.957462:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387180 going to sleep for 11 seconds 00000100:00100000:1.0:1746140881.959280:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575979392:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.959290:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575979520:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.959324:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.959357:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573542400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2721us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.959366:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8522 00000100:00100000:0.0:1746140881.960954:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.961112:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573542656 00000100:00100000:1.0:1746140881.961120:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573542656 00002000:00100000:1.0:1746140881.961172:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8800a51cf100 x1830960573542656/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.961182:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cf100 with x1830960573542656 ext(3145728->4194303) 00002000:00010000:1.0:1746140881.961186:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51cf100 00000100:00100000:1.0:1746140881.961214:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8461 00000100:00100000:1.0:1746140881.961222:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1982:x1830960573542656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140881.964044:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.964551:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573542912 00000100:00100000:3.0:1746140881.964560:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573542912 00002000:00100000:3.0:1746140881.964600:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8800a51cf480 x1830960573542912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.964611:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cf480 with x1830960573542912 ext(3145728->4194303) 00002000:00010000:3.0:1746140881.964616:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51cf480 00000100:00100000:3.0:1746140881.964640:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8462 00000100:00100000:3.0:1746140881.964648:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573542912:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140881.973151:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1982:x1830960573542656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11917us (12193us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140881.973173:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8461 00002000:00100000:1.0:1746140881.973185:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8800a51cf100 x1830960573542656/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.973195:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cf100 with x1830960573542656 ext(3145728->4194303) 00002000:00010000:1.0:1746140881.973201:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51cf100 00000100:00100000:3.0:1746140881.976636:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573542912:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11978us (12592us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140881.976648:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8462 00002000:00100000:3.0:1746140881.976659:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8800a51cf480 x1830960573542912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.976675:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cf480 with x1830960573542912 ext(3145728->4194303) 00002000:00010000:3.0:1746140881.976680:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51cf480 00000100:00100000:0.0:1746140881.977185:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.977358:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573543040 00000100:00100000:3.0:1746140881.977366:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573543040 00000100:00100000:3.0:1746140881.977423:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16480 00000100:00100000:3.0:1746140881.977429:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573543040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.977445:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.977460:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb9063 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d25 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140881.977511:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575979648:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140881.977933:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744240 going to sleep for 11 seconds 00000100:00100000:3.0:1746140881.978875:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575979648:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140881.978909:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb9063 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d25 expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140881.978922:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb9063 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d25 expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140881.978977:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c9f2a00, rc 0) 00000100:00100000:3.0:1746140881.979023:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573543040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1593us (1838us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140881.979031:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16480 00000100:00100000:0.0:1746140881.980413:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140881.980453:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.980464:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573543168 00000100:00100000:3.0:1746140881.980472:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573543168 00000100:00100000:3.0:1746140881.980505:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573543296 00000100:00100000:3.0:1746140881.980507:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573543296 00000100:00100000:0.0:1746140881.980519:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16481 00000100:00100000:0.0:1746140881.980529:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573543168:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140881.980538:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16482 00000100:00100000:3.0:1746140881.980544:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+30:32465:x1830960573543296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140881.980545:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.980551:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140881.980560:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009252ae00/0x8156357b7fdb9071 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d2c expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.980561:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d33 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.980608:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960575979776:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140881.980657:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 35 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.980665:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140881.980666:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140881.980669:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->4886527] (req 4194304->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d33 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140881.980681:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3facc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140881.980691:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 35 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.980702:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 35 pid: 4186 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140881.980711:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575979904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140881.980907:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744240 going to sleep for 11 seconds 00000100:00100000:3.0:1746140881.982132:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960575979904:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140881.982148:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->4886527] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d33 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.982172:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c9f2800, rc 0) 00000100:00100000:3.0:1746140881.982436:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+31:32465:x1830960573543296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1890us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.982444:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16482 00000100:00100000:0.0:1746140881.982839:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.982936:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573543424 00000100:00100000:3.0:1746140881.982942:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573543424 00002000:00100000:3.0:1746140881.982973:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4595711) req@ffff8800a51cce00 x1830960573543424/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.982992:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cce00 with x1830960573543424 ext(4194304->4595711) 00010000:00010000:3.0:1746140881.982998:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 34 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140881.983010:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 34 pid: 4186 timeout: 961 lvb_type: 0 00002000:00010000:3.0:1746140881.983016:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cce00 00000100:00100000:3.0:1746140881.983030:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1748 00000100:00100000:3.0:1746140881.983037:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573543424:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140881.986619:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573543552 00000100:00100000:3.0:1746140881.986628:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573543552 00000100:00100000:3.0:1746140881.986676:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16483 00000100:00100000:3.0:1746140881.986684:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32464:x1830960573543552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140881.986701:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140881.986718:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d3a expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.986744:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140881.986750:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4595712->4886527] (req 4595712->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d3a expref: 37 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.986760:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4595712->4886527] (req 4595712->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d3a expref: 37 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140881.986769:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3600, rc 0) 00000100:00100000:3.0:1746140881.986808:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:32464:x1830960573543552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140881.986815:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16483 00000100:00100000:3.0:1746140881.991215:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573543424:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8165us (8364us total) trans 21474841281 rc 0/0 00000100:00100000:3.0:1746140881.991986:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1748 00002000:00100000:3.0:1746140881.992003:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4595711) req@ffff8800a51cce00 x1830960573543424/t21474841281(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/448 e 0 to 0 dl 1746140892 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.992015:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cce00 with x1830960573543424 ext(4194304->4595711) 00010000:00010000:3.0:1746140881.992027:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 37 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140881.992045:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 37 pid: 4186 timeout: 961 lvb_type: 0 00002000:00010000:3.0:1746140881.992052:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cce00 00000100:00100000:0.0:1746140881.994197:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.994273:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573543680 00000100:00100000:1.0:1746140881.994282:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573543680 00010000:00010000:1.0:1746140881.994349:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 37 pid: 4186 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140881.994373:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8523 00000100:00100000:1.0:1746140881.994380:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573543680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140881.994392:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140881.994413:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 37 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140881.994425:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 37 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140881.994448:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff11400/0x8156357b7fdb9047 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d09 expref: 37 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140881.994472:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.994474:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.994481:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d33 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.994489:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d33 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.994497:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.994499:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140881.994502:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4595712->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d3a expref: 36 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.994508:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4595712->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d3a expref: 36 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140881.994538:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4595712->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d3a expref: 36 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.994551:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575980032:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.994645:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d33 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140881.994653:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575980160:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.994671:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140881.996582:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575980032:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140881.996596:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960575980160:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140881.996615:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140881.996651:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573543680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2271us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140881.996660:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8523 00000100:00100000:0.0:1746140881.997262:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140881.997478:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573543936 00000100:00100000:3.0:1746140881.997486:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573543936 00002000:00100000:3.0:1746140881.997522:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8800a51cc000 x1830960573543936/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140881.997532:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cc000 with x1830960573543936 ext(4194304->4886527) 00002000:00010000:3.0:1746140881.997537:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cc000 00000100:00100000:3.0:1746140881.997567:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8463 00000100:00100000:3.0:1746140881.997573:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573543936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140881.998749:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140881.998825:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573544192 00000100:00100000:1.0:1746140881.998831:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573544192 00002000:00100000:1.0:1746140881.998857:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4595712->4886527) req@ffff8800a51ce300 x1830960573544192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/0 e 0 to 0 dl 1746140892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140881.998870:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ce300 with x1830960573544192 ext(4595712->4886527) 00002000:00010000:1.0:1746140881.998874:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ce300 00000100:00100000:1.0:1746140881.998888:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8464 00000100:00100000:1.0:1746140881.998894:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573544192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.003386:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573544192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4483us (4630us total) trans 0 rc 290816/290816 00000100:00100000:1.0:1746140882.003398:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8464 00002000:00100000:1.0:1746140882.003409:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4595712->4886527) req@ffff8800a51ce300 x1830960573544192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 290816/290816 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.003419:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ce300 with x1830960573544192 ext(4595712->4886527) 00002000:00010000:1.0:1746140882.003424:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ce300 00000100:00100000:3.0:1746140882.003502:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573543936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5922us (6234us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140882.003511:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8463 00002000:00100000:3.0:1746140882.003519:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8800a51cc000 x1830960573543936/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:297/0 lens 488/440 e 0 to 0 dl 1746140892 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.003527:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cc000 with x1830960573543936 ext(4194304->4886527) 00002000:00010000:3.0:1746140882.003531:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cc000 00000100:00100000:0.0:1746140882.008483:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140882.008618:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140882.009364:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.009483:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573544704 00000100:00100000:3.0:1746140882.009494:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573544704 00000100:00100000:3.0:1746140882.009549:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4638 00000100:00100000:3.0:1746140882.009556:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32465:x1830960573544704:12345-192.168.204.16@tcp:35:cat.0 00000100:00080000:0.0:1746140882.009692:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746140882.009808:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32465:x1830960573544704:12345-192.168.204.16@tcp:35:cat.0 Request processed in 251us (443us total) trans 8589944893 rc 0/0 00000100:00100000:3.0:1746140882.009814:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4638 00000100:00100000:0.0:1746140882.017532:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.017651:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573544832 00000100:00100000:1.0:1746140882.017659:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573544832 00000100:00100000:1.0:1746140882.017766:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10617 00000100:00100000:1.0:1746140882.017774:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:32470:x1830960573544832:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140882.017798:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.017816:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf000/0x8156357b7fdb907f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d41 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.017875:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.017889:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.017900:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.017912:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.017917:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.017922:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018036:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018043:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018048:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140882.018078:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140882.018082:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140882.018095:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018104:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018116:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018122:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018127:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018136:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012febf200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140882.018140:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018146:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018166:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140882.018169:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140882.018173:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018178:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf200/0x8156357b7fdb9086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00000100:00080000:0.0:1746140882.018250:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746140882.018455:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018461:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018465:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018469:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012febe600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140882.018472:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018477:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018483:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293000) 00010000:00010000:1.0:1746140882.018485:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140882.018488:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018492:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febe600/0x8156357b7fdb908d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.018518:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf000/0x8156357b7fdb907f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.018526:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.018532:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140882.018534:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140882.018536:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012febee00, rc 0) 00000100:00100000:1.0:1746140882.018592:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32470:x1830960573544832:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 819us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.018598:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10617 00000100:00100000:0.0:1746140882.022776:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.023048:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.023080:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573545088 00000100:00100000:3.0:1746140882.023093:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573545088 00000100:00100000:3.0:1746140882.023123:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16485 00000100:00100000:3.0:1746140882.023128:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573545088:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140882.023136:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.023145:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d4f expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.023166:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.023167:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.023172:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.023185:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.023194:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c6b800, rc 0) 00000100:00100000:3.0:1746140882.023721:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573545088:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 591us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.023726:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16485 00000100:00100000:0.0:1746140882.026529:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.026574:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573545344 00000100:00100000:1.0:1746140882.026583:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573545344 00000100:00100000:1.0:1746140882.026638:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10618 00000100:00100000:1.0:1746140882.026645:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32470:x1830960573545344:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140882.026662:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.026679:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf400/0x8156357b7fdb90a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d56 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.026842:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.026855:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.026863:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.026892:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.026903:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 8 pid: 14742 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.026915:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575980288:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.027010:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.029052:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575980288:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.029077:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140882.029133:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.029269:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573545472 00000100:00100000:1.0:1746140882.029275:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573545472 00010000:00010000:1.0:1746140882.029334:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 9 pid: 14742 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.029362:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8524 00000100:00100000:1.0:1746140882.029368:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573545472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.029379:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140882.029384:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 9 pid: 14742 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.029393:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 9 pid: 14742 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.029411:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febee00/0x8156357b7fdb9094 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d41 expref: 9 pid: 14742 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.029439:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140882.029444:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.029452:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.029457:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.029473:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.029502:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573545472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.029507:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8524 00010000:00010000:1.0:1746140882.029524:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.029530:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140882.029556:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140882.029845:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf400/0x8156357b7fdb90a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d56 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.029856:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d56 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.029865:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140882.029868:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746140882.029870:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012febf600, rc 0) 00000100:00100000:1.0:1746140882.029903:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32470:x1830960573545344:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3259us (3384us total) trans 8589944894 rc 0/0 00000100:00100000:1.0:1746140882.029909:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10618 00000100:00100000:0.0:1746140882.031188:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.031251:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573545600 00000100:00100000:1.0:1746140882.031256:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573545600 00000100:00100000:1.0:1746140882.031293:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10619 00000100:00100000:1.0:1746140882.031300:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32470:x1830960573545600:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140882.031369:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.031382:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfa00/0x8156357b7fdb90be lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d5d expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.031441:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfe00/0x8156357b7fdb90c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.031452:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d56 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.031458:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfe00/0x8156357b7fdb90c5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.031483:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d56 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.031494:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febf600/0x8156357b7fdb90b0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d56 expref: 9 pid: 14742 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.031509:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575980416:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.031752:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.034931:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.035133:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575980416:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.035167:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfe00/0x8156357b7fdb90c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.036815:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfe00/0x8156357b7fdb90c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.036826:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfe00/0x8156357b7fdb90c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140882.036867:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140882.036871:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140882.036886:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfe00/0x8156357b7fdb90c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.036918:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfa00/0x8156357b7fdb90be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d5d expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.036985:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfe00/0x8156357b7fdb90c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d5d expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.036993:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.036996:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140882.036998:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012febfe00, rc 0) 00000100:00100000:3.0:1746140882.037024:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32470:x1830960573545600:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5725us (5839us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.037030:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10619 00000100:00100000:0.0:1746140882.040775:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.040884:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573545984 00000100:00100000:3.0:1746140882.040895:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573545984 00000100:00100000:3.0:1746140882.041011:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10620 00000100:00100000:3.0:1746140882.041019:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32470:x1830960573545984:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140882.041039:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.041056:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c6ba00/0x8156357b7fdb90cc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d64 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.041161:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c6bc00/0x8156357b7fdb90d3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.041174:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c6bc00/0x8156357b7fdb90d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.041184:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c6bc00/0x8156357b7fdb90d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140882.041196:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140882.041658:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c6ba00/0x8156357b7fdb90cc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d64 expref: 11 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.041675:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c6bc00/0x8156357b7fdb90d3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d64 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.041682:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.041685:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140882.041687:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c6bc00, rc 0) 00000100:00100000:3.0:1746140882.041871:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:32470:x1830960573545984:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 852us (1107us total) trans 8589944895 rc 0/0 00000100:00100000:3.0:1746140882.041877:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10620 00000100:00100000:0.0:1746140882.043610:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.043635:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.043995:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573546240 00000100:00100000:0.0:1746140882.044003:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.044004:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573546240 00000100:00100000:0.0:1746140882.044028:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.044046:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573546496 00000100:00100000:0.0:1746140882.044047:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573546752 00000100:00100000:3.0:1746140882.044048:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573546496 00000100:00100000:0.0:1746140882.044050:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573546752 00000100:00100000:0.0:1746140882.044069:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573546112 00000100:00100000:0.0:1746140882.044071:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573546112 00000100:00100000:3.0:1746140882.044074:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16486 00000100:00100000:3.0:1746140882.044081:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573546240:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:0.0:1746140882.044086:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16487 00000100:00100000:0.0:1746140882.044090:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573546496:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140882.044115:0:8460:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.044116:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb90e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044133:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092995200/0x8156357b7fdb8eaa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c22 expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140882.044133:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936f2000/0x8156357b7fdb8ebf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c30 expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.044141:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fcef400/0x8156357b7fdb8fc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c92 expref: 30 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.044141:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044148:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009252b200/0x8156357b7fdb8fa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c76 expref: 39 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.044149:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093877400/0x8156357b7fdb8fc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c99 expref: 35 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.044168:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.044170:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.044173:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.044173:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb90e1 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044174:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.044177:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.044199:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16488 00010000:00010000:0.0:1746140882.044202:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093877400/0x8156357b7fdb8fc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c99 expref: 35 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.044215:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573546752:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746140882.044215:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093877400/0x8156357b7fdb8fc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c99 expref: 35 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.044217:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009252b200/0x8156357b7fdb8fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c76 expref: 39 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044226:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009252b200/0x8156357b7fdb8fa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c76 expref: 39 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.044228:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b751880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575980544:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.044236:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575980672:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.044255:0:8458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044272:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 30 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044280:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e305800/0x8156357b7fdb9055 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d17 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.044286:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16489 00010000:00010000:1.0:1746140882.044287:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 12 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140882.044294:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573546112:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746140882.044294:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 39 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.044294:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044300:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.044301:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.044327:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 30 pid: 9872 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.044329:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044337:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.044341:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b751c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575980800:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.044348:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.044355:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009252ac00/0x8156357b7fdb8fad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c84 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044355:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 39 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044362:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093877600/0x8156357b7fdb8f67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c5a expref: 35 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044366:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 39 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:0.0:1746140882.044371:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936f2000/0x8156357b7fdb8ebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c30 expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.044372:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.044373:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.044376:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.044378:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575980928:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140882.044380:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936f2000/0x8156357b7fdb8ebf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c30 expref: 12 pid: 8460 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.044387:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b751f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960575981056:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.044392:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093877600/0x8156357b7fdb8f67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c5a expref: 35 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044401:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093877600/0x8156357b7fdb8f67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c5a expref: 35 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.044410:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575981184:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.044436:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009252ac00/0x8156357b7fdb8fad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c84 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044444:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009252ac00/0x8156357b7fdb8fad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c84 expref: 30 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.044451:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575981312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.044472:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.044480:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 12 pid: 8460 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.044492:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575981440:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.044509:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b16c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140882.044534:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fcef400/0x8156357b7fdb8fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c92 expref: 30 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.044542:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fcef400/0x8156357b7fdb8fc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c92 expref: 30 pid: 8460 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.044550:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575981568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.044580:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092995200/0x8156357b7fdb8eaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c22 expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.044581:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 12 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.044589:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092995200/0x8156357b7fdb8eaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c22 expref: 12 pid: 9872 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.044590:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 12 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.044597:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575981824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.044599:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575981696:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.044609:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b19c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746140882.044620:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e305800/0x8156357b7fdb9055 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d17 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044627:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e305800/0x8156357b7fdb9055 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d17 expref: 30 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.044633:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575981952:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.044648:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 30 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044658:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 30 pid: 4186 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.044663:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575982080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.044673:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.044754:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.044811:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.044827:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573546368 00000100:00100000:1.0:1746140882.044834:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573546368 00000100:00100000:0.0:1746140882.044870:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.044876:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573546624 00000100:00100000:1.0:1746140882.044879:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573546624 00000100:00100000:1.0:1746140882.044893:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16490 00000100:00100000:1.0:1746140882.044898:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573546368:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746140882.044916:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044926:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092995c00/0x8156357b7fdb8eb8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c29 expref: 13 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.044933:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f60200/0x8156357b7fdb8fd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca0 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044939:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb8fbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c8b expref: 39 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044944:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.044945:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.044947:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044962:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb8fbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c8b expref: 39 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.044968:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb8fbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c8b expref: 39 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.044975:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575982208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.045003:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f60200/0x8156357b7fdb8fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca0 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.045009:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f60200/0x8156357b7fdb8fd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca0 expref: 30 pid: 9872 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.045016:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575982336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.045065:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092995c00/0x8156357b7fdb8eb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c29 expref: 13 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.045071:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092995c00/0x8156357b7fdb8eb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c29 expref: 13 pid: 9872 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.045078:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575982464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.045092:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.053068:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.053092:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.053137:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575981184:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.053227:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573546880 00000100:00100000:3.0:1746140882.053232:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575980672:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.053234:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573546880 00000100:00100000:0.0:1746140882.053246:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.053263:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573547136 00000100:00100000:3.0:1746140882.053266:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573547136 00010000:00010000:1.0:1746140882.053267:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093877400/0x8156357b7fdb8fc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c99 expref: 36 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.053276:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.053288:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.053301:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573547264 00000100:00100000:1.0:1746140882.053326:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573547264 00000100:00100000:0.0:1746140882.053358:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.053367:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746140882.053380:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746140882.053386:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 32 pid: 9872 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.053404:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573547648 00000100:00100000:3.0:1746140882.053407:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573547648 00010000:00010000:3.0:1746140882.053417:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fcef400/0x8156357b7fdb8fc2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c92 expref: 31 pid: 8460 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.053425:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573547520 00000100:00100000:3.0:1746140882.053427:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573547520 00010000:00010000:1.0:1746140882.053647:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093877600/0x8156357b7fdb8f67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c5a expref: 37 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.053661:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 14 pid: 8460 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.053665:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8526 00000100:00100000:1.0:1746140882.053673:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573546880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140882.053681:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8528 00010000:00010000:1.0:1746140882.053685:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140882.053686:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573547136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.053693:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.053711:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 32 pid: 9872 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.053713:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093877400/0x8156357b7fdb8fc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c99 expref: 37 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.053721:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 32 pid: 9872 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.053907:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093877400/0x8156357b7fdb8fc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c99 expref: 37 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.053925:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140882.053928:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093877400/0x8156357b7fdb8fc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c99 expref: 37 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.053939:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140882.053947:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140882.053948:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.053959:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.054005:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f61800/0x8156357b7fdb8fd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca7 expref: 32 pid: 9872 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.054020:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140882.054166:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.054176:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.054185:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.054193:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.054227:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.054241:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.054250:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.054259:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.054266:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.054271:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573546880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 598us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.054279:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8526 00000100:00100000:1.0:1746140882.054294:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573547776 00000100:00100000:1.0:1746140882.054297:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573547776 00010000:00010000:1.0:1746140882.054323:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092995200/0x8156357b7fdb8eaa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c22 expref: 15 pid: 9872 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.054338:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573548544 00000100:00100000:1.0:1746140882.054340:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573548544 00010000:00010000:1.0:1746140882.054350:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 32 pid: 4186 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.054358:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573547904 00000100:00100000:1.0:1746140882.054359:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573547904 00010000:00010000:1.0:1746140882.054367:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 16 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.054374:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573548672 00000100:00100000:1.0:1746140882.054375:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573548672 00010000:00010000:1.0:1746140882.054382:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e305800/0x8156357b7fdb9055 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d17 expref: 33 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.054389:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573549184 00000100:00100000:1.0:1746140882.054391:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573549184 00010000:00010000:1.0:1746140882.054398:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63e600/0x8156357b7fdb909b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d48 expref: 16 pid: 4186 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.054406:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573548928 00000100:00100000:1.0:1746140882.054407:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573548928 00010000:00010000:1.0:1746140882.054415:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa48400/0x8156357b7fdb904e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d10 expref: 32 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.054422:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573549312 00000100:00100000:1.0:1746140882.054423:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573549312 00010000:00010000:1.0:1746140882.054429:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d33 expref: 33 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.054436:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573548800 00000100:00100000:1.0:1746140882.054438:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573548800 00010000:00010000:1.0:1746140882.054445:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 40 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.054451:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573549056 00000100:00100000:1.0:1746140882.054453:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573549056 00010000:00010000:1.0:1746140882.054460:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4595712->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d3a expref: 34 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.054470:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8532 00000100:00100000:1.0:1746140882.054474:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573547520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.054481:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140882.054491:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 16 pid: 8460 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.054498:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 16 pid: 8460 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.054509:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.054510:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.054514:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.054523:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.054544:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.054637:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1984:x1830960573547136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 949us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.054643:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8528 00000100:00100000:3.0:1746140882.054709:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8534 00000100:00100000:3.0:1746140882.054716:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573548416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.054723:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.054737:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092995c00/0x8156357b7fdb8eb8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c29 expref: 16 pid: 9872 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.054745:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092995c00/0x8156357b7fdb8eb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c29 expref: 16 pid: 9872 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.054755:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.055236:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573547520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 758us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.055244:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8532 00000100:00100000:3.0:1746140882.055248:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573548416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 531us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.055255:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8534 00000100:00100000:1.0:1746140882.055260:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8535 00000100:00100000:1.0:1746140882.055266:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573548032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140882.055272:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8537 00010000:00010000:1.0:1746140882.055274:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140882.055277:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+15:1983:x1830960573547776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.055284:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140882.055285:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936f2000/0x8156357b7fdb8ebf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c30 expref: 15 pid: 8460 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.055294:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936f2000/0x8156357b7fdb8ebf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c30 expref: 15 pid: 8460 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.055295:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092995200/0x8156357b7fdb8eaa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c22 expref: 15 pid: 9872 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.055317:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092995200/0x8156357b7fdb8eaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c22 expref: 15 pid: 9872 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.055320:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.055322:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.055325:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb90e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055327:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.055328:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.055331:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055331:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2a00/0x8156357b7fdb90e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055341:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055342:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140882.055349:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.055358:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573548032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.055363:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8535 00000100:00100000:3.0:1746140882.055366:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+15:1983:x1830960573547776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.055371:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8537 00000100:00100000:1.0:1746140882.055375:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8538 00000100:00100000:3.0:1746140882.055381:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8539 00000100:00100000:1.0:1746140882.055381:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1983:x1830960573548544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140882.055385:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573547904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.055387:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.055390:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.055396:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 14 pid: 20960 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.055396:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 32 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.055403:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 14 pid: 20960 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.055415:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 32 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.055425:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.055436:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573547904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 50us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.055441:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8539 00000100:00100000:3.0:1746140882.055448:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8541 00000100:00100000:3.0:1746140882.055451:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573549184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.055456:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.055464:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f63e600/0x8156357b7fdb909b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d48 expref: 14 pid: 4186 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.055466:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.055470:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f63e600/0x8156357b7fdb909b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d48 expref: 14 pid: 4186 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.055493:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.055504:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573549184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.055508:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8541 00000100:00100000:3.0:1746140882.055516:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573549440 00000100:00100000:3.0:1746140882.055520:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573549440 00010000:00010000:3.0:1746140882.055529:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d02 expref: 35 pid: 4186 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.055537:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8542 00000100:00100000:3.0:1746140882.055541:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573548928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.055545:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.055550:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa48400/0x8156357b7fdb904e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d10 expref: 31 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.055557:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa48400/0x8156357b7fdb904e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d10 expref: 31 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.055564:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140882.055564:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.055572:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573548928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 31us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.055576:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8542 00000100:00100000:1.0:1746140882.055579:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1983:x1830960573548544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 197us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.055583:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8543 00000100:00100000:3.0:1746140882.055586:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573549312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140882.055586:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8538 00010000:00010000:3.0:1746140882.055591:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.055595:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d33 expref: 30 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.055597:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8544 00010000:00010000:3.0:1746140882.055601:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb906a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d33 expref: 30 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.055602:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573548800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.055608:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140882.055608:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140882.055616:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573549312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 29us (1365us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140882.055616:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 39 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.055620:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8543 00010000:00010000:1.0:1746140882.055623:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 39 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.055627:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8545 00000100:00100000:3.0:1746140882.055631:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573549056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.055633:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140882.055635:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.055640:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4595712->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d3a expref: 35 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.055643:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573548800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 41us (1384us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140882.055647:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936f3600/0x8156357b7fdb9078 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4595712->4886527) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d3a expref: 35 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.055648:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8544 00010000:00010000:3.0:1746140882.055655:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.055657:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8546 00000100:00100000:1.0:1746140882.055662:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573549440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140882.055665:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573549056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 34us (1398us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140882.055668:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140882.055669:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8545 00010000:00010000:1.0:1746140882.055675:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d02 expref: 35 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.055684:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f60a00/0x8156357b7fdb9040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d02 expref: 34 pid: 4186 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.055693:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.055695:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.055697:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e800/0x8156357b7fdb9104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055703:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63e800/0x8156357b7fdb9104 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055708:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009252ac00/0x8156357b7fdb8fad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c84 expref: 29 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.055713:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.055719:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575981312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.055724:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573549440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (258us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140882.055728:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f2600/0x8156357b7fdb8eb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c1b expref: 13 pid: 8460 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.055729:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8546 00000100:00100000:3.0:1746140882.055736:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575981440:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.055752:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055760:0:4784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055760:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f60400/0x8156357b7fdb8fbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c8b expref: 38 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.055765:0:4784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.055771:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575982208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.055782:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f60200/0x8156357b7fdb8fd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ca0 expref: 30 pid: 9872 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.055783:0:4784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055788:0:4784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.055793:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575982336:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.055794:0:4784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055799:0:4784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8c400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140882.055802:0:4784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055803:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092995c00/0x8156357b7fdb8eb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c29 expref: 13 pid: 9872 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.055809:0:4784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.055814:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575982464:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.055817:0:4784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055822:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8c400/0x8156357b7fdb90f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055830:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055836:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055842:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.055855:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.055857:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573546112:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11565us (11829us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.055864:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16489 00010000:00010000:3.0:1746140882.055892:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fcef400/0x8156357b7fdb8fc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c92 expref: 29 pid: 8460 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.055899:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575981568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.055908:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092995200/0x8156357b7fdb8eaa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0c22 expref: 12 pid: 9872 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.055915:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960575981824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.055926:0:8460:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055936:0:8460:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055941:0:8460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055950:0:8460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055955:0:8460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055961:0:8460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055965:0:8460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130d29c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140882.055967:0:8460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055972:0:8460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055979:0:8460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.055985:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d29c00/0x8156357b7fdb90e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.056019:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573546240:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11939us (12414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.056025:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16486 00010000:00010000:1.0:1746140882.056034:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056040:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056044:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012febee00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140882.056047:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056052:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056061:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056065:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012febee00/0x8156357b7fdb90fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.056095:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573546368:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11195us (11284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.056100:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16490 00010000:00010000:1.0:1746140882.056127:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb905c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d1e expref: 37 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.056136:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575980928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.056146:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c6b800/0x8156357b7fdb90a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d4f expref: 9 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.056162:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575981696:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.056172:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e305800/0x8156357b7fdb9055 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d17 expref: 28 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.056180:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575981952:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.056189:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f61c00/0x8156357b7fdb9039 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cfb expref: 27 pid: 4186 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.056196:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575982080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.056209:0:8458:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056215:0:8458:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056219:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056231:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056238:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056243:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056248:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012febfc00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140882.056250:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056256:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056269:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.056275:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012febfc00/0x8156357b7fdb90ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.056339:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573546752:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12131us (12336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.056345:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16488 00000100:00100000:0.0:1746140882.057771:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.059507:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573549696 00000100:00100000:3.0:1746140882.059518:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573549696 00000100:00100000:3.0:1746140882.059571:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10621 00000100:00100000:3.0:1746140882.059578:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:32470:x1830960573549696:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:3.0:1746140882.059631:0:14742:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.059653:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012febfe00/0x8156357b7fdb90c5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d5d expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.059670:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.059674:0:14742:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140882.059702:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.059712:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.059720:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.059725:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.059731:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 6/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.059763:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.059774:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 268 pid: 14785 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.059786:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575983232:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.059894:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.059901:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.059908:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575983360:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.059934:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.059941:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 9 pid: 14741 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.059948:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575983488:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.059966:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140882.061547:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575983232:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140882.061554:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.061561:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575983488:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.061649:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573549824 00000100:00100000:1.0:1746140882.061656:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573549824 00000100:00100000:0.0:1746140882.061676:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140882.061694:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 269 pid: 14785 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.061701:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960575983360:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.061725:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:1.0:1746140882.061726:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573549952 00000100:00100000:1.0:1746140882.061728:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573549952 00010000:00010000:1.0:1746140882.061740:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 10 pid: 14741 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.061758:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8547 00000100:00100000:1.0:1746140882.061764:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960573549824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140882.061767:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8548 00000100:00100000:3.0:1746140882.061774:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573549952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.061777:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.061782:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140882.061783:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 269 pid: 14785 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.061787:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 10 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.061792:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 269 pid: 14785 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.061806:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 10 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.061824:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b67200/0x8156357b7fdb900f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd1 expref: 10 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.061832:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3000/0x8156357b7fdb901d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cdf expref: 269 pid: 14785 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.061837:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.061841:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.061848:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140882.061848:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140882.061852:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140882.061857:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.061885:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573549952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.061885:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1985:x1830960573549824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.061891:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8547 00000100:00100000:3.0:1746140882.061895:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8548 00000100:00100000:0.0:1746140882.061901:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.061957:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573550080 00000100:00100000:3.0:1746140882.061960:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573550080 00010000:00010000:3.0:1746140882.061972:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.061994:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8549 00000100:00100000:3.0:1746140882.061999:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573550080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.062005:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.062009:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.062017:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.062027:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272dc00/0x8156357b7fdb9016 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0cd8 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.062035:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.062037:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.062044:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.062049:0:8473:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.062062:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140882.062071:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140882.062077:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140882.062078:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573550080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.062083:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8549 00000040:00080000:1.0:1746140882.062800:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3348, 88 off283280 00000004:00080000:1.0:1746140882.062810:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138504274ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.062888:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3386, 88 off286808 00000004:00080000:1.0:1746140882.062894:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861138588700ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140882.062920:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3387, 88 off286896 00000004:00080000:1.0:1746140882.062924:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861138618935ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140882.062933:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3349, 88 off283368 00000004:00080000:1.0:1746140882.062935:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138630750ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.063081:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3350, 88 off283456 00000004:00080000:1.0:1746140882.063085:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138780168ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.063096:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3388, 88 off286984 00000004:00080000:1.0:1746140882.063099:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861138793888ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140882.063115:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3389, 88 off287072 00000004:00080000:1.0:1746140882.063118:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861138813633ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140882.063125:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3390, 88 off287160 00000004:00080000:1.0:1746140882.063128:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861138822831ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140882.063134:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3351, 88 off283544 00000004:00080000:1.0:1746140882.063180:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138874763ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.063200:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3391, 88 off287248 00000004:00080000:1.0:1746140882.063203:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861138898453ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140882.063212:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3352, 88 off283632 00000004:00080000:1.0:1746140882.063215:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138910161ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.063222:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3392, 88 off287336 00000004:00080000:1.0:1746140882.063224:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861138919213ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140882.063230:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3353, 88 off283720 00000004:00080000:1.0:1746140882.063233:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138928623ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.063241:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3354, 88 off283808 00000004:00080000:1.0:1746140882.063244:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138938850ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.063256:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3355, 88 off283896 00000004:00080000:1.0:1746140882.063258:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138953305ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.063265:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3356, 88 off283984 00000004:00080000:1.0:1746140882.063267:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861138962720ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140882.063278:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3393, 88 off287424 00000004:00080000:1.0:1746140882.063281:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861138976230ns, next at 809142599738ns, rc = 0 00000004:00010000:1.0:1746140882.082920:0:14742:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009eeaaa00 reply state ffff880093d91800 transno 8589944896 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:1.0:1746140882.082940:0:14742:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746140882.083160:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944896 is committed 00000004:00080000:0.0:1746140882.083185:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2636 committed 00000004:00080000:0.0:1746140882.083200:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2603 committed 00000004:00080000:0.0:1746140882.083205:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2602 committed 00000004:00080000:0.0:1746140882.083207:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2601 committed 00000004:00080000:0.0:1746140882.083209:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2600 committed 00000004:00080000:0.0:1746140882.083210:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2635 committed 00000004:00080000:0.0:1746140882.083213:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2599 committed 00000004:00080000:0.0:1746140882.083214:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2634 committed 00000004:00080000:0.0:1746140882.083216:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2598 committed 00000004:00080000:0.0:1746140882.083217:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2633 committed 00000004:00080000:0.0:1746140882.083218:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2632 committed 00000004:00080000:0.0:1746140882.083220:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2631 committed 00000004:00080000:0.0:1746140882.083222:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2597 committed 00000004:00080000:0.0:1746140882.083223:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2596 committed 00000004:00080000:0.0:1746140882.083225:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2630 committed 00000004:00080000:0.0:1746140882.083226:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2629 committed 00000004:00080000:0.0:1746140882.083227:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2595 committed 00000001:00080000:0.0:1746140882.083237:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944892 is committed 00000001:00080000:0.0:1746140882.083247:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944893 is committed 00010000:00080000:1.0:1746140882.083458:0:14742:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746140882.083478:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32470:x1830960573549696:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 23894us (25704us total) trans 8589944896 rc 0/0 00000100:00100000:1.0:1746140882.083487:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10621 00010000:00010000:3.0:1746140882.083975:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.083987:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.083997:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.084003:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8d800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.084007:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.084013:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.084029:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.084032:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140882.084035:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140882.084040:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdb910b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140882.084068:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575983872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.084139:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575984000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140882.084784:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140882.084811:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575984384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140882.084833:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140882.084848:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575984896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140882.084863:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140882.084877:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575985408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140882.084893:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140882.084923:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575984640 00000100:00100000:3.0:1746140882.084929:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575984640 00000100:00100000:3.0:1746140882.084949:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575984128 00000100:00100000:3.0:1746140882.084951:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575984128 00000100:00100000:3.0:1746140882.084961:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575984384 00000100:00100000:3.0:1746140882.084962:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575984384 00000100:00100000:3.0:1746140882.084969:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575984896 00000100:00100000:3.0:1746140882.084971:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575984896 00000100:00100000:3.0:1746140882.084983:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16492 00000100:00100000:3.0:1746140882.084990:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3312:x1830960575983616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140882.085190:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3312:x1830960575983616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (1122us total) trans 21474841282 rc 0/0 00000100:00100000:0.0:1746140882.085470:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.086338:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16498 00000100:00100000:3.0:1746140882.086346:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16492 00000100:00100000:1.0:1746140882.086348:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3312:x1830960575984128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140882.086362:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16499 00000100:00100000:3.0:1746140882.086368:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3312:x1830960575984768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.086451:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3312:x1830960575984128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (1659us total) trans 17179874012 rc 0/0 00000100:00100000:1.0:1746140882.086456:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16498 00000100:00100000:1.0:1746140882.086467:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16500 00000100:00100000:3.0:1746140882.086469:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3312:x1830960575984768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1650us total) trans 17179874013 rc 0/0 00000100:00100000:1.0:1746140882.086473:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3310:x1830960575984384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140882.086476:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16499 00000100:00100000:3.0:1746140882.086487:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16501 00000100:00100000:3.0:1746140882.086492:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3312:x1830960575985152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140882.086568:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16502 00000100:00100000:3.0:1746140882.086574:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3310:x1830960575984896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140882.086589:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16503 00000100:00100000:3.0:1746140882.086593:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3310:x1830960575985408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140882.086672:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3310:x1830960575985408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1778us total) trans 17179874014 rc 0/0 00000100:00100000:3.0:1746140882.086678:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16503 00000100:00100000:1.0:1746140882.086706:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746140882.086730:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bd500/2, rc 0, transno 17179874014 00000100:00100000:1.0:1746140882.086732:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575984512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140882.086735:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575985408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140882.086747:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575984000 00000100:00100000:3.0:1746140882.086751:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575984000 00000100:00100000:1.0:1746140882.086754:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.086765:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575985024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140882.086769:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575984512 00000100:00100000:3.0:1746140882.086771:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575984512 00000100:00100000:1.0:1746140882.086779:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140882.086782:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16504 00000100:00100000:3.0:1746140882.086786:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3311:x1830960575984000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.086789:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575985536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140882.086795:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575985024 00000100:00100000:3.0:1746140882.086797:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575985024 00000100:00100000:1.0:1746140882.086803:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140882.086805:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575985536 00000100:00100000:3.0:1746140882.086807:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575985536 00000100:00100000:3.0:1746140882.086815:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16505 00000100:00100000:3.0:1746140882.086819:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3311:x1830960575984512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.086821:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16506 00000100:00100000:1.0:1746140882.086826:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3311:x1830960575985024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.086888:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573550208 00000100:00100000:1.0:1746140882.086891:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573550208 00000100:00100000:3.0:1746140882.086913:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3311:x1830960575984512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (158us total) trans 17179874015 rc 0/0 00000100:00100000:1.0:1746140882.086917:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10622 00000100:00100000:3.0:1746140882.086918:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16505 00000100:00100000:1.0:1746140882.086922:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32470:x1830960573550208:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746140882.086929:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16507 00000100:00100000:3.0:1746140882.086933:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3311:x1830960575985536:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746140882.086936:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.086952:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec22600/0x8156357b7fdb9112 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d6b expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.087001:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec22600/0x8156357b7fdb9112 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d6b expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.087007:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3311:x1830960575985536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (202us total) trans 17179874017 rc 0/0 00000100:00100000:3.0:1746140882.087012:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16507 00010000:00010000:1.0:1746140882.087014:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec22600/0x8156357b7fdb9112 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d6b expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.087031:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:1.0:1746140882.087034:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140882.087037:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec22600, rc 0) 00000100:00100000:1.0:1746140882.087070:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:32470:x1830960573550208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 148us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.087075:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10622 00000100:00100000:1.0:1746140882.087201:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3311:x1830960575985024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 375us (420us total) trans 17179874016 rc 0/0 00000100:00100000:1.0:1746140882.087206:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16506 00000004:00080000:1.0:1746140882.087224:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bf480/2, rc 0, transno 17179874015 00000100:00100000:1.0:1746140882.087227:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575984512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140882.087232:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354be680/2, rc 0, transno 17179874016 00000100:00100000:1.0:1746140882.087234:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575985024:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140882.087239:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354be300/2, rc 0, transno 17179874017 00000100:00100000:1.0:1746140882.087241:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575985536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.087526:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:3310:x1830960575984384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1053us (2691us total) trans 21474841286 rc 0/0 00000100:00100000:0.0:1746140882.087532:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16500 00000100:00100000:3.0:1746140882.087697:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3312:x1830960575985152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1205us (2848us total) trans 21474841287 rc 0/0 00000100:00100000:3.0:1746140882.087701:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16501 00000004:00080000:3.0:1746140882.087723:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea9880/2, rc 0, transno 21474841286 00000100:00100000:3.0:1746140882.087730:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575984384:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140882.087738:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eeabb80/2, rc 0, transno 21474841285 00000100:00100000:3.0:1746140882.087741:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575983872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140882.087896:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3310:x1830960575984896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1322us (3031us total) trans 21474841288 rc 0/0 00000100:00100000:0.0:1746140882.087902:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16502 00000100:00100000:3.0:1746140882.088452:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3311:x1830960575984000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1665us (1746us total) trans 21474841289 rc 0/0 00000100:00100000:3.0:1746140882.088459:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16504 00000004:00080000:3.0:1746140882.088480:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea8e00/2, rc 0, transno 21474841288 00000100:00100000:3.0:1746140882.088484:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575984896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140882.088551:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea8a80/2, rc 0, transno 21474841289 00000100:00100000:0.0:1746140882.088555:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575984000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140882.089055:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575985664 00000100:00100000:0.0:1746140882.089060:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575985664 00000100:00100000:0.0:1746140882.089085:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16508 00000100:00100000:0.0:1746140882.089090:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3312:x1830960575985664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140882.090060:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573550336 00000100:00100000:3.0:1746140882.090064:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573550336 00000100:00100000:3.0:1746140882.090087:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10623 00000100:00100000:3.0:1746140882.090091:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:32470:x1830960573550336:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140882.090102:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.090118:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdb9119 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d72 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.090192:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c400/0x8156357b7fdb9120 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.090204:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c400/0x8156357b7fdb9120 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.090212:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c400/0x8156357b7fdb9120 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140882.090238:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140882.090242:0:14741:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140882.090255:0:14741:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c400/0x8156357b7fdb9120 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.090274:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdb9119 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d72 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.090292:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c400/0x8156357b7fdb9120 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d72 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.090299:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.090319:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140882.090321:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8c400, rc 0) 00000100:00100000:3.0:1746140882.090353:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:32470:x1830960573550336:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 262us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.090358:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10623 00000100:00100000:1.0:1746140882.090609:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3312:x1830960575985664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1517us (1670us total) trans 21474841290 rc 0/0 00000100:00100000:1.0:1746140882.090616:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16508 00000100:00100000:0.0:1746140882.092269:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.092332:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.092366:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.092648:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.092667:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573550848 00000100:00100000:1.0:1746140882.092668:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573550592 00000100:00100000:3.0:1746140882.092675:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573550848 00000100:00100000:1.0:1746140882.092675:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573550592 00000100:00100000:3.0:1746140882.092717:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16509 00000100:00100000:1.0:1746140882.092722:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16510 00000100:00100000:3.0:1746140882.092723:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573550848:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746140882.092728:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573550592:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140882.092738:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.092738:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.092754:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d8e expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.092754:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d80 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140882.092777:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed2, atime: 0x6813fed2, ctime: 0x6813fed2, blocks: 0x821 00002000:00010000:1.0:1746140882.092777:0:8459:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed2, atime: 0x6813fed2, ctime: 0x6813fed2, blocks: 0x81f 00010000:00010000:3.0:1746140882.092793:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.092793:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.092795:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.092795:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.092802:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 11 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.092803:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.092816:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.092817:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 11 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.092826:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec23400, rc 0) 00010000:00010000:3.0:1746140882.092828:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8c000, rc 0) 00000100:00100000:1.0:1746140882.093040:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573550592:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 312us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.093047:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16510 00000100:00100000:3.0:1746140882.093048:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573550848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 324us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.093054:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16509 00000100:00100000:1.0:1746140882.094190:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.094224:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.094744:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573550720 00000100:00100000:0.0:1746140882.094752:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573550720 00000100:00100000:0.0:1746140882.094784:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16514 00000100:00100000:0.0:1746140882.094790:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573550720:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140882.094797:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140882.094810:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0d87 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140882.094829:0:8458:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fed2, atime: 0x6813fed2, ctime: 0x6813fed2, blocks: 0x821 00010000:00010000:0.0:1746140882.094842:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.094843:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.094850:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 11 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140882.094863:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 11 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140882.094871:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009252b000, rc 0) 00000100:00100000:0.0:1746140882.094900:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573550720:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 110us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.094906:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16514 00000100:00100000:0.0:1746140882.101795:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.102060:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573551360 00000100:00100000:3.0:1746140882.102070:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573551360 00000100:00100000:3.0:1746140882.102135:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8465 00000100:00100000:3.0:1746140882.102143:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573551360:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140882.102193:0:21376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdb9151 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.102208:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.102210:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.102215:0:21376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdb9151 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.102228:0:21376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdb9151 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.103960:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.104039:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573551616 00000100:00100000:1.0:1746140882.104052:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573551616 00000100:00100000:1.0:1746140882.104110:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8466 00000100:00100000:1.0:1746140882.104119:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573551616:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140882.104166:0:32429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.104179:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.104180:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.104184:0:32429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.104195:0:32429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.104783:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573551872 00000100:00100000:0.0:1746140882.104789:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573551872 00000100:00100000:0.0:1746140882.104835:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8467 00000100:00100000:0.0:1746140882.104841:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573551872:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140882.104865:0:32428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009252a200/0x8156357b7fdb915f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.104880:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.104882:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.104886:0:32428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009252a200/0x8156357b7fdb915f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.104895:0:32428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009252a200/0x8156357b7fdb915f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.111645:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.111685:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.111711:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.111718:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573552128 00000100:00100000:3.0:1746140882.111727:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573552128 00000100:00100000:3.0:1746140882.111772:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573552384 00000100:00100000:3.0:1746140882.111774:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573552384 00000100:00100000:3.0:1746140882.111787:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573552640 00000100:00100000:3.0:1746140882.111788:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573552640 00000100:00100000:3.0:1746140882.111806:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8468 00000100:00100000:3.0:1746140882.111812:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573552128:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140882.111846:0:21690:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.111858:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.111860:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.111864:0:21690:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.111876:0:21690:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.112988:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8470 00000100:00100000:0.0:1746140882.112996:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573552640:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140882.113019:0:8463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.113029:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.113031:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.113034:0:8463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.113043:0:8463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.117073:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573553152 00000100:00100000:3.0:1746140882.117080:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573553152 00000100:00100000:3.0:1746140882.117146:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8472 00000100:00100000:3.0:1746140882.117166:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573553152:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140882.117187:0:8465:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.117196:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.117198:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.117203:0:8465:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.117215:0:8465:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.123519:0:32429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.123538:0:32429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.123547:0:32429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.123555:0:32429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec23c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140882.123559:0:32429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.123567:0:32429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.123585:0:32429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.123598:0:32429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec23c00/0x8156357b7fdb9158 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.123683:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573551616:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 19560us (19723us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140882.123692:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8466 00010000:00010000:3.0:1746140882.137414:0:21690:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.137441:0:21690:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.137448:0:21690:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.137454:0:21690:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092995200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140882.137459:0:21690:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.137468:0:21690:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.137879:0:21690:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.137887:0:21690:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092995200/0x8156357b7fdb9166 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.137983:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573552128:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 26165us (26344us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.137993:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8468 00010000:00010000:1.0:1746140882.140958:0:8463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.140984:0:8463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.140992:0:8463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.140998:0:8463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009252aa00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140882.141002:0:8463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.141009:0:8463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.141029:0:8463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.141035:0:8463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb9174 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.141174:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573552640:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 28172us (29454us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140882.141184:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8470 00010000:00010000:3.0:1746140882.145055:0:8465:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.145065:0:8465:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.145075:0:8465:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.145081:0:8465:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c9f2e00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140882.145084:0:8465:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.145088:0:8465:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.145098:0:8465:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.145104:0:8465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c9f2e00/0x8156357b7fdb9182 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.145146:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573553152:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 27992us (28110us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.145165:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8472 00000100:00100000:0.0:1746140882.151172:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.155523:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9189 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.155543:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9189 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.155550:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9189 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.155560:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff15e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.155565:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9189 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.155572:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9189 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.155596:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.155599:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.155605:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9189 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.155610:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9189 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00000100:00100000:1.0:1746140882.155693:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.157658:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.158027:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573553664 00000100:00100000:3.0:1746140882.158035:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573553664 00000100:00100000:3.0:1746140882.158181:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16516 00000100:00100000:3.0:1746140882.158188:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573553664:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140882.158273:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.158291:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.158337:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:3.0:1746140882.158364:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140882.158367:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140882.158369:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140882.158371:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00000100:00100000:0.0:1746140882.158372:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:3.0:1746140882.158373:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746140882.158395:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573553664:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 208us (750us total) trans 17179874018 rc 0/0 00000100:00100000:3.0:1746140882.158401:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16516 00000100:00100000:3.0:1746140882.158413:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573553920 00000100:00100000:3.0:1746140882.158417:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573553920 00000100:00100000:3.0:1746140882.158430:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573554176 00000100:00100000:3.0:1746140882.158431:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573554176 00000100:00100000:3.0:1746140882.158440:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573553792 00000100:00100000:3.0:1746140882.158442:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573553792 00000100:00100000:3.0:1746140882.158447:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573554048 00000100:00100000:3.0:1746140882.158449:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573554048 00000100:00100000:0.0:1746140882.158453:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16517 00000100:00100000:0.0:1746140882.158460:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573553920:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:3.0:1746140882.158461:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16518 00000100:00100000:3.0:1746140882.158464:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573554176:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746140882.158518:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746140882.158520:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140882.158522:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140882.158523:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140882.158525:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:0.0:1746140882.158529:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140882.158531:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.158533:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.158535:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.158537:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140882.158542:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573554176:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 77us (250us total) trans 17179874019 rc 0/0 00000100:00100000:3.0:1746140882.158547:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16518 00000100:00100000:0.0:1746140882.158549:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573553920:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 92us (277us total) trans 21474841292 rc 0/0 00000100:00100000:0.0:1746140882.158554:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16517 00000100:00100000:3.0:1746140882.158557:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16519 00000100:00100000:3.0:1746140882.158561:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573553792:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140882.158562:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16520 00000100:00100000:0.0:1746140882.158566:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573554048:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746140882.158611:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140882.158611:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:3.0:1746140882.158613:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.158613:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140882.158614:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.158615:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140882.158616:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.158617:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:3.0:1746140882.158618:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746140882.158618:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5519 -> 5519 00000100:00100000:3.0:1746140882.158632:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573553792:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 71us (295us total) trans 17179874020 rc 0/0 00000100:00100000:0.0:1746140882.158632:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573554048:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 65us (259us total) trans 21474841293 rc 0/0 00000100:00100000:3.0:1746140882.158636:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16519 00000100:00100000:0.0:1746140882.158881:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16520 00000100:00100000:3.0:1746140882.162646:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573554432 00000100:00100000:3.0:1746140882.162656:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573554432 00000100:00100000:3.0:1746140882.162711:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4639 00000100:00100000:3.0:1746140882.162719:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:32470:x1830960573554432:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:3.0:1746140882.162785:0:14745:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x31d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c6bc00/0x8156357b7fdb90d3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d64 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.162832:0:14745:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14745 initiator: MDT0 00010000:00010000:3.0:1746140882.162843:0:14745:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec22600/0x8156357b7fdb9112 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d6b expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.162849:0:14745:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14745 initiator: MDT0 00010000:00010000:3.0:1746140882.162881:0:14745:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec22600/0x8156357b7fdb9112 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d6b expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.162892:0:14745:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec22600/0x8156357b7fdb9112 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d6b expref: 9 pid: 14742 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.162905:0:14745:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14745:1830960575985792:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.163074:0:14745:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.165036:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.165107:0:14745:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14745:1830960575985792:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.165132:0:14745:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14745 initiator: MDT0 00010000:00010000:3.0:1746140882.168346:0:14745:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14745 initiator: MDT0 00010000:00010000:3.0:1746140882.168359:0:14745:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14745 initiator: MDT0 00000040:00080000:3.0:1746140882.170934:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3357, 88 off284072 00000004:00080000:3.0:1746140882.170945:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246638874ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171010:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3394, 88 off287512 00000004:00080000:3.0:1746140882.171014:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861246709546ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140882.171029:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3395, 88 off287600 00000004:00080000:3.0:1746140882.171032:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861246726674ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140882.171039:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3358, 88 off284160 00000004:00080000:3.0:1746140882.171041:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246736581ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171046:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3359, 88 off284248 00000004:00080000:3.0:1746140882.171050:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246745138ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171055:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3396, 88 off287688 00000004:00080000:3.0:1746140882.171057:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861246752595ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140882.171063:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3397, 88 off287776 00000004:00080000:3.0:1746140882.171066:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861246761171ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140882.171072:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3398, 88 off287864 00000004:00080000:3.0:1746140882.171074:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861246769144ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140882.171080:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3360, 88 off284336 00000004:00080000:3.0:1746140882.171082:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246777635ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171089:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3399, 88 off287952 00000004:00080000:3.0:1746140882.171091:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861246786254ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140882.171097:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3361, 88 off284424 00000004:00080000:3.0:1746140882.171099:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246794314ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171105:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3400, 88 off288040 00000004:00080000:3.0:1746140882.171108:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861246803688ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140882.171114:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3362, 88 off284512 00000004:00080000:3.0:1746140882.171117:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246811871ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171122:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3363, 88 off284600 00000004:00080000:3.0:1746140882.171124:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246819278ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171129:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3364, 88 off284688 00000004:00080000:3.0:1746140882.171131:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246826184ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171136:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3365, 88 off284776 00000004:00080000:3.0:1746140882.171138:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 861246832913ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140882.171142:0:14745:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3401, 88 off288128 00000004:00080000:3.0:1746140882.171144:0:14745:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861246839543ns, next at 809142599738ns, rc = 0 00000001:00080000:0.0:1746140882.212807:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944897 is committed 00000001:00080000:0.0:1746140882.212823:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944898 is committed 00000004:00080000:0.0:1746140882.212830:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2644 committed 00000004:00080000:0.0:1746140882.212837:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2612 committed 00000004:00080000:0.0:1746140882.212843:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2611 committed 00000004:00080000:0.0:1746140882.212845:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2610 committed 00000004:00080000:0.0:1746140882.212847:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2609 committed 00000004:00080000:0.0:1746140882.212848:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2643 committed 00000004:00080000:0.0:1746140882.212849:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2608 committed 00000004:00080000:0.0:1746140882.212851:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2642 committed 00000004:00080000:0.0:1746140882.212853:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2607 committed 00000004:00080000:0.0:1746140882.212854:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2641 committed 00000004:00080000:0.0:1746140882.212856:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2640 committed 00000004:00080000:0.0:1746140882.212857:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2639 committed 00000004:00080000:0.0:1746140882.212859:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2606 committed 00000004:00080000:0.0:1746140882.212861:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2605 committed 00000004:00080000:0.0:1746140882.212862:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2638 committed 00000004:00080000:0.0:1746140882.212864:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2637 committed 00000004:00080000:0.0:1746140882.212865:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2604 committed 00000100:00100000:0.0:1746140882.212987:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575986432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.213038:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575986048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.213074:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.213110:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575986560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.213125:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.213139:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746140882.213143:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575986176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.213171:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.213183:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575986688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.213197:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.213539:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16522 00000100:00100000:1.0:1746140882.213547:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3310:x1830960575986048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746140882.213669:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140882.213672:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.213674:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.213676:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.213677:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140882.213710:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3310:x1830960575986048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (637us total) trans 17179874021 rc 0/0 00000100:00100000:1.0:1746140882.213716:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16522 00000100:00100000:1.0:1746140882.213733:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16525 00000100:00100000:1.0:1746140882.213736:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3310:x1830960575986688:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746140882.213985:0:14745:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092610a80 reply state ffff880099581c00 transno 8589944898 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14745 initiator: MDT0 00000100:00100000:3.0:1746140882.213997:0:14745:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746140882.214006:0:14745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:3.0:1746140882.214009:0:14745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140882.214017:0:14745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c6bc00/0x8156357b7fdb90d3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d64 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.214193:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3310:x1830960575986688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 455us (994us total) trans 17179874024 rc 0/0 00000100:00100000:1.0:1746140882.214199:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16525 00000100:00100000:1.0:1746140882.214208:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575986432 00000100:00100000:1.0:1746140882.214211:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575986432 00000100:00100000:1.0:1746140882.214226:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16526 00000100:00100000:1.0:1746140882.214229:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3313:x1830960575986432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.214330:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575986944 00000100:00100000:1.0:1746140882.214333:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575986944 00000100:00100000:1.0:1746140882.214347:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16527 00000100:00100000:1.0:1746140882.214351:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3313:x1830960575986944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140882.214501:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746140882.214503:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.214505:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.214507:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.214509:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746140882.214703:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3313:x1830960575986944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 351us (409us total) trans 21474841294 rc 0/0 00000100:00100000:1.0:1746140882.214708:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16527 00000100:00100000:1.0:1746140882.214728:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575987200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.214748:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.214761:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575987712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.214773:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.214783:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746140882.214787:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575987072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.214803:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.214810:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575987584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.214823:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.214838:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575987072 00000100:00100000:1.0:1746140882.214840:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575987072 00000100:00100000:1.0:1746140882.214849:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16532 00000100:00100000:1.0:1746140882.214852:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3311:x1830960575987712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.214938:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960575987712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (164us total) trans 21474841299 rc 0/0 00000100:00100000:1.0:1746140882.214943:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16532 00000100:00100000:1.0:1746140882.214950:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16534 00000100:00100000:1.0:1746140882.214954:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3311:x1830960575987584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.215028:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3311:x1830960575987584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (203us total) trans 21474841300 rc 0/0 00000100:00100000:1.0:1746140882.215033:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16534 00000004:00080000:0.0:1746140882.215069:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b1180/2, rc 0, transno 17179874024 00000100:00100000:0.0:1746140882.215079:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575986688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140882.215091:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b0e00/2, rc 0, transno 17179874021 00000100:00100000:0.0:1746140882.215095:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575986048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140882.215104:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b2a00/2, rc 0, transno 17179874023 00000100:00100000:0.0:1746140882.215107:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575986560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.215218:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3313:x1830960575986432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 986us (1215us total) trans 17179874025 rc 0/0 00000100:00100000:0.0:1746140882.215227:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16526 00000100:00100000:0.0:1746140882.215249:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16536 00000100:00100000:0.0:1746140882.215258:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3312:x1830960575986816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.215449:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+71:3312:x1830960575986304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (306us total) trans 17179874026 rc 0/0 00000100:00100000:0.0:1746140882.215455:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16535 00000100:00100000:1.0:1746140882.215635:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575987968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.215655:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746140882.215747:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746140882.215750:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.215752:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.215753:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.215755:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746140882.215789:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+71:3310:x1830960575986176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2055us (2617us total) trans 17179874028 rc 0/0 00000100:00100000:1.0:1746140882.215795:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16524 00000100:00100000:1.0:1746140882.215805:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575987968 00000100:00100000:1.0:1746140882.215807:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575987968 00000100:00100000:1.0:1746140882.215826:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16537 00000100:00100000:1.0:1746140882.215831:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3313:x1830960575987968:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140882.215881:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b2680/2, rc 0, transno 17179874028 00000100:00100000:0.0:1746140882.215886:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575986176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.215919:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3313:x1830960575987968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (263us total) trans 21474841302 rc 0/0 00000100:00100000:1.0:1746140882.215924:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16537 00000004:00080000:0.0:1746140882.215933:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f079c00/2, rc 0, transno 21474841302 00000100:00100000:0.0:1746140882.215937:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575987968:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140882.215968:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140882.215969:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.215971:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.215973:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.215974:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:1.0:1746140882.216004:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+70:3312:x1830960575985920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2569us (2969us total) trans 17179874022 rc 0/0 00000100:00100000:0.0:1746140882.216006:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:3312:x1830960575986816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 750us (818us total) trans 17179874027 rc 0/0 00000100:00100000:1.0:1746140882.216009:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16521 00000100:00100000:0.0:1746140882.216013:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16536 00000004:00080000:1.0:1746140882.216250:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094452680/2, rc 0, transno 17179874027 00000100:00100000:1.0:1746140882.216254:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575986816:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140882.216261:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b0380/2, rc 0, transno 17179874022 00000100:00100000:1.0:1746140882.216264:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575985920:0@lo:2:osp-syn-1-0.0 00010000:00080000:0.0:1746140882.216364:0:14745:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746140882.216381:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32470:x1830960573554432:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 53660us (53911us total) trans 8589944898 rc 0/0 00000100:00100000:0.0:1746140882.216390:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4639 00010000:00010000:0.0:1746140882.216420:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14745 initiator: MDT0 00010000:00010000:0.0:1746140882.216429:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14745 initiator: MDT0 00010000:00010000:0.0:1746140882.216436:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14745 initiator: MDT0 00010000:00010000:0.0:1746140882.216441:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c9f2800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140882.216446:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14745 initiator: MDT0 00010000:00010000:0.0:1746140882.216453:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14745 initiator: MDT0 00010000:00010000:0.0:1746140882.216466:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008f388800) 00010000:00010000:0.0:1746140882.216469:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140882.216471:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14745 initiator: MDT0 00010000:00010000:0.0:1746140882.216476:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c9f2800/0x8156357b7fdb9190 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14745 initiator: MDT0 00000100:00100000:0.0:1746140882.234020:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.234334:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573554944 00000100:00100000:0.0:1746140882.234343:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573554944 00000100:00100000:0.0:1746140882.234387:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4640 00000100:00100000:0.0:1746140882.234395:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32470:x1830960573554944:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1746140882.234654:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32470:x1830960573554944:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 260us (640us total) trans 8589944899 rc 0/0 00000100:00100000:0.0:1746140882.234660:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4640 00000100:00100000:0.0:1746140882.253770:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.255757:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.264729:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573555584 00000100:00100000:0.0:1746140882.264737:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573555584 00000100:00100000:0.0:1746140882.264782:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16538 00000100:00100000:0.0:1746140882.264790:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32482:x1830960573555584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140882.264808:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140882.264826:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0db8 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.264848:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.264850:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.264858:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 28 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.264872:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 28 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.264883:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f8b600, rc 0) 00000100:00100000:0.0:1746140882.264940:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32482:x1830960573555584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 150us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.264946:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16538 00000100:00100000:1.0:1746140882.273042:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.273117:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.273136:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573556480 00000100:00100000:1.0:1746140882.273140:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573556480 00010000:00010000:1.0:1746140882.273177:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb91d6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db1 expref: 10 pid: 14741 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.273199:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8551 00000100:00100000:1.0:1746140882.273205:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573556480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.273218:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140882.273222:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb91d6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db1 expref: 10 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.273232:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb91d6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db1 expref: 10 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.273264:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140882.273268:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da7800/0x8156357b7fdb9207 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140882.273275:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da7800/0x8156357b7fdb9207 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140882.273281:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da7800/0x8156357b7fdb9207 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140882.273299:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.273358:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573556480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.273365:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8551 00000100:00100000:3.0:1746140882.280169:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573556864 00000100:00100000:3.0:1746140882.280174:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573556864 00002000:00100000:3.0:1746140882.280202:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009abdc380 x1830960573556864/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.280211:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc380 with x1830960573556864 ext(0->1048575) 00002000:00010000:3.0:1746140882.280215:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdc380 00000100:00100000:3.0:1746140882.280229:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8473 00000100:00100000:3.0:1746140882.280234:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573556864:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.283488:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573557248 00000100:00100000:1.0:1746140882.283494:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573557248 00010000:00010000:1.0:1746140882.283528:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da7800/0x8156357b7fdb9207 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dc6 expref: 9 pid: 14741 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.283552:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8554 00000100:00100000:1.0:1746140882.283559:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960573557248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.283572:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140882.283577:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da7800/0x8156357b7fdb9207 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dc6 expref: 9 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.283586:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da7800/0x8156357b7fdb9207 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dc6 expref: 9 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.283603:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da7800/0x8156357b7fdb9207 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dc6 expref: 9 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.283615:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140882.283619:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140882.283624:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140882.283628:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140882.283632:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.283668:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573557248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.283675:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8554 00000001:00080000:3.0:1746140882.306863:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874006 is committed 00000001:00080000:3.0:1746140882.306873:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873984 is committed 00000001:00080000:3.0:1746140882.306882:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873971 is committed 00000001:00080000:3.0:1746140882.306907:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874016 is committed 00000001:00080000:3.0:1746140882.306914:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874009 is committed 00000001:00080000:3.0:1746140882.306957:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873972 is committed 00000001:00080000:3.0:1746140882.307066:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874020 is committed 00000001:00080000:3.0:1746140882.307077:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874017 is committed 00010000:00010000:3.0:1746140882.311639:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 273 pid: 14743 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746140882.311661:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944899 is committed 00000001:00080000:0.0:1746140882.311676:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944904 is committed 00000004:00080000:0.0:1746140882.311680:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2652 committed 00000004:00080000:0.0:1746140882.311688:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2621 committed 00000004:00080000:0.0:1746140882.311697:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2620 committed 00000004:00080000:0.0:1746140882.311699:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2619 committed 00000004:00080000:0.0:1746140882.311701:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2618 committed 00000004:00080000:0.0:1746140882.311703:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2651 committed 00000004:00080000:0.0:1746140882.311705:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2617 committed 00000004:00080000:0.0:1746140882.311707:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2650 committed 00000004:00080000:0.0:1746140882.311708:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2616 committed 00000004:00080000:0.0:1746140882.311710:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2649 committed 00000004:00080000:0.0:1746140882.311711:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2648 committed 00000004:00080000:0.0:1746140882.311712:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2647 committed 00000004:00080000:0.0:1746140882.311714:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2615 committed 00000004:00080000:0.0:1746140882.311715:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2614 committed 00000004:00080000:0.0:1746140882.311716:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2646 committed 00000004:00080000:0.0:1746140882.311718:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2645 committed 00000004:00080000:0.0:1746140882.311719:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2613 committed 00000001:00080000:0.0:1746140882.311725:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944903 is committed 00000100:00100000:0.0:1746140882.311764:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575988736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.311833:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.311882:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575989248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.311903:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.311938:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575989120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.311957:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.311970:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575989632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.312055:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575988992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.312088:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16540 00000100:00100000:1.0:1746140882.312095:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+16:3311:x1830960575988864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.312100:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.312125:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575990144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140882.312161:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.312174:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575990656:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140882.312188:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746140882.312190:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746140882.312191:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.312193:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.312195:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.312197:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140882.312216:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575989632 00000100:00100000:1.0:1746140882.312219:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+18:3311:x1830960575988864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (358us total) trans 17179874030 rc 0/0 00000100:00100000:0.0:1746140882.312222:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575989632 00000100:00100000:1.0:1746140882.312224:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16540 00000100:00100000:1.0:1746140882.312233:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575990656 00000100:00100000:1.0:1746140882.312236:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575990656 00000100:00100000:0.0:1746140882.312252:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16541 00000100:00100000:0.0:1746140882.312259:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3310:x1830960575989248:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746140882.312281:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.312283:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746140882.312287:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.312295:0:14743:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.312300:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.312357:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1000/0x8156357b7fdb920e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 270 pid: 14743 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746140882.312377:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 269 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.312410:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1a00, rc 0) 00000100:00100000:3.0:1746140882.312454:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32479:x1830960573556352:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 39280us (39419us total) trans 8589944904 rc 0/0 00000100:00100000:0.0:1746140882.312454:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3310:x1830960575989248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (550us total) trans 17179874032 rc 0/0 00000100:00100000:3.0:1746140882.312462:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10630 00000100:00100000:0.0:1746140882.312463:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16541 00000100:00100000:0.0:1746140882.312477:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16545 00000100:00100000:0.0:1746140882.312483:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+78:3313:x1830960575990656:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746140882.312487:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.312494:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140882.312523:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140882.312527:0:14741:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140882.312543:0:14741:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.312567:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0200/0x8156357b7fdb9223 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.312577:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 268 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.312583:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.312586:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746140882.312588:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1400, rc 0) 00000100:00100000:3.0:1746140882.312605:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32483:x1830960573556608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 32216us (33160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.312611:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10631 00000100:00100000:2.0:1746140882.312665:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140882.312682:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575989888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.312697:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140882.312704:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575990400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.312716:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140882.312720:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573557376 00000100:00100000:3.0:1746140882.312724:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573557376 00000100:00100000:2.0:1746140882.312733:0:3311:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874017 gen 2 00000004:00080000:2.0:1746140882.312737:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b66300, transno 17179873948 00000004:00080000:2.0:1746140882.312741:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519180, transno 17179873949 00000004:00080000:2.0:1746140882.312743:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b67480, transno 17179873950 00000100:00100000:3.0:1746140882.312744:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10632 00000004:00080000:2.0:1746140882.312745:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f518700, transno 17179873951 00000004:00080000:2.0:1746140882.312747:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f518000, transno 17179873952 00000100:00100000:3.0:1746140882.312749:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32478:x1830960573557376:12345-192.168.204.16@tcp:101:multiop.0 00000004:00080000:2.0:1746140882.312749:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519c00, transno 17179873953 00000004:00080000:2.0:1746140882.312750:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519880, transno 17179873954 00000004:00080000:2.0:1746140882.312752:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519500, transno 17179873955 00000004:00080000:2.0:1746140882.312754:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b183b80, transno 17179873956 00000004:00080000:2.0:1746140882.312756:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24e300, transno 17179873957 00000004:00080000:2.0:1746140882.312757:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24ed80, transno 17179873958 00000004:00080000:2.0:1746140882.312759:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24c000, transno 17179873959 00000004:00080000:2.0:1746140882.312760:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b182a00, transno 17179873960 00010000:00010000:3.0:1746140882.312762:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1746140882.312762:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24c380, transno 17179873961 00000004:00080000:2.0:1746140882.312763:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24ca80, transno 17179873962 00000004:00080000:2.0:1746140882.312765:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181880, transno 17179873963 00000004:00080000:2.0:1746140882.312767:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f078a80, transno 17179873974 00000004:00080000:2.0:1746140882.312768:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07a300, transno 17179873975 00000004:00080000:2.0:1746140882.312770:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07ad80, transno 17179873976 00010000:00010000:3.0:1746140882.312772:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ddb expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746140882.312772:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f079880, transno 17179873977 00000004:00080000:2.0:1746140882.312774:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baf480, transno 17179873978 00000004:00080000:2.0:1746140882.312775:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f078e00, transno 17179873979 00000004:00080000:2.0:1746140882.312777:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07bb80, transno 17179873980 00000004:00080000:2.0:1746140882.312778:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bad880, transno 17179873981 00000004:00080000:2.0:1746140882.312781:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51aa00, transno 17179873985 00000004:00080000:2.0:1746140882.312783:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b069c00, transno 17179873986 00000004:00080000:2.0:1746140882.312784:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06b100, transno 17179873987 00000004:00080000:2.0:1746140882.312786:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51b800, transno 17179873988 00000004:00080000:2.0:1746140882.312788:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b068700, transno 17179873989 00000004:00080000:2.0:1746140882.312790:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f518e00, transno 17179873990 00000004:00080000:2.0:1746140882.312791:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06a680, transno 17179873991 00000004:00080000:2.0:1746140882.312793:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51a300, transno 17179873992 00000004:00080000:2.0:1746140882.312794:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f170700, transno 17179873993 00000004:00080000:2.0:1746140882.312796:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f171c00, transno 17179873994 00000004:00080000:2.0:1746140882.312798:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f173480, transno 17179873995 00010000:00010000:3.0:1746140882.312799:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 7 pid: 14741 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746140882.312800:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f170380, transno 17179873996 00000004:00080000:2.0:1746140882.312801:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f172680, transno 17179873997 00000004:00080000:2.0:1746140882.312803:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f172300, transno 17179873998 00000004:00080000:2.0:1746140882.312805:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f171880, transno 17179873999 00010000:00010000:3.0:1746140882.312807:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 7 pid: 14741 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746140882.312807:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f170e00, transno 17179874000 00000004:00080000:2.0:1746140882.312809:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093132d80, transno 17179874001 00000004:00080000:2.0:1746140882.312811:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093131c00, transno 17179874002 00000004:00080000:2.0:1746140882.312812:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093130380, transno 17179874003 00000004:00080000:2.0:1746140882.312814:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093130a80, transno 17179874004 00010000:00010000:3.0:1746140882.312816:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00000004:00080000:2.0:1746140882.312816:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093131180, transno 17179874005 00010000:00010000:3.0:1746140882.312818:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:2.0:1746140882.312818:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093131f80, transno 17179874006 00010000:00010000:3.0:1746140882.312820:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43000, rc 0) 00000004:00080000:2.0:1746140882.312820:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093133b80, transno 17179874007 00000004:00080000:2.0:1746140882.312821:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093133800, transno 17179874008 00000004:00080000:2.0:1746140882.312823:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bdf80, transno 17179874010 00000004:00080000:2.0:1746140882.312825:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bed80, transno 17179874011 00000004:00080000:2.0:1746140882.312827:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bce00, transno 17179874012 00000004:00080000:2.0:1746140882.312829:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bea00, transno 17179874013 00000004:00080000:2.0:1746140882.312832:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bd500, transno 17179874014 00000004:00080000:2.0:1746140882.312834:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bf480, transno 17179874015 00000004:00080000:2.0:1746140882.312837:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354be680, transno 17179874016 00000004:00080000:2.0:1746140882.312839:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354be300, transno 17179874017 00000100:00100000:3.0:1746140882.312840:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32478:x1830960573557376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.312845:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10632 00000100:00100000:2.0:1746140882.312845:0:3311:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8801359b0e00 x1830960575986048/t17179874021(17179874021) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746140898 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746140882.312852:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513ca80/2, rc 0, transno 17179874030 00000100:00100000:2.0:1746140882.312857:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575988864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140882.312864:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746140882.312868:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575989760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.312883:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140882.313234:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575989376 00000100:00100000:0.0:1746140882.313237:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575989376 00000100:00100000:0.0:1746140882.313253:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575989888 00000100:00100000:0.0:1746140882.313255:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575989888 00000100:00100000:0.0:1746140882.313265:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575990400 00000100:00100000:0.0:1746140882.313267:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575990400 00000100:00100000:0.0:1746140882.313272:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575989760 00000100:00100000:0.0:1746140882.313275:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575989760 00000100:00100000:0.0:1746140882.313283:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16546 00000100:00100000:0.0:1746140882.313287:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3311:x1830960575989376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.313847:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16547 00000100:00100000:1.0:1746140882.313856:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+82:3311:x1830960575989888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140882.313967:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140882.313970:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.313971:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.313973:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.313975:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140882.314044:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575990272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.314048:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+83:3311:x1830960575989888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (1349us total) trans 21474841305 rc 0/0 00000100:00100000:1.0:1746140882.314054:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16547 00000100:00100000:2.0:1746140882.314063:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.314065:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575990272 00000100:00100000:1.0:1746140882.314069:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575990272 00000100:00100000:0.0:1746140882.314073:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3311:x1830960575989376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 784us (1405us total) trans 17179874034 rc 0/0 00000004:00080000:2.0:1746140882.314077:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f079500/2, rc 0, transno 21474841305 00000100:00100000:0.0:1746140882.314080:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16546 00000100:00100000:2.0:1746140882.314083:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575989888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.314087:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16548 00000004:00080000:2.0:1746140882.314091:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abded80/2, rc 0, transno 17179874034 00000100:00100000:1.0:1746140882.314092:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+83:3311:x1830960575990400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.314093:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575989376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140882.314095:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16549 00000100:00100000:0.0:1746140882.314101:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:3311:x1830960575989760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.314182:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16550 00000100:00100000:1.0:1746140882.314188:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+85:3311:x1830960575990400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1470us total) trans 21474841306 rc 0/0 00000100:00100000:2.0:1746140882.314189:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3311:x1830960575990272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.314194:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16548 00002000:00010000:0.0:1746140882.314206:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140882.314209:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.314212:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.314214:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140882.314217:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:0.0:1746140882.314238:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:3311:x1830960575989760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (1353us total) trans 21474841307 rc 0/0 00000100:00100000:0.0:1746140882.314243:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16549 00000100:00100000:2.0:1746140882.314283:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3311:x1830960575990272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (217us total) trans 21474841308 rc 0/0 00000100:00100000:2.0:1746140882.314289:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16550 00000100:00100000:1.0:1746140882.314355:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.314383:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575989504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140882.314404:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.314416:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575990016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.314430:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.314440:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575990528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.314453:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140882.314474:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575988992 00000100:00100000:1.0:1746140882.314478:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575988992 00000100:00100000:1.0:1746140882.314492:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575989504 00000100:00100000:1.0:1746140882.314493:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575989504 00000100:00100000:1.0:1746140882.314501:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575990016 00000100:00100000:1.0:1746140882.314502:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575990016 00000100:00100000:1.0:1746140882.314509:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575990528 00000100:00100000:1.0:1746140882.314511:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575990528 00000100:00100000:1.0:1746140882.314519:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16551 00000100:00100000:1.0:1746140882.314523:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3312:x1830960575988992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746140882.314611:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746140882.314614:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.314616:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.314618:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140882.314620:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4137 00000100:00100000:1.0:1746140882.314645:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3312:x1830960575988992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (290us total) trans 17179874035 rc 0/0 00000100:00100000:1.0:1746140882.314651:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16551 00000100:00100000:1.0:1746140882.314661:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16552 00000004:00080000:2.0:1746140882.314664:0:14789:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 16 in progress, 6 in flight, 56 done 00000100:00100000:1.0:1746140882.314665:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3312:x1830960575989504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140882.314685:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16553 00000100:00100000:2.0:1746140882.314691:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960575990016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.314738:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3312:x1830960575989504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (333us total) trans 17179874036 rc 0/0 00000100:00100000:1.0:1746140882.314743:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16552 00000100:00100000:1.0:1746140882.314752:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16554 00000100:00100000:1.0:1746140882.314757:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3312:x1830960575990528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746140882.314768:0:4785:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:2.0:1746140882.314772:0:4785:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140882 -> 1746140882 00002000:00010000:2.0:1746140882.314774:0:4785:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:2.0:1746140882.314775:0:4785:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140882 -> 1746140882 00002000:00010000:2.0:1746140882.314777:0:4785:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5519 -> 5513 00000100:00100000:2.0:1746140882.314797:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3312:x1830960575990016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (365us total) trans 21474841309 rc 0/0 00000100:00100000:2.0:1746140882.314802:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16553 00000004:00080000:2.0:1746140882.314837:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07b480/2, rc 0, transno 21474841303 00000100:00100000:2.0:1746140882.314841:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575990144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140882.314842:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3312:x1830960575990528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (387us total) trans 21474841310 rc 0/0 00000100:00100000:1.0:1746140882.314847:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16554 00000004:00080000:2.0:1746140882.314850:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513d880/2, rc 0, transno 17179874031 00000100:00100000:2.0:1746140882.314854:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575989120:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140882.314861:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc08380/2, rc 0, transno 17179874033 00000100:00100000:2.0:1746140882.314864:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575989632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140882.314873:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513f100/2, rc 0, transno 17179874035 00000100:00100000:1.0:1746140882.314876:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575988992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140882.314883:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc09c00/2, rc 0, transno 17179874036 00000100:00100000:1.0:1746140882.314886:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575989504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140882.314891:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07b100/2, rc 0, transno 21474841309 00000100:00100000:1.0:1746140882.314894:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575990016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140882.314899:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092612680/2, rc 0, transno 21474841310 00000100:00100000:1.0:1746140882.314902:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960575990528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.314915:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:3313:x1830960575990656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2432us (2723us total) trans 21474841304 rc 0/0 00000100:00100000:1.0:1746140882.314916:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575990784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.314921:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16545 00000100:00100000:1.0:1746140882.314933:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746140882.314940:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0c380/2, rc 0, transno 21474841304 00000100:00100000:2.0:1746140882.314944:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960575990656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.314952:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960575990784 00000004:00080000:1.0:1746140882.314954:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abde680/2, rc 0, transno 17179874032 00000100:00100000:2.0:1746140882.314955:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960575990784 00000100:00100000:1.0:1746140882.314957:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575989248:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140882.314965:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513e680/2, rc 0, transno 17179874029 00000100:00100000:2.0:1746140882.314968:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16555 00000100:00100000:1.0:1746140882.314969:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575988736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140882.314972:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:3310:x1830960575990784:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140882.314985:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07b800/2, rc 0, transno 21474841307 00000100:00100000:1.0:1746140882.314988:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575989760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140882.314995:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092611f80/2, rc 0, transno 21474841308 00000100:00100000:1.0:1746140882.314997:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575990272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140882.315002:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092610000/2, rc 0, transno 21474841306 00000100:00100000:1.0:1746140882.315005:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960575990400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.315047:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+86:3310:x1830960575990784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (113us total) trans 21474841311 rc 0/0 00000100:00100000:2.0:1746140882.315051:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16555 00000004:00080000:1.0:1746140882.315059:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b891f80/2, rc 0, transno 21474841311 00000100:00100000:1.0:1746140882.315063:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960575990784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140882.315176:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.315272:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.315323:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573557504 00000100:00100000:2.0:1746140882.315326:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573557504 00000100:00100000:2.0:1746140882.315346:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573557632 00000100:00100000:2.0:1746140882.315348:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573557632 00000100:00100000:2.0:1746140882.315375:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16556 00000100:00100000:2.0:1746140882.315379:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+5:32482:x1830960573557504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.315388:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.315402:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0de2 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.315419:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.315421:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.315429:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 6 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.315443:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 6 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.315453:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993e00, rc 0) 00000100:00100000:2.0:1746140882.315486:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32482:x1830960573557504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.315491:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16556 00000100:00100000:2.0:1746140882.315501:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16557 00000100:00100000:2.0:1746140882.315505:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573557632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.315511:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.315519:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0de9 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.315531:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.315532:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.315537:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 33 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.315546:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 33 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.315552:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993c00, rc 0) 00000100:00100000:2.0:1746140882.315566:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573557632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.315570:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16557 00000100:00100000:3.0:1746140882.317091:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.317117:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.317128:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.318056:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573557760 00000100:00100000:3.0:1746140882.318057:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.318065:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573557760 00000100:00100000:3.0:1746140882.318075:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.318096:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573557888 00000100:00100000:2.0:1746140882.318098:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573557888 00000100:00100000:3.0:1746140882.318103:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.318110:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573558144 00000100:00100000:2.0:1746140882.318112:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573558144 00000100:00100000:2.0:1746140882.318121:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573558016 00000100:00100000:2.0:1746140882.318123:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573558016 00000100:00100000:2.0:1746140882.318133:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573558272 00000100:00100000:2.0:1746140882.318134:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573558272 00000100:00100000:2.0:1746140882.318143:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573558400 00000100:00100000:2.0:1746140882.318144:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573558400 00000100:00100000:2.0:1746140882.318170:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16558 00000100:00100000:2.0:1746140882.318176:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1983:x1830960573557760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.318190:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.318206:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0df0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.318226:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.318227:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.318235:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 21 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140882.318237:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16559 00000100:00100000:1.0:1746140882.318252:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573557888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.318267:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.318281:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0df7 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.318299:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.318301:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.318322:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318334:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318344:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299a600, rc 0) 00000100:00100000:1.0:1746140882.318390:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573557888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 143us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.318396:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16559 00000100:00100000:1.0:1746140882.318412:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16560 00000100:00100000:1.0:1746140882.318418:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573558144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.318425:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.318433:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e05 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.318444:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.318446:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.318450:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 35 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318463:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 35 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318470:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299b800, rc 0) 00000100:00100000:1.0:1746140882.318484:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573558144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.318488:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16560 00000100:00100000:1.0:1746140882.318497:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16561 00000100:00100000:1.0:1746140882.318502:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:32479:x1830960573558016:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140882.318507:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.318512:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0dfe expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.318530:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 7 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318537:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318542:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.318543:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.318546:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 22 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318547:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1298432->1474559] (req 1298432->1474559) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 22 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.318556:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f898000, rc 0) 00010000:00010000:1.0:1746140882.318571:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318582:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 22 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.318587:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573557760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 410us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.318593:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16558 00000100:00100000:1.0:1746140882.318594:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575990912:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.318608:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16562 00000100:00100000:2.0:1746140882.318612:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1982:x1830960573558272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.318618:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.318627:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e0c expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.318636:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.318637:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.318640:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 7 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.318641:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 35 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.318649:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 7 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.318650:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 35 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140882.318656:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575991040:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.318661:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f899200, rc 0) 00000100:00100000:2.0:1746140882.318680:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1982:x1830960573558272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 68us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.318680:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1600 going to sleep for 11 seconds 00000100:00100000:2.0:1746140882.318686:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16562 00000100:00100000:2.0:1746140882.318696:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16563 00000100:00100000:2.0:1746140882.318701:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573558400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.318706:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.318712:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e13 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.318721:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.318722:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.318725:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 22 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.318733:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 22 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.318739:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f899c00, rc 0) 00000100:00100000:2.0:1746140882.318753:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573558400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.318759:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16563 00000100:00100000:0.0:1746140882.321574:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575990912:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140882.321587:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575991040:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.321606:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140882.321617:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1298432->1474559] (req 1298432->1474559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.321632:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299aa00, rc 0) 00000100:00100000:0.0:1746140882.321669:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:32479:x1830960573558016:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3166us (3613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.321677:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16561 00000100:00100000:1.0:1746140882.322474:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573558528 00000100:00100000:1.0:1746140882.322481:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573558528 00010000:00010000:1.0:1746140882.322509:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 8 pid: 8458 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.322532:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8555 00000100:00100000:1.0:1746140882.322538:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573558528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.322549:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140882.322571:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 8 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.322581:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 8 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.322665:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009252b000/0x8156357b7fdb914a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d87 expref: 8 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.322677:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.322701:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573558528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 164us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.322707:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8555 00000100:00100000:3.0:1746140882.325245:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.325354:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573558656 00000100:00100000:1.0:1746140882.325417:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573558656 00010000:00010000:1.0:1746140882.325450:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 21 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.325476:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8556 00000100:00100000:1.0:1746140882.325484:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573558656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.325495:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140882.325516:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 21 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.325528:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 21 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.325550:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009299a600/0x8156357b7fdb924d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df7 expref: 21 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.325565:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.325568:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.325575:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 20 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.325583:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 20 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.325614:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 20 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.325627:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575991168:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140882.325698:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.327925:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575991168:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140882.327941:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.327983:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960573558656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2499us (2745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.327993:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8556 00000100:00100000:0.0:1746140882.328213:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.328252:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.328264:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573559168 00000100:00100000:3.0:1746140882.328270:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573559168 00002000:00100000:3.0:1746140882.328319:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1298432->1302527) req@ffff88009b890a80 x1830960573559168/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.328329:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890a80 with x1830960573559168 ext(1298432->1302527) 00002000:00010000:3.0:1746140882.328334:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b890a80 00000100:00100000:3.0:1746140882.328349:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573558912 00000100:00100000:3.0:1746140882.328352:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573558912 00002000:00100000:3.0:1746140882.328364:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b890e00 x1830960573558912/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.328371:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890e00 with x1830960573558912 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.328374:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b890e00 00000100:00100000:3.0:1746140882.328399:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8474 00000100:00100000:3.0:1746140882.328405:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960573559168:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140882.328405:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8475 00000100:00100000:0.0:1746140882.328412:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1984:x1830960573558912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.328565:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960573559168:12345-192.168.204.16@tcp:3:cat.0 Request processed in 160us (352us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140882.328572:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8474 00002000:00100000:3.0:1746140882.328577:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1298432->1302527) req@ffff88009b890a80 x1830960573559168/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.328583:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890a80 with x1830960573559168 ext(1298432->1302527) 00002000:00010000:3.0:1746140882.328586:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b890a80 00000100:00100000:2.0:1746140882.335384:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.335517:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573559424 00000100:00100000:0.0:1746140882.335527:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573559424 00002000:00100000:0.0:1746140882.335571:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88008f078a80 x1830960573559424/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.335582:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f078a80 with x1830960573559424 ext(0->1048575) 00002000:00010000:0.0:1746140882.335588:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f078a80 00000100:00100000:0.0:1746140882.335609:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8476 00000100:00100000:0.0:1746140882.335616:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573559424:12345-192.168.204.16@tcp:3:cat.0 00000001:00080000:1.0:1746140882.336018:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841293 is committed 00000001:00080000:1.0:1746140882.336032:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841290 is committed 00000001:00080000:1.0:1746140882.336064:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841212 is committed 00000001:00080000:1.0:1746140882.336123:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841240 is committed 00000001:00080000:1.0:1746140882.336132:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841233 is committed 00000001:00080000:1.0:1746140882.336175:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841280 is committed 00000001:00080000:1.0:1746140882.336212:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841236 is committed 00000001:00080000:1.0:1746140882.336253:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841281 is committed 00000100:00100000:2.0:1746140882.343879:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.343914:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.343950:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.343974:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573559680 00000100:00100000:2.0:1746140882.343981:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573559680 00002000:00100000:2.0:1746140882.344019:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88008f07a300 x1830960573559680/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.344028:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07a300 with x1830960573559680 ext(1048576->2097151) 00002000:00010000:2.0:1746140882.344033:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07a300 00000100:00100000:2.0:1746140882.344045:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573559936 00000100:00100000:2.0:1746140882.344047:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573559936 00002000:00100000:2.0:1746140882.344066:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f07ad80 x1830960573559936/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 504/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.344072:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07ad80 with x1830960573559936 ext(1048576->2097151) 00002000:00010000:2.0:1746140882.344074:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07ad80 00000100:00100000:2.0:1746140882.344088:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573560192 00000100:00100000:2.0:1746140882.344090:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573560192 00002000:00100000:2.0:1746140882.344099:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f079880 x1830960573560192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.344104:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079880 with x1830960573560192 ext(1048576->2097151) 00002000:00010000:2.0:1746140882.344106:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f079880 00000100:00100000:2.0:1746140882.344115:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8477 00000100:00100000:2.0:1746140882.344121:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573559680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140882.344517:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8478 00000100:00100000:0.0:1746140882.344530:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573559936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.344780:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8479 00000100:00100000:1.0:1746140882.344790:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1983:x1830960573560192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.349142:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1984:x1830960573558912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20716us (20873us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.349175:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8475 00002000:00100000:3.0:1746140882.349187:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b890e00 x1830960573558912/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.349197:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890e00 with x1830960573558912 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.349203:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b890e00 00000100:00100000:2.0:1746140882.353432:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1983:x1830960573559424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17807us (18050us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140882.353444:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8476 00002000:00100000:2.0:1746140882.353455:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88008f078a80 x1830960573559424/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.353463:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f078a80 with x1830960573559424 ext(0->1048575) 00002000:00010000:2.0:1746140882.353468:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f078a80 00000100:00100000:2.0:1746140882.357848:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573559680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13715us (13963us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140882.357859:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8477 00002000:00100000:2.0:1746140882.357871:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88008f07a300 x1830960573559680/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.357880:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07a300 with x1830960573559680 ext(1048576->2097151) 00002000:00010000:2.0:1746140882.357885:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07a300 00000100:00100000:0.0:1746140882.358846:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1983:x1830960573560192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14053us (14889us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140882.358856:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8479 00002000:00100000:0.0:1746140882.358865:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f079880 x1830960573560192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.358874:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079880 with x1830960573560192 ext(1048576->2097151) 00002000:00010000:0.0:1746140882.358878:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f079880 00000100:00100000:2.0:1746140882.362027:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.362027:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1983:x1830960573559936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17494us (18105us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746140882.362039:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8478 00002000:00100000:0.0:1746140882.362050:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f07ad80 x1830960573559936/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 504/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.362059:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07ad80 with x1830960573559936 ext(1048576->2097151) 00002000:00010000:0.0:1746140882.362065:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07ad80 00000100:00100000:0.0:1746140882.362094:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573560320 00000100:00100000:0.0:1746140882.362230:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573560320 00000100:00100000:0.0:1746140882.362278:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16564 00000100:00100000:0.0:1746140882.362285:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32482:x1830960573560320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140882.362298:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140882.362433:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e1a expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.362469:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 19 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.362477:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.362479:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.362482:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 7 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.362516:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 19 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.362528:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 19 pid: 4782 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.362541:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b891180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575991296:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140882.362898:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140882.366373:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b891180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575991296:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.366412:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 7 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.367050:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fb8400, rc 0) 00000100:00100000:2.0:1746140882.367126:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32482:x1830960573560320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4835us (5103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.367135:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16564 00000100:00100000:0.0:1746140882.371524:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.371637:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.371765:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573560576 00000100:00100000:2.0:1746140882.371775:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573560576 00002000:00100000:2.0:1746140882.371821:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1298432->1474559) req@ffff88009b893800 x1830960573560576/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.371831:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893800 with x1830960573560576 ext(1298432->1474559) 00010000:00010000:2.0:1746140882.371840:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 20 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.371854:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 20 pid: 4782 timeout: 961 lvb_type: 0 00002000:00010000:2.0:1746140882.371861:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b893800 00000100:00100000:2.0:1746140882.371883:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1749 00000100:00100000:2.0:1746140882.371889:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573560576:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140882.372338:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573560832 00000100:00100000:1.0:1746140882.372342:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573560832 00000100:00100000:1.0:1746140882.372378:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4641 00000100:00100000:1.0:1746140882.372383:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a979850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32479:x1830960573560832:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140882.372652:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a979850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32479:x1830960573560832:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 268us (1014us total) trans 8589944905 rc 0/0 00000100:00100000:1.0:1746140882.372659:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4641 00000100:00100000:0.0:1746140882.376623:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.376679:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573560960 00000100:00100000:2.0:1746140882.376689:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573560960 00000100:00100000:2.0:1746140882.376727:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16565 00000100:00100000:2.0:1746140882.376733:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:32483:x1830960573560960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.376750:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.376767:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e21 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.376794:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140882.376798:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 23 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.376809:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 23 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.376818:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0be400, rc 0) 00000100:00100000:2.0:1746140882.376858:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:32483:x1830960573560960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.376866:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16565 00000100:00100000:3.0:1746140882.378458:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573560576:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6559us (6935us total) trans 17179874037 rc 0/0 00000100:00100000:3.0:1746140882.378474:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1749 00002000:00100000:3.0:1746140882.378484:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1298432->1474559) req@ffff88009b893800 x1830960573560576/t17179874037(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/448 e 0 to 0 dl 1746140893 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.378493:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893800 with x1830960573560576 ext(1298432->1474559) 00010000:00010000:3.0:1746140882.378502:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 23 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.378518:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 23 pid: 4782 timeout: 961 lvb_type: 0 00002000:00010000:3.0:1746140882.378524:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b893800 00000100:00100000:0.0:1746140882.381006:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.381189:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573561088 00000100:00100000:1.0:1746140882.381202:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573561088 00010000:00010000:1.0:1746140882.381244:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 23 pid: 4782 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.381296:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8557 00000100:00100000:1.0:1746140882.381343:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1982:x1830960573561088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.381362:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746140882.383222:0:9847:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140882 -> 1746140883 00002000:00010000:1.0:1746140882.383230:0:9847:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140882 -> 1746140883 00010000:00010000:1.0:1746140882.383245:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 23 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.383262:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 23 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.383289:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb925b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1298432->1474559) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dfe expref: 23 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.383358:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.383361:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.383369:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 6 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.383376:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 6 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.383389:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.383390:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.383393:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 22 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.383399:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 22 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.383441:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 22 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.383463:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575991424:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140882.383579:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 6 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.383587:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575991552:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140882.383607:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.385404:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575991424:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140882.385417:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575991552:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140882.385437:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.385484:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573561088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4180us (4486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.385494:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8557 00000100:00100000:0.0:1746140882.389339:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.389962:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.390247:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573561344 00000100:00100000:3.0:1746140882.390256:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573561344 00002000:00100000:3.0:1746140882.390298:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b891c00 x1830960573561344/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.390331:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891c00 with x1830960573561344 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.390336:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b891c00 00000100:00100000:3.0:1746140882.391794:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573561600 00000100:00100000:3.0:1746140882.391800:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573561600 00002000:00100000:3.0:1746140882.391829:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b890700 x1830960573561600/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.391837:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890700 with x1830960573561600 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.391842:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b890700 00000100:00100000:3.0:1746140882.391862:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8480 00000100:00100000:3.0:1746140882.391870:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573561344:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.393286:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8481 00000100:00100000:2.0:1746140882.393296:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573561600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.403439:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573561344:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11557us (14129us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.403452:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8480 00002000:00100000:3.0:1746140882.403463:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b891c00 x1830960573561344/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.403473:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891c00 with x1830960573561344 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.403479:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b891c00 00000100:00100000:0.0:1746140882.404819:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573561600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11516us (14849us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140882.404830:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8481 00002000:00100000:0.0:1746140882.404839:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b890700 x1830960573561600/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.404849:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890700 with x1830960573561600 ext(1048576->2097151) 00002000:00010000:0.0:1746140882.404854:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b890700 00000100:00100000:0.0:1746140882.414515:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.414632:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573561728 00000100:00100000:2.0:1746140882.414641:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573561728 00000100:00100000:2.0:1746140882.414684:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16566 00000100:00100000:2.0:1746140882.414691:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32482:x1830960573561728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.414708:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.414725:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e28 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.414751:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.414753:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.414761:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 7 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.414775:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 7 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.414784:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0bfa00, rc 0) 00000100:00100000:2.0:1746140882.414997:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32482:x1830960573561728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 305us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.415003:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16566 00000100:00100000:0.0:1746140882.424275:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.424363:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.424385:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.424417:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.424428:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573561984 00000100:00100000:3.0:1746140882.424437:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573561984 00000100:00100000:2.0:1746140882.424456:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573562240 00000100:00100000:2.0:1746140882.424460:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573562240 00002000:00100000:3.0:1746140882.424473:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b891180 x1830960573561984/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.424480:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891180 with x1830960573561984 ext(2097152->3145727) 00002000:00100000:2.0:1746140882.424480:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b183b80 x1830960573562240/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746140882.424485:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891180 00002000:00100000:2.0:1746140882.424488:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b183b80 with x1830960573562240 ext(3145728->4194303) 00002000:00010000:2.0:1746140882.424491:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b183b80 00000100:00100000:3.0:1746140882.424508:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573562496 00000100:00100000:3.0:1746140882.424509:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573562496 00000100:00100000:2.0:1746140882.424513:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573562752 00000100:00100000:2.0:1746140882.424515:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573562752 00002000:00100000:3.0:1746140882.424517:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b182a00 x1830960573562496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.424522:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182a00 with x1830960573562496 ext(2097152->3145727) 00002000:00010000:3.0:1746140882.424524:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b182a00 00002000:00100000:2.0:1746140882.424528:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b181880 x1830960573562752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140882.424533:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8482 00002000:00100000:2.0:1746140882.424535:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181880 with x1830960573562752 ext(3145728->4194303) 00002000:00010000:2.0:1746140882.424537:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b181880 00000100:00100000:3.0:1746140882.424538:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1985:x1830960573561984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.424550:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8483 00000100:00100000:2.0:1746140882.424555:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1985:x1830960573562240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.424639:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8484 00000100:00100000:1.0:1746140882.424649:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573562496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.424778:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8485 00000100:00100000:3.0:1746140882.424782:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573562752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.433994:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.435656:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573563008 00000100:00100000:3.0:1746140882.435667:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573563008 00002000:00100000:3.0:1746140882.435714:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f07bb80 x1830960573563008/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.436135:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07bb80 with x1830960573563008 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.436141:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f07bb80 00000100:00100000:3.0:1746140882.436173:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8486 00000100:00100000:3.0:1746140882.436181:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573563008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.446943:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573562752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22142us (22508us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140882.446957:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8485 00002000:00100000:2.0:1746140882.446970:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b181880 x1830960573562752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.446979:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181880 with x1830960573562752 ext(3145728->4194303) 00002000:00010000:2.0:1746140882.446986:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b181880 00000100:00100000:3.0:1746140882.450171:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573562240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25601us (25793us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.450185:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8483 00002000:00100000:3.0:1746140882.450198:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b183b80 x1830960573562240/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.450208:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b183b80 with x1830960573562240 ext(3145728->4194303) 00002000:00010000:3.0:1746140882.450215:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b183b80 00000100:00100000:2.0:1746140882.459192:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1985:x1830960573561984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 34639us (34917us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140882.459207:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8482 00002000:00100000:2.0:1746140882.459223:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b891180 x1830960573561984/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.459239:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891180 with x1830960573561984 ext(2097152->3145727) 00002000:00010000:2.0:1746140882.459245:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891180 00000100:00100000:0.0:1746140882.462791:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573562496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 38126us (38385us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140882.462804:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8484 00002000:00100000:0.0:1746140882.462820:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b182a00 x1830960573562496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.462830:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182a00 with x1830960573562496 ext(2097152->3145727) 00002000:00010000:0.0:1746140882.462837:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b182a00 00000100:00100000:0.0:1746140882.465433:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573563008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29240us (31437us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140882.465448:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8486 00002000:00100000:0.0:1746140882.465460:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f07bb80 x1830960573563008/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.465471:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07bb80 with x1830960573563008 ext(1048576->2097151) 00002000:00010000:0.0:1746140882.465477:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f07bb80 00000100:00100000:0.0:1746140882.471210:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.471276:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.471727:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573563264 00000100:00100000:2.0:1746140882.471736:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573563264 00000100:00100000:1.0:1746140882.471796:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573563136 00000100:00100000:1.0:1746140882.471801:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573563136 00000100:00100000:1.0:1746140882.471832:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16567 00000100:00100000:1.0:1746140882.471839:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573563264:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140882.471844:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16568 00000100:00100000:3.0:1746140882.471854:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573563136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.471859:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.471864:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.471877:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e2f expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.471878:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e36 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.471903:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.471903:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.471905:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.471905:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.471915:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.471915:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.471932:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.471932:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.471943:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009252a000, rc 0) 00010000:00010000:1.0:1746140882.471943:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8c600, rc 0) 00000100:00100000:1.0:1746140882.472032:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960573563264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 193us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.472040:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16567 00000100:00100000:3.0:1746140882.472510:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960573563136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 656us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.472516:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16568 00000100:00100000:0.0:1746140882.479448:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.479581:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573563520 00000100:00100000:2.0:1746140882.479595:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573563520 00002000:00100000:2.0:1746140882.479656:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b182680 x1830960573563520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.479665:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182680 with x1830960573563520 ext(4194304->4886527) 00002000:00010000:2.0:1746140882.479671:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b182680 00000100:00100000:2.0:1746140882.479698:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8487 00000100:00100000:2.0:1746140882.479705:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1985:x1830960573563520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140882.488071:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.488120:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.488207:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573563776 00000100:00100000:2.0:1746140882.488220:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573563776 00002000:00100000:2.0:1746140882.488270:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88008ece0700 x1830960573563776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.488279:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0700 with x1830960573563776 ext(2097152->3145727) 00002000:00010000:2.0:1746140882.488285:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece0700 00000100:00100000:3.0:1746140882.488348:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573564032 00000100:00100000:3.0:1746140882.488356:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573564032 00000100:00100000:2.0:1746140882.488356:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8488 00000100:00100000:2.0:1746140882.488364:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573563776:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140882.488391:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008ece0e00 x1830960573564032/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.488400:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0e00 with x1830960573564032 ext(3145728->4194303) 00002000:00010000:3.0:1746140882.488405:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece0e00 00000100:00100000:3.0:1746140882.488434:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8489 00000100:00100000:3.0:1746140882.488441:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573564032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140882.492422:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.492460:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.492566:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573564288 00000100:00100000:2.0:1746140882.492579:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573564288 00002000:00100000:2.0:1746140882.492622:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008ece2d80 x1830960573564288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.492639:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2d80 with x1830960573564288 ext(2097152->3145727) 00002000:00010000:2.0:1746140882.492644:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece2d80 00000100:00100000:2.0:1746140882.492662:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573564544 00000100:00100000:2.0:1746140882.492664:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573564544 00002000:00100000:2.0:1746140882.492674:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008ece3800 x1830960573564544/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.492680:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece3800 with x1830960573564544 ext(3145728->4194303) 00002000:00010000:2.0:1746140882.492682:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece3800 00000100:00100000:2.0:1746140882.492694:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8490 00000100:00100000:2.0:1746140882.492701:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573564288:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.493072:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8491 00000100:00100000:3.0:1746140882.493085:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573564544:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.493581:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1985:x1830960573563520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13874us (14144us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140882.493590:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8487 00002000:00100000:2.0:1746140882.493596:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b182680 x1830960573563520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.493603:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182680 with x1830960573563520 ext(4194304->4886527) 00002000:00010000:2.0:1746140882.493606:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b182680 00000100:00100000:3.0:1746140882.498748:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573563776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10288us (10592us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.498760:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8488 00002000:00100000:3.0:1746140882.498772:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88008ece0700 x1830960573563776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.498789:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0700 with x1830960573563776 ext(2097152->3145727) 00002000:00010000:3.0:1746140882.498795:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece0700 00000100:00100000:0.0:1746140882.503862:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.503909:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.503938:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573564800 00000100:00100000:0.0:1746140882.503946:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573564800 00000100:00100000:0.0:1746140882.503988:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4642 00000100:00100000:0.0:1746140882.503995:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32483:x1830960573564800:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746140882.504202:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32483:x1830960573564800:12345-192.168.204.16@tcp:35:cat.0 Request processed in 207us (291us total) trans 8589944906 rc 0/0 00000100:00100000:0.0:1746140882.504208:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4642 00000100:00100000:1.0:1746140882.504904:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573564032:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16461us (16781us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140882.504911:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8489 00002000:00100000:1.0:1746140882.504920:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008ece0e00 x1830960573564032/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.504928:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0e00 with x1830960573564032 ext(3145728->4194303) 00002000:00010000:1.0:1746140882.504933:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece0e00 00000100:00100000:3.0:1746140882.505010:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573565056 00000100:00100000:3.0:1746140882.505014:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573565056 00000100:00100000:3.0:1746140882.505053:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10633 00000100:00100000:3.0:1746140882.505058:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32486:x1830960573565056:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140882.505068:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.505085:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b400/0x8156357b7fdb9293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e3d expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.505362:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505375:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505384:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505395:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505399:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505404:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505637:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505649:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505654:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:3.0:1746140882.505663:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140882.505721:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505727:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505733:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505738:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009252b000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.505742:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505748:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505757:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140882.505759:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.505763:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505768:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b000/0x8156357b7fdb929a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505786:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505793:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505798:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505802:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009252aa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.505804:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505809:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505814:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871900) 00010000:00010000:3.0:1746140882.505815:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.505817:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505822:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009252aa00/0x8156357b7fdb92a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.505855:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009252b400/0x8156357b7fdb9293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 273 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.505866:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 272 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.505872:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.505874:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140882.505876:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092664200, rc 0) 00000100:00100000:3.0:1746140882.505902:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32486:x1830960573565056:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 844us (2052us total) trans 8589944907 rc 0/0 00000100:00100000:3.0:1746140882.505909:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10633 00000100:00100000:3.0:1746140882.509236:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573564544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16145us (16765us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.509247:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8491 00002000:00100000:3.0:1746140882.509259:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008ece3800 x1830960573564544/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.509267:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece3800 with x1830960573564544 ext(3145728->4194303) 00002000:00010000:3.0:1746140882.509272:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece3800 00000100:00100000:1.0:1746140882.509733:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573564288:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17029us (17316us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140882.509741:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8490 00002000:00100000:1.0:1746140882.509748:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008ece2d80 x1830960573564288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.509755:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2d80 with x1830960573564288 ext(2097152->3145727) 00002000:00010000:1.0:1746140882.509758:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece2d80 00000100:00100000:0.0:1746140882.523434:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.523689:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573565312 00000100:00100000:1.0:1746140882.523699:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573565312 00002000:00100000:1.0:1746140882.523741:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88008ece2300 x1830960573565312/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.523751:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2300 with x1830960573565312 ext(4194304->4886527) 00002000:00010000:1.0:1746140882.523756:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece2300 00000100:00100000:1.0:1746140882.523790:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8492 00000100:00100000:1.0:1746140882.523797:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573565312:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140882.529593:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.529677:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573565440 00000100:00100000:3.0:1746140882.529687:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573565440 00000100:00100000:3.0:1746140882.529747:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16569 00000100:00100000:3.0:1746140882.529754:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:32486:x1830960573565440:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140882.529772:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.529791:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e44 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.529821:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 6 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.529829:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 23 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.529835:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 7 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.529846:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.529847:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.529851:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1462272->1794047] (req 1462272->1794047) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 23 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.529878:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 7 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.529891:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 7 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.529902:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575991680:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.530023:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 23 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.530032:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 23 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.530040:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575991808:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.530066:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 6 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.530074:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 6 pid: 8459 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.530086:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575991936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.530102:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.531715:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573565312:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7912us (8285us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140882.531726:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8492 00002000:00100000:1.0:1746140882.531736:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88008ece2300 x1830960573565312/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.531746:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2300 with x1830960573565312 ext(4194304->4886527) 00002000:00010000:1.0:1746140882.531752:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece2300 00000100:00100000:3.0:1746140882.533832:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575991680:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.533843:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575991808:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.533852:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575991936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.533883:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1462272->1794047] (req 1462272->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 23 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.533901:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009252aa00, rc 0) 00000100:00100000:3.0:1746140882.533954:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:32486:x1830960573565440:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4199us (4375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.533961:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16569 00000100:00100000:0.0:1746140882.535006:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.535040:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.535076:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.535107:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573565696 00000100:00100000:2.0:1746140882.535116:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573565696 00010000:00010000:2.0:1746140882.535157:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 7 pid: 8459 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.535179:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573565568 00000100:00100000:2.0:1746140882.535181:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573565568 00010000:00010000:2.0:1746140882.535191:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 8 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.535200:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573565824 00000100:00100000:2.0:1746140882.535202:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573565824 00010000:00010000:2.0:1746140882.535208:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 23 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.535220:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8558 00000100:00100000:2.0:1746140882.535224:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573565696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.535237:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.535258:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 7 pid: 8459 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.535267:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 7 pid: 8459 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.535288:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec23400/0x8156357b7fdb9135 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d80 expref: 7 pid: 8459 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.535331:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.535340:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8559 00000100:00100000:1.0:1746140882.535350:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573565568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140882.535356:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573565696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 131us (355us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140882.535359:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140882.535362:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8558 00010000:00010000:1.0:1746140882.535369:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 8 pid: 20960 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.535374:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8560 00000100:00100000:2.0:1746140882.535378:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573565824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.535379:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 8 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.535384:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.535391:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 23 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.535391:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9238 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de2 expref: 8 pid: 20960 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.535399:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 23 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.535408:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f898000/0x8156357b7fdb9246 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0df0 expref: 23 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.535416:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.535418:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.535424:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.535432:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.535768:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140882.535785:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.535798:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573565824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 418us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.535798:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575992064:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140882.535803:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8560 00000100:00100000:1.0:1746140882.535865:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.538928:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.539165:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573565952 00000100:00100000:3.0:1746140882.539173:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573565952 00000100:00100000:3.0:1746140882.539221:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16570 00000100:00100000:3.0:1746140882.539228:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573565952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140882.539244:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.539259:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db8bc00/0x8156357b7fdb92bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e4b expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.539326:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992192:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140882.539398:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.539428:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960575992064:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140882.539446:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.539466:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573565568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4119us (4426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.539475:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8559 00000100:00100000:3.0:1746140882.544521:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:2.0:1746140882.544547:0:8458:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime: 1746140882 -> 1746140883 00002000:00010000:2.0:1746140882.544552:0:8458:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime: 1746140882 -> 1746140883 00002000:00010000:2.0:1746140882.544554:0:8458:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime: 1746140882 -> 1746140883 00000100:00100000:2.0:1746140882.544578:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992192:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140882.544612:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db8bc00/0x8156357b7fdb92bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e4b expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.544626:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db8bc00/0x8156357b7fdb92bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e4b expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140882.544639:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573566208 00000100:00100000:1.0:1746140882.544646:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573566208 00010000:00010000:2.0:1746140882.544653:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db8bc00, rc 0) 00002000:00100000:1.0:1746140882.544686:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1789952->1794047) req@ffff8801354be680 x1830960573566208/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.544696:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354be680 with x1830960573566208 ext(1789952->1794047) 00000100:00100000:2.0:1746140882.544700:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573565952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5471us (5780us total) trans 0 rc 301/301 00002000:00010000:1.0:1746140882.544701:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354be680 00000100:00100000:2.0:1746140882.544708:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16570 00000100:00100000:1.0:1746140882.544717:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8493 00000100:00100000:1.0:1746140882.544725:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573566208:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140882.544916:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573566208:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 192us (408us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140882.544922:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8493 00002000:00100000:1.0:1746140882.544928:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1789952->1794047) req@ffff8801354be680 x1830960573566208/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.544941:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354be680 with x1830960573566208 ext(1789952->1794047) 00002000:00010000:1.0:1746140882.544944:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354be680 00000100:00100000:0.0:1746140882.549738:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.549844:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.549903:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573566592 00000100:00100000:2.0:1746140882.549912:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573566592 00000100:00100000:1.0:1746140882.549918:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573566464 00000100:00100000:1.0:1746140882.549923:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573566464 00000100:00100000:2.0:1746140882.549958:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16571 00000100:00100000:1.0:1746140882.549959:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4643 00000100:00100000:2.0:1746140882.549964:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573566592:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140882.549965:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32486:x1830960573566464:12345-192.168.204.16@tcp:35:multiop.0 00010000:00010000:2.0:1746140882.549979:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.549995:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb92c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e52 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.550041:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992320:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140882.550132:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.550163:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:32486:x1830960573566464:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 197us (436us total) trans 8589944908 rc 0/0 00000100:00100000:1.0:1746140882.550170:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4643 00000100:00100000:2.0:1746140882.552037:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992320:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140882.552066:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb92c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e52 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.552079:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb92c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e52 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.552104:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5228200, rc 0) 00000100:00100000:2.0:1746140882.552140:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573566592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2176us (2296us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140882.552154:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16571 00000100:00100000:0.0:1746140882.554693:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.555716:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.555835:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573566976 00000100:00100000:1.0:1746140882.555844:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573566976 00000100:00100000:1.0:1746140882.555886:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4644 00000100:00100000:1.0:1746140882.555893:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32482:x1830960573566976:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140882.555954:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573566720 00000100:00100000:2.0:1746140882.555959:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573566720 00000100:00100000:2.0:1746140882.555997:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16572 00000100:00100000:2.0:1746140882.556003:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32478:x1830960573566720:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140882.556014:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.556030:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e59 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.556054:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090747000/0x8156357b7fdb9127 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d9c expref: 5 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.556062:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.556068:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 21 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.556074:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.556076:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.556079:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3903488->4194303] (req 3903488->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.556099:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32482:x1830960573566976:12345-192.168.204.16@tcp:35:cat.0 Request processed in 205us (383us total) trans 8589944909 rc 0/0 00000100:00100000:1.0:1746140882.556105:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4644 00010000:00010000:2.0:1746140882.556106:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 21 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.556116:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 21 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.556128:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.556200:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.556207:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.556216:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992576:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.556630:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090747000/0x8156357b7fdb9127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d9c expref: 5 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.556639:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090747000/0x8156357b7fdb9127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d9c expref: 5 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.556647:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.556668:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140882.558360:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992448:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.558369:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992576:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.558375:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960575992704:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.558398:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3903488->4194303] (req 3903488->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.558411:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5228a00, rc 0) 00000100:00100000:2.0:1746140882.558442:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32478:x1830960573566720:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2437us (3757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.558448:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16572 00000100:00100000:0.0:1746140882.559986:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.560028:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.560351:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573567104 00000100:00100000:1.0:1746140882.560358:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573567232 00000100:00100000:2.0:1746140882.560359:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573567104 00000100:00100000:1.0:1746140882.560363:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573567232 00010000:00010000:2.0:1746140882.560391:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 22 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.560392:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090747000/0x8156357b7fdb9127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d9c expref: 6 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.560435:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8561 00000100:00100000:1.0:1746140882.560442:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+6:1982:x1830960573567232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140882.560447:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8562 00000100:00100000:2.0:1746140882.560453:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573567104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140882.560455:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.560462:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.560478:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 22 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.560480:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090747000/0x8156357b7fdb9127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d9c expref: 6 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.560489:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 22 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.560498:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090747000/0x8156357b7fdb9127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d9c expref: 6 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.560519:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f899c00/0x8156357b7fdb9269 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e13 expref: 22 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.560525:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090747000/0x8156357b7fdb9127 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d9c expref: 6 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:1.0:1746140882.560536:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140882.560618:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140882.560656:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+5:1982:x1830960573567232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 215us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.560662:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8561 00000100:00100000:2.0:1746140882.560692:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573567104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 238us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.560698:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8562 00000100:00100000:1.0:1746140882.561772:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.561902:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573567360 00000100:00100000:2.0:1746140882.561908:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573567360 00010000:00010000:2.0:1746140882.561925:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.561944:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8563 00000100:00100000:2.0:1746140882.561949:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573567360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.561958:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.561971:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.561980:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.561993:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8c600/0x8156357b7fdb9285 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e36 expref: 8 pid: 20960 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.562001:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.562003:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.562008:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.562016:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.562044:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.562056:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575992832:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140882.562956:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140882.564250:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960575992832:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140882.564267:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.564367:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573567360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2415us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.564375:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8563 00000100:00100000:0.0:1746140882.564791:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.564930:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573567616 00000100:00100000:3.0:1746140882.564936:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573567616 00002000:00100000:3.0:1746140882.564970:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (3903488->3907583) req@ffff88009fc36a00 x1830960573567616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.564980:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc36a00 with x1830960573567616 ext(3903488->3907583) 00002000:00010000:3.0:1746140882.564984:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc36a00 00000100:00100000:3.0:1746140882.565010:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8494 00000100:00100000:3.0:1746140882.565017:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573567616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.565193:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573567616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 176us (402us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140882.565199:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8494 00002000:00100000:3.0:1746140882.565204:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (3903488->3907583) req@ffff88009fc36a00 x1830960573567616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.565211:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc36a00 with x1830960573567616 ext(3903488->3907583) 00002000:00010000:3.0:1746140882.565214:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc36a00 00000100:00100000:0.0:1746140882.568640:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.568844:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573567744 00000100:00100000:2.0:1746140882.568854:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573567744 00000100:00100000:2.0:1746140882.568907:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16573 00000100:00100000:2.0:1746140882.568915:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32478:x1830960573567744:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140882.568933:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.568949:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e60 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.568980:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090746600/0x8156357b7fdb9143 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d95 expref: 7 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.568988:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 9 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.568996:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 12 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.569003:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.569004:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.569008:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4452351] (req 4194304->4452351) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.569040:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 12 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.569052:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 12 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.569064:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575992960:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.569166:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 9 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.569174:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 9 pid: 8458 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.569187:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575993088:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.569214:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090746600/0x8156357b7fdb9143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d95 expref: 7 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.569222:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090746600/0x8156357b7fdb9143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d95 expref: 7 pid: 4186 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.569230:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575993216:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.569247:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140882.571099:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575992960:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.571108:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575993088:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.571377:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575993216:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.571404:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4452351] (req 4194304->4452351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.571420:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1200, rc 0) 00000100:00100000:2.0:1746140882.571467:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32478:x1830960573567744:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2552us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.571476:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16573 00000100:00100000:0.0:1746140882.572127:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.572192:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573567872 00000100:00100000:3.0:1746140882.572198:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573567872 00010000:00010000:3.0:1746140882.572227:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090746600/0x8156357b7fdb9143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d95 expref: 8 pid: 4186 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.572261:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8564 00000100:00100000:3.0:1746140882.572268:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573567872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.572279:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.572325:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090746600/0x8156357b7fdb9143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d95 expref: 8 pid: 4186 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.572336:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090746600/0x8156357b7fdb9143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d95 expref: 8 pid: 4186 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.572358:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090746600/0x8156357b7fdb9143 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d95 expref: 8 pid: 4186 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.572377:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.572414:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573567872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 146us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.572420:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8564 00000100:00100000:2.0:1746140882.573998:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.574299:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573568000 00000100:00100000:3.0:1746140882.574323:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573568000 00010000:00010000:3.0:1746140882.574345:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 13 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.574369:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8565 00000100:00100000:3.0:1746140882.574374:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1985:x1830960573568000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.574383:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.574403:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 13 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.574415:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 13 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.574431:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f899200/0x8156357b7fdb9262 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e0c expref: 13 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.574444:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.574484:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1985:x1830960573568000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.574490:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8565 00000100:00100000:2.0:1746140882.575351:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.575402:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573568128 00000100:00100000:0.0:1746140882.575407:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573568128 00010000:00010000:0.0:1746140882.575430:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 9 pid: 8458 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.575460:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8566 00000100:00100000:0.0:1746140882.575466:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573568128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140882.575475:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140882.575488:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 9 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:0.0:1746140882.575498:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 9 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:0.0:1746140882.575513:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009252a000/0x8156357b7fdb928c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e2f expref: 9 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:0.0:1746140882.575528:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.575530:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.575537:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.575546:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.575577:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.575594:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575993344:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140882.575791:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23cacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.576922:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575993344:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140882.576940:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140882.577003:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573568128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1535us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.577013:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8566 00000100:00100000:0.0:1746140882.579858:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.579956:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573568384 00000100:00100000:1.0:1746140882.579965:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573568384 00002000:00100000:1.0:1746140882.580008:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4448256->4452351) req@ffff88009fc34380 x1830960573568384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.580018:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34380 with x1830960573568384 ext(4448256->4452351) 00002000:00010000:1.0:1746140882.580023:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34380 00000100:00100000:1.0:1746140882.580056:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8495 00000100:00100000:1.0:1746140882.580064:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573568384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.580279:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573568384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 215us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140882.580286:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8495 00002000:00100000:1.0:1746140882.580292:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4448256->4452351) req@ffff88009fc34380 x1830960573568384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.580301:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34380 with x1830960573568384 ext(4448256->4452351) 00002000:00010000:1.0:1746140882.580332:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34380 00000100:00100000:0.0:1746140882.585507:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.586451:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573568640 00000100:00100000:2.0:1746140882.586463:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573568640 00000100:00100000:2.0:1746140882.588169:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4645 00000100:00100000:2.0:1746140882.588186:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32478:x1830960573568640:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140882.588463:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32478:x1830960573568640:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 282us (2973us total) trans 8589944910 rc 0/0 00000100:00100000:2.0:1746140882.588470:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4645 00000100:00100000:0.0:1746140882.654611:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.654733:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573568768 00000100:00100000:3.0:1746140882.654744:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573568768 00000100:00100000:3.0:1746140882.654807:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10634 00000100:00100000:3.0:1746140882.654814:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:32491:x1830960573568768:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140882.654837:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.654855:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8b800/0x8156357b7fdb92d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e67 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.654916:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.654929:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.654939:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.654955:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.654961:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.654966:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655081:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655088:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655094:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:3.0:1746140882.655123:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140882.655127:0:14743:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140882.655155:0:14743:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655165:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655172:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655177:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655183:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655192:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db8ba00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.655196:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655202:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655212:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140882.655215:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.655219:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655223:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb92e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655240:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655243:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655248:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655252:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db8bc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.655254:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655258:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655263:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871300) 00010000:00010000:3.0:1746140882.655265:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.655267:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655271:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8bc00/0x8156357b7fdb92e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.655294:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8b800/0x8156357b7fdb92d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.655336:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 7 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.655343:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.655345:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140882.655347:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009252a000, rc 0) 00000100:00100000:3.0:1746140882.655411:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:32491:x1830960573568768:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 597us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.655419:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10634 00000100:00100000:0.0:1746140882.659051:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.660002:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.660027:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.660453:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573568896 00000100:00100000:3.0:1746140882.660463:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573568896 00000100:00100000:0.0:1746140882.660482:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.660488:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573569152 00000100:00100000:2.0:1746140882.660493:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573569152 00000100:00100000:3.0:1746140882.660504:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573569024 00000100:00100000:3.0:1746140882.660506:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573569024 00000100:00100000:0.0:1746140882.660506:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573569280 00000100:00100000:0.0:1746140882.660508:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573569280 00000100:00100000:3.0:1746140882.660523:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16574 00000100:00100000:3.0:1746140882.660530:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573568896:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746140882.660539:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16575 00000100:00100000:0.0:1746140882.660544:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573569152:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140882.660545:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140882.660553:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140882.660554:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16576 00000100:00100000:1.0:1746140882.660561:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573569024:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140882.660562:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009252be00/0x8156357b7fdb92f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e6e expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.660562:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb92fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e7c expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.660567:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.660574:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e75 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.660582:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.660584:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.660591:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 9 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.660604:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 9 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140882.660607:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575993472:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140882.660608:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575993600:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140882.660612:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8c200, rc 0) 00000100:00100000:2.0:1746140882.660651:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16577 00000100:00100000:2.0:1746140882.660656:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573569280:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140882.660662:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.660669:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdb930a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e83 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.660690:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23cacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140882.660692:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140882.660699:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575993728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140882.660722:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.660754:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573569024:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 193us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.660760:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16576 00000100:00100000:3.0:1746140882.664782:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575993600:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140882.664814:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009252be00/0x8156357b7fdb92f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e6e expref: 9 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.664828:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009252be00/0x8156357b7fdb92f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e6e expref: 9 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.664853:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009252be00, rc 0) 00002000:00010000:2.0:1746140882.664987:0:4785:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime: 1746140882 -> 1746140883 00002000:00010000:1.0:1746140882.664987:0:9872:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime: 1746140882 -> 1746140883 00002000:00010000:2.0:1746140882.664991:0:4785:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140882 -> 1746140883 00002000:00010000:1.0:1746140882.664991:0:9872:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140882 -> 1746140883 00002000:00010000:2.0:1746140882.664993:0:4785:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime: 1746140882 -> 1746140883 00002000:00010000:1.0:1746140882.664993:0:9872:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime: 1746140882 -> 1746140883 00000100:00100000:2.0:1746140882.665002:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960575993728:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140882.665004:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575993472:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140882.665019:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdb930a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e83 expref: 8 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.665020:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb92fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e7c expref: 8 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.665027:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdb930a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e83 expref: 8 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.665028:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb92fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e7c expref: 8 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.665041:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a0000, rc 0) 00010000:00010000:1.0:1746140882.665041:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb9000, rc 0) 00000100:00100000:2.0:1746140882.665077:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573569280:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4420us (4595us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140882.665085:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16577 00000100:00100000:1.0:1746140882.665256:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573569152:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4710us (5254us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140882.665262:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16575 00000100:00100000:3.0:1746140882.665286:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+6:1985:x1830960573568896:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4748us (6238us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140882.665296:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16574 00000100:00100000:0.0:1746140882.670910:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.670958:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573569536 00000100:00100000:2.0:1746140882.670968:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573569536 00000100:00100000:2.0:1746140882.671021:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10635 00000100:00100000:2.0:1746140882.671029:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:32491:x1830960573569536:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140882.671049:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.671066:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb9311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e8a expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.671173:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.671186:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 272 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.671193:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 272 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.671199:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.671204:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.671234:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.671245:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 8 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.671255:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575993856:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.671879:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 272 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.671888:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 272 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.671896:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575993984:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.671936:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 272 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.671943:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 272 pid: 14741 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.671951:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575994112:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.671967:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c19c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746140882.673970:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746140882.675569:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575993856:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.675583:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575993984:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.675685:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575994112:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.675711:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140882.676485:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.676554:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573569664 00000100:00100000:2.0:1746140882.676561:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573569664 00010000:00010000:2.0:1746140882.676593:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.676626:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8567 00000100:00100000:2.0:1746140882.676632:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573569664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.676644:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.676654:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.676664:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.676685:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009252a000/0x8156357b7fdb92ee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e67 expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.676704:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140882.676709:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.676717:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.676722:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.676778:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573569664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 146us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.676785:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8567 00000100:00100000:2.0:1746140882.676863:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.676915:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573569792 00000100:00100000:3.0:1746140882.676926:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573569792 00000100:00100000:2.0:1746140882.676953:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.676960:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 273 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.677004:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573569920 00000100:00100000:3.0:1746140882.677011:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573569920 00010000:00010000:3.0:1746140882.677021:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 274 pid: 14741 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.677046:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8568 00000100:00100000:3.0:1746140882.677053:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:1985:x1830960573569792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.677064:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.677069:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 274 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.677077:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8569 00010000:00010000:3.0:1746140882.677082:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 274 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.677084:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:1984:x1830960573569920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.677094:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.677099:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 274 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.677100:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092664200/0x8156357b7fdb92a8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e3d expref: 274 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.677108:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 273 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.677180:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1400/0x8156357b7fdb922a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dd4 expref: 273 pid: 14741 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.677200:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.677206:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.677215:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140882.677221:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.677251:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140882.677255:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.677286:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1984:x1830960573569920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 202us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.677296:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8569 00010000:00010000:3.0:1746140882.677299:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.677366:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:1985:x1830960573569792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 312us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.677372:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8568 00010000:00010000:0.0:1746140882.677417:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140882.677424:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:0.0:1746140882.677442:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140882.677567:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb9311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e8a expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.677956:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e8a expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.677963:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140882.677966:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140882.677968:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1e00, rc 0) 00000100:00100000:0.0:1746140882.678231:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:32491:x1830960573569536:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 7202us (7330us total) trans 8589944911 rc 0/0 00000100:00100000:0.0:1746140882.678237:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10635 00000100:00100000:0.0:1746140882.679150:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.680193:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573570176 00000100:00100000:2.0:1746140882.680202:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573570176 00000100:00100000:2.0:1746140882.680253:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10636 00000100:00100000:2.0:1746140882.680260:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32496:x1830960573570176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.680281:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.680298:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb9326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e91 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.680416:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.680429:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.680439:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.680452:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.680458:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.680462:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681065:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681073:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681079:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140882.681087:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140882.681169:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681175:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681181:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681190:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a0a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140882.681193:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681200:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681209:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140882.681212:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140882.681215:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681220:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb932d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681232:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681237:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681241:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681245:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a0800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140882.681247:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681251:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681256:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152b00) 00010000:00010000:2.0:1746140882.681258:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140882.681261:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681265:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb9334 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140882.681298:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb9326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.681329:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.681335:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140882.681337:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140882.681339:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1c00, rc 0) 00000100:00100000:2.0:1746140882.681403:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32496:x1830960573570176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1142us (2263us total) trans 8589944912 rc 0/0 00000100:00100000:2.0:1746140882.681409:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10636 00000100:00100000:1.0:1746140882.681639:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.681654:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573570432 00000100:00100000:3.0:1746140882.681659:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573570432 00000100:00100000:1.0:1746140882.681668:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.681685:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573570688 00000100:00100000:3.0:1746140882.681687:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573570688 00000100:00100000:3.0:1746140882.681705:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10637 00000100:00100000:1.0:1746140882.681709:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10638 00000100:00100000:3.0:1746140882.681710:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32495:x1830960573570432:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:1.0:1746140882.681715:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:32491:x1830960573570688:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140882.681721:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.681722:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.681724:0:14743:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746140882.681728:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ac00/0x8156357b7fdb9349 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e98 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.681733:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1e00/0x8156357b7fdb9318 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e8a expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.681745:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140882.681748:0:14743:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140882.681753:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdb9350 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0e9f expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.681775:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140882.681779:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.681781:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140882.681785:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.681787:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140882.681791:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140882.681796:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140882.681797:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140882.681801:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.681806:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140882.681845:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdb9350 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.681852:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140882.681855:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.681859:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.681864:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140882.681873:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140882.681875:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140882.681877:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140882.681881:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8c600, rc 0) 00010000:00010000:3.0:1746140882.681898:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.681909:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 9 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.681912:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:32491:x1830960573570688:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 198us (244us total) trans 8589944913 rc 0/0 00000100:00100000:1.0:1746140882.681917:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10638 00000100:00100000:3.0:1746140882.681925:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960575994240:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.681987:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140882.683066:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960575994240:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.683095:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140882.683421:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.683495:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.683546:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573570944 00000100:00100000:1.0:1746140882.683552:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573570944 00000100:00100000:1.0:1746140882.683592:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10639 00000100:00100000:1.0:1746140882.683596:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:32491:x1830960573570944:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140882.683611:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.683621:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d200/0x8156357b7fdb937a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ea6 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.683657:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d200/0x8156357b7fdb937a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ea6 expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.683665:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d200/0x8156357b7fdb937a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ea6 expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.683675:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140882.683677:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140882.683679:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8d200, rc 0) 00000100:00100000:1.0:1746140882.683719:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:32491:x1830960573570944:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 121us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.683725:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10639 00000100:00100000:3.0:1746140882.683726:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573570816 00000100:00100000:3.0:1746140882.683732:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573570816 00010000:00010000:3.0:1746140882.683765:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 10 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.683798:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8570 00000100:00100000:3.0:1746140882.683805:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573570816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.683818:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.683823:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 10 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.683834:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 10 pid: 14743 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.684062:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.684419:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c600/0x8156357b7fdb935e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e9f expref: 10 pid: 14743 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.684434:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.684438:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684450:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684456:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684473:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.684503:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573570816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 698us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.684510:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8570 00010000:00010000:3.0:1746140882.684530:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684536:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140882.684551:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140882.684652:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684659:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684665:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684670:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fadd000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.684674:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684680:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684692:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.684694:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140882.684698:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684703:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadd000/0x8156357b7fdb9373 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684715:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684719:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684724:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684728:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db8ba00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.684730:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684735:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684741:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140882.684743:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.684746:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684750:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9357 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684759:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684764:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684769:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684772:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008faddc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.684775:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684779:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684785:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871600) 00010000:00010000:3.0:1746140882.684787:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.684789:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684793:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008faddc00/0x8156357b7fdb9365 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.684835:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ac00/0x8156357b7fdb9349 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e98 expref: 273 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.684841:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8ac00/0x8156357b7fdb9349 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e98 expref: 273 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.684849:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db8ac00, rc 0) 00000100:00100000:3.0:1746140882.684872:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32495:x1830960573570432:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3162us (3234us total) trans 8589944914 rc 301/301 00000100:00100000:3.0:1746140882.684883:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10637 00000100:00100000:2.0:1746140882.685353:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573571072 00000100:00100000:2.0:1746140882.685360:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573571072 00000100:00100000:2.0:1746140882.685403:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16578 00000100:00100000:2.0:1746140882.685409:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573571072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.685420:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.685433:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1000/0x8156357b7fdb9388 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ead expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.685477:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575994368:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140882.685550:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.686283:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.686336:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.686361:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.686375:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.686405:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.686422:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573571328 00000100:00100000:0.0:1746140882.686422:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573571200 00000100:00100000:3.0:1746140882.686427:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573571328 00000100:00100000:0.0:1746140882.686427:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573571200 00000100:00100000:1.0:1746140882.686444:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573571584 00000100:00100000:1.0:1746140882.686449:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573571584 00000100:00100000:0.0:1746140882.686533:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573571456 00000100:00100000:0.0:1746140882.686537:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573571456 00000100:00100000:1.0:1746140882.686555:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573571840 00000100:00100000:1.0:1746140882.686557:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573571840 00000100:00100000:0.0:1746140882.686652:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16579 00000100:00100000:1.0:1746140882.686662:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16580 00000100:00100000:0.0:1746140882.686664:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573571328:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:1.0:1746140882.686668:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573571200:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140882.686699:0:32376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.686716:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090746e00/0x8156357b7fdb913c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d79 expref: 8 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.686725:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.686732:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.686743:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.686745:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.686748:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.686774:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.686786:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 7 pid: 8459 timeout: 961 lvb_type: 0 00010000:00010000:0.0:1746140882.686786:0:4782:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.686798:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575994496:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140882.686804:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 20 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.686811:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.686813:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.686815:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.686837:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 20 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.686845:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 20 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.686854:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140882.686855:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575994624:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.686863:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 11 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.686871:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575994752:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140882.686876:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23cacc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746140882.686895:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090746e00/0x8156357b7fdb913c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d79 expref: 8 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.686901:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090746e00/0x8156357b7fdb913c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d79 expref: 8 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.686912:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.686913:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575994880:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.686928:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.686931:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573571712 00000100:00100000:0.0:1746140882.686934:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573571712 00000100:00100000:1.0:1746140882.686944:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16581 00000100:00100000:1.0:1746140882.686950:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573571584:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140882.686967:0:9872:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.686976:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.686983:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 7 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.686990:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.686995:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.686996:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.686998:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.686999:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16582 00000100:00100000:3.0:1746140882.687007:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573571456:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140882.687011:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140882.687012:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16583 00010000:00010000:1.0:1746140882.687018:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 11 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.687024:0:24958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.687024:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573571840:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:1.0:1746140882.687026:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575995008:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.687035:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 8 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.687042:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 8 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.687049:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 20 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.687049:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 7 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.687054:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.687055:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.687056:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 7 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.687057:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.687057:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.687063:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575995136:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.687071:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 20 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.687071:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.687077:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140882.687078:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 20 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.687079:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.687080:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140882.687081:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.687088:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 9 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.687091:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575995264:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.687095:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575995392:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.687103:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.687108:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1540 going to sleep for 11 seconds 00010000:00010000:2.0:1746140882.687112:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.687122:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 8 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140882.687122:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575995520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.687130:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 8 pid: 32376 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.687138:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575995648:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.687170:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c1300 going to sleep for 11 seconds 00010000:00010000:3.0:1746140882.687181:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 8 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.687189:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 8 pid: 4782 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.687197:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575995776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.687210:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.687362:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16584 00000100:00100000:0.0:1746140882.687369:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573571712:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140882.687386:0:8460:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.687396:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.687402:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.687404:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.687406:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.687420:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.687427:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 7 pid: 8458 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.687625:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960575995904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.687636:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960575994368:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140882.687659:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1000/0x8156357b7fdb9388 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ead expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140882.687659:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23ca0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140882.687715:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1000/0x8156357b7fdb9388 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ead expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140882.687729:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1000, rc 0) 00000100:00100000:3.0:1746140882.687751:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573571072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2342us (3689us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140882.687757:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16578 00000100:00100000:1.0:1746140882.689546:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575994496:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.689558:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575994752:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.689566:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575994880:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.689588:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.689634:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960575994624:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.689655:0:4782:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.690612:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575995008:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140882.690956:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960575995904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140882.690962:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575995264:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.690969:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960575995520:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140882.690971:0:8460:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.690973:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575995648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.690984:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.691030:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575995136:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.691037:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960575995392:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.691060:0:9872:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.691125:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.691164:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.691816:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573572352 00000100:00100000:3.0:1746140882.691823:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573572352 00010000:00010000:3.0:1746140882.691854:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 10 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.691876:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573572224 00000100:00100000:3.0:1746140882.691879:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573572224 00010000:00010000:3.0:1746140882.691888:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090746e00/0x8156357b7fdb913c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d79 expref: 11 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.692004:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.692090:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573572864 00000100:00100000:3.0:1746140882.692093:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573572864 00000100:00100000:0.0:1746140882.692100:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.692106:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 12 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.692115:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.692120:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573572608 00000100:00100000:3.0:1746140882.692123:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573572608 00000100:00100000:0.0:1746140882.692125:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.692131:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 13 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.692162:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.692164:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8571 00000100:00100000:3.0:1746140882.692170:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573572352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140882.692172:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.692182:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140882.692183:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.692196:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.692206:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 11 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.692206:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.692215:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 11 pid: 4784 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.692236:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8c000/0x8156357b7fdb912e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d8e expref: 11 pid: 4784 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.692236:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140882.692253:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.692294:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573572352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 125us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.692298:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573571968 00000100:00100000:3.0:1746140882.692301:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8571 00000100:00100000:2.0:1746140882.692302:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573571968 00010000:00010000:2.0:1746140882.692326:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 8 pid: 8459 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.692338:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573573248 00000100:00100000:2.0:1746140882.692340:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573573248 00010000:00010000:2.0:1746140882.692350:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 21 pid: 4782 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.692358:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573572480 00000100:00100000:2.0:1746140882.692359:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573572480 00000100:00100000:3.0:1746140882.692360:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573572736 00000100:00100000:3.0:1746140882.692363:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573572736 00010000:00010000:2.0:1746140882.692367:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 9 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.692373:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 9 pid: 32376 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.692380:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573573376 00000100:00100000:2.0:1746140882.692382:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573573376 00000100:00100000:3.0:1746140882.692384:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8572 00000100:00100000:3.0:1746140882.692389:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573572224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.692392:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 7 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.692395:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140882.692403:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8573 00010000:00010000:3.0:1746140882.692405:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090746e00/0x8156357b7fdb913c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d79 expref: 9 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.692408:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1982:x1830960573572864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.692412:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090746e00/0x8156357b7fdb913c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d79 expref: 9 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.692417:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.692422:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090746e00/0x8156357b7fdb913c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0d79 expref: 9 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.692425:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 13 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.692430:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140882.692433:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 13 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.692444:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573572224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.692450:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8572 00010000:00010000:2.0:1746140882.692451:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb9254 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e05 expref: 13 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:3.0:1746140882.692460:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8574 00010000:00010000:2.0:1746140882.692460:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.692465:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1985:x1830960573572608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.692471:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.692478:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 12 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.692478:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1982:x1830960573572864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.692483:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8573 00010000:00010000:3.0:1746140882.692485:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 12 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.692495:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8575 00010000:00010000:3.0:1746140882.692496:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c993c00/0x8156357b7fdb923f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0de9 expref: 11 pid: 20960 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.692497:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.692500:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573571968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.692503:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140882.692507:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.692514:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 9 pid: 8459 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.692516:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+10:1985:x1830960573572608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.692516:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573573504 00000100:00100000:0.0:1746140882.692519:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573573504 00000100:00100000:3.0:1746140882.692522:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8574 00010000:00010000:2.0:1746140882.692522:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 10 pid: 8459 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.692532:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8576 00010000:00010000:2.0:1746140882.692533:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f8b600/0x8156357b7fdb91e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0db8 expref: 10 pid: 8459 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.692537:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573573248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140882.692537:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16585 00010000:00010000:2.0:1746140882.692542:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140882.692542:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32496:x1830960573573504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140882.692543:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.692544:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.692548:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.692554:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.692555:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 21 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.692555:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.692562:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0eb4 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.692563:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 21 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.692574:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0be400/0x8156357b7fdb9277 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e21 expref: 21 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:0.0:1746140882.692578:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.692579:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140882.692583:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140882.692584:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.692585:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.692588:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 10 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.692592:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573571968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.692597:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573573248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (424us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140882.692597:0:20960:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.692598:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8575 00000100:00100000:3.0:1746140882.692602:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8576 00010000:00010000:0.0:1746140882.692608:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 9 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.692610:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8577 00000100:00100000:3.0:1746140882.692614:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8578 00000100:00100000:2.0:1746140882.692615:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573572480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140882.692616:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb8c00, rc 0) 00000100:00100000:3.0:1746140882.692618:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573572736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.692621:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.692625:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.692628:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 9 pid: 4782 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.692630:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32496:x1830960573573504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 88us (134us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140882.692631:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 9 pid: 32376 timeout: 961 lvb_type: 1 00000100:00100000:0.0:1746140882.692635:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16585 00010000:00010000:2.0:1746140882.692636:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 9 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.692639:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 9 pid: 32376 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.692645:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0bfa00/0x8156357b7fdb927e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e28 expref: 8 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.692652:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.692654:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8c200/0x8156357b7fdb9303 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e75 expref: 9 pid: 32376 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.692661:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140882.692672:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140882.692674:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573572736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (478us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140882.692674:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.692680:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8578 00010000:00010000:2.0:1746140882.692681:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.692690:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8579 00010000:00010000:2.0:1746140882.692694:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.692695:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573573376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.692700:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.692706:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 7 pid: 4782 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.692714:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 7 pid: 4782 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.692714:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573572480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.692720:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8577 00010000:00010000:3.0:1746140882.692723:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.692724:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.692727:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.692733:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.692743:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140882.692754:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.692761:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.692780:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.692787:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.692790:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573572096 00010000:00010000:2.0:1746140882.692794:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.692794:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573572096 00010000:00010000:2.0:1746140882.692800:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8ca00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140882.692803:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.692810:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746140882.692817:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1462272->1794047) req@ffff88009b1b1f80 x1830960573572096/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746140882.692818:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.692819:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.692824:0:32376:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 6 pid: 20960 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746140882.692831:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b1f80 with x1830960573572096 ext(1462272->1794047) 00010000:00010000:2.0:1746140882.692835:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 6 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.692838:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 20 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.692846:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 20 pid: 8458 timeout: 961 lvb_type: 0 00002000:00010000:1.0:1746140882.692852:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b1b1f80 00010000:00010000:2.0:1746140882.692857:0:32376:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 6 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.692864:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573572992 00000100:00100000:1.0:1746140882.692866:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573572992 00000100:00100000:2.0:1746140882.692867:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575996032:192.168.204.16@tcp:105: 00002000:00100000:1.0:1746140882.692877:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3903488->4194303) req@ffff88009b1b3100 x1830960573572992/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.692883:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b3100 with x1830960573572992 ext(3903488->4194303) 00010000:00010000:1.0:1746140882.692887:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.692894:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00002000:00010000:1.0:1746140882.692899:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b1b3100 00000100:00100000:2.0:1746140882.692905:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c1840 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.692908:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573573120 00000100:00100000:1.0:1746140882.692910:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573573120 00002000:00100000:1.0:1746140882.692920:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4452351) req@ffff88012b183800 x1830960573573120/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140882.692923:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1750 00002000:00100000:1.0:1746140882.692926:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b183800 with x1830960573573120 ext(4194304->4452351) 00000100:00100000:2.0:1746140882.692929:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960573572096:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:1.0:1746140882.692930:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 7 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.692937:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 7 pid: 8458 timeout: 961 lvb_type: 0 00002000:00010000:1.0:1746140882.692947:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b183800 00000100:00100000:0.0:1746140882.692949:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1751 00000100:00100000:0.0:1746140882.692956:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573572992:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140882.692961:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1752 00000100:00100000:1.0:1746140882.692966:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573573120:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746140882.693210:0:9872:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.693218:0:9872:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.693235:0:9872:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.693242:0:9872:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.693247:0:9872:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.693252:0:9872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8d000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140882.693254:0:9872:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.693260:0:9872:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.693274:0:9872:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.693280:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8d000/0x8156357b7fdb939d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.693332:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573571584:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 6382us (6971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.693339:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16581 00000100:00100000:3.0:1746140882.693490:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573573376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 795us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.693497:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8579 00010000:00010000:3.0:1746140882.693529:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135fb8400/0x8156357b7fdb9270 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e1a expref: 8 pid: 4782 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.693537:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960575995776:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140882.693553:0:24958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693560:0:24958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693565:0:24958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693576:0:24958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693582:0:24958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693587:0:24958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693591:0:24958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fadd400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140882.693594:0:24958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693605:0:24958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693613:0:24958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.693618:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fadd400/0x8156357b7fdb93a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.693658:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573571456:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 6652us (7281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.693664:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16582 00000100:00100000:3.0:1746140882.695392:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960575996032:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140882.695410:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.695420:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdb938f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.695474:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573571200:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 8805us (9136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.695481:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16580 00000100:00100000:0.0:1746140882.696447:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.696762:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573573760 00000100:00100000:3.0:1746140882.696769:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573573760 00002000:00100000:3.0:1746140882.696800:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009b893100 x1830960573573760/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.696809:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893100 with x1830960573573760 ext(0->1048575) 00002000:00010000:3.0:1746140882.696814:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b893100 00000100:00100000:3.0:1746140882.696832:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8496 00000100:00100000:3.0:1746140882.696838:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960573573760:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.698020:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573573120:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5048us (5807us total) trans 21474841312 rc 0/0 00000100:00100000:1.0:1746140882.698029:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1752 00002000:00100000:1.0:1746140882.698036:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4452351) req@ffff88012b183800 x1830960573573120/t21474841312(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/448 e 0 to 0 dl 1746140893 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.698043:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b183800 with x1830960573573120 ext(4194304->4452351) 00010000:00010000:1.0:1746140882.698050:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 10 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.698062:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 10 pid: 8458 timeout: 961 lvb_type: 0 00002000:00010000:1.0:1746140882.698068:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b183800 00000100:00100000:0.0:1746140882.699533:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.699569:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573573888 00000100:00100000:3.0:1746140882.699577:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573573888 00010000:00010000:3.0:1746140882.699605:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 10 pid: 8458 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.699629:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8580 00000100:00100000:3.0:1746140882.699635:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1982:x1830960573573888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.699646:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.699663:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 10 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.699674:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 10 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.699694:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb92d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e60 expref: 10 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.699708:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.699709:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.699714:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.699727:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.699758:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.699783:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1982:x1830960573573888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 148us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.699788:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8580 00010000:00010000:0.0:1746140882.699885:0:8460:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.699895:0:8460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.699913:0:8460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.699921:0:8460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.699929:0:8460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.699944:0:8460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecb9000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140882.699948:0:8460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.699956:0:8460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.699966:0:8460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.699971:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb93b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140882.700027:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960573571712:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12658us (13114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.700035:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16584 00000100:00100000:2.0:1746140882.700732:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573572992:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7775us (8603us total) trans 17179874038 rc 0/0 00000100:00100000:2.0:1746140882.700740:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1751 00002000:00100000:2.0:1746140882.700748:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3903488->4194303) req@ffff88009b1b3100 x1830960573572992/t17179874038(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/448 e 0 to 0 dl 1746140893 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.700757:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b3100 with x1830960573572992 ext(3903488->4194303) 00010000:00010000:2.0:1746140882.700764:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.700775:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00002000:00010000:2.0:1746140882.700781:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b1b3100 00000100:00100000:1.0:1746140882.701205:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573572096:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8269us (9096us total) trans 17179874039 rc 0/0 00000100:00100000:1.0:1746140882.701216:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1750 00002000:00100000:1.0:1746140882.701225:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a7:0x0] (1462272->1794047) req@ffff88009b1b1f80 x1830960573572096/t17179874039(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/448 e 0 to 0 dl 1746140893 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.701235:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b1f80 with x1830960573572096 ext(1462272->1794047) 00010000:00010000:1.0:1746140882.701243:0:21640:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:1.0:1746140882.701255:0:21640:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 961 lvb_type: 0 00002000:00010000:1.0:1746140882.701262:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b1b1f80 00000100:00100000:0.0:1746140882.703887:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.703990:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573574016 00000100:00100000:3.0:1746140882.704000:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573574016 00010000:00010000:3.0:1746140882.704039:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.704068:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8581 00000100:00100000:3.0:1746140882.704076:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573574016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.704089:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.704113:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.704124:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.704158:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5228a00/0x8156357b7fdb92cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e59 expref: 8 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.704174:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.704177:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.704181:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.704190:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.704225:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.704278:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1983:x1830960573574016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 203us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.704285:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8581 00010000:00010000:2.0:1746140882.704328:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.704339:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.704359:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.704366:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.704378:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.704384:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5228200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140882.704388:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.704395:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.704407:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.704413:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5228200/0x8156357b7fdb93ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.704486:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+6:1985:x1830960573571840:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 17465us (18079us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.704494:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16583 00000100:00100000:0.0:1746140882.707161:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.707656:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573574144 00000100:00100000:2.0:1746140882.707665:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573574144 00010000:00010000:2.0:1746140882.707696:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.707724:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8582 00000100:00100000:2.0:1746140882.707730:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573574144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.707742:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.707763:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.707774:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.707795:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009252aa00/0x8156357b7fdb92b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1462272->1794047) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e44 expref: 22 pid: 8458 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.707809:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.707812:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.707816:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707824:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707847:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.707892:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573574144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 161us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.707899:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8582 00010000:00010000:2.0:1746140882.707920:0:4782:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707928:0:4782:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707946:0:4782:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707952:0:4782:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707959:0:4782:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707964:0:4782:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecb8800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140882.707968:0:4782:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707974:0:4782:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707986:0:4782:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.707992:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8800/0x8156357b7fdb9396 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.708034:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+5:1985:x1830960573571328:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 21372us (21754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.708041:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16579 00000100:00100000:3.0:1746140882.708878:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573573760:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12038us (12431us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.708887:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8496 00002000:00100000:3.0:1746140882.708898:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009b893100 x1830960573573760/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.708909:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893100 with x1830960573573760 ext(0->1048575) 00002000:00010000:3.0:1746140882.708913:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b893100 00000100:00100000:0.0:1746140882.709126:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.709196:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573574400 00000100:00100000:3.0:1746140882.709201:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573574400 00000100:00100000:3.0:1746140882.709236:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10640 00000100:00100000:3.0:1746140882.709241:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32498:x1830960573574400:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140882.709259:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.709279:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0200/0x8156357b7fdb93c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ebb expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.709397:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709409:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709417:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709428:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709433:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709439:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709544:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709552:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709559:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140882.709567:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140882.709646:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709652:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709658:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709666:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a1200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.709669:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709674:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709683:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.709685:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140882.709688:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709694:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1200/0x8156357b7fdb93d5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709704:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709708:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709712:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709716:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a0000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.709719:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709723:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709728:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140882.709730:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.709733:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709737:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0000/0x8156357b7fdb93c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709743:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709747:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709751:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709755:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a1600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.709756:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709760:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709764:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871e00) 00010000:00010000:3.0:1746140882.709765:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.709767:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709771:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1600/0x8156357b7fdb93ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.709801:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0200/0x8156357b7fdb93c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ebb expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.709807:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0200/0x8156357b7fdb93c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ebb expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.709814:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a0200, rc 0) 00000100:00100000:3.0:1746140882.709856:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32498:x1830960573574400:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 615us (730us total) trans 8589944915 rc 301/301 00000100:00100000:3.0:1746140882.709862:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10640 00000100:00100000:0.0:1746140882.709996:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.710043:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573574656 00000100:00100000:3.0:1746140882.710047:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573574656 00000100:00100000:3.0:1746140882.710292:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10641 00000100:00100000:3.0:1746140882.710298:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32491:x1830960573574656:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:3.0:1746140882.710336:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.710348:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d200/0x8156357b7fdb937a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ea6 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.710357:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.710360:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.710511:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32491:x1830960573574656:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 212us (515us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746140882.710517:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10641 00000100:00100000:0.0:1746140882.714206:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.714263:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.714338:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573575040 00000100:00100000:1.0:1746140882.714347:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573575040 00000100:00100000:2.0:1746140882.714372:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573574784 00000100:00100000:2.0:1746140882.714387:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573574784 00000100:00100000:1.0:1746140882.714393:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4646 00000100:00100000:1.0:1746140882.714399:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32491:x1830960573575040:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140882.714432:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16586 00000100:00100000:2.0:1746140882.714439:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32496:x1830960573574784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.714454:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.714473:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ec2 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140882.714496:0:4782:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed3, atime: 0x6813fed2, ctime: 0x6813fed3, blocks: 0x821 00010000:00010000:2.0:1746140882.714514:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.714517:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.714524:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 8 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.714538:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 8 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.714552:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfd4200, rc 0) 00000100:00100000:2.0:1746140882.714600:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32496:x1830960573574784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 161us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.714604:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:32491:x1830960573575040:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 205us (340us total) trans 8589944916 rc 0/0 00000100:00100000:2.0:1746140882.714606:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16586 00000100:00100000:1.0:1746140882.714610:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4646 00000100:00100000:0.0:1746140882.716261:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.716358:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573575296 00000100:00100000:2.0:1746140882.716369:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573575296 00000100:00100000:2.0:1746140882.716412:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4647 00000100:00100000:2.0:1746140882.716417:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a97bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:32491:x1830960573575296:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140882.716559:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a97bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:32491:x1830960573575296:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 141us (302us total) trans 8589944917 rc 0/0 00000100:00100000:2.0:1746140882.716566:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4647 00000100:00100000:0.0:1746140882.722056:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.722160:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573575552 00000100:00100000:3.0:1746140882.722171:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573575552 00002000:00100000:3.0:1746140882.722214:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88008f07a680 x1830960573575552/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.722224:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07a680 with x1830960573575552 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.722234:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07a680 00000100:00100000:3.0:1746140882.722264:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8497 00000100:00100000:3.0:1746140882.722271:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960573575552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.735041:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960573575552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12758us (12983us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.735053:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8497 00002000:00100000:3.0:1746140882.735065:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88008f07a680 x1830960573575552/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.735074:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07a680 with x1830960573575552 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.735080:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07a680 00000100:00100000:0.0:1746140882.744978:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.745068:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573575680 00000100:00100000:2.0:1746140882.745077:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573575680 00000100:00100000:2.0:1746140882.745185:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16587 00000100:00100000:2.0:1746140882.745194:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32496:x1830960573575680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.745211:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.745230:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ec9 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140882.745252:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fed3, atime: 0x6813fed2, ctime: 0x6813fed3, blocks: 0x821 00010000:00010000:2.0:1746140882.745270:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.745272:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.745278:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.745297:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.745329:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfd5400, rc 0) 00000100:00100000:2.0:1746140882.745383:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32496:x1830960573575680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 190us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.745389:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16587 00000100:00100000:0.0:1746140882.746522:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.746916:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573575936 00000100:00100000:3.0:1746140882.746927:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573575936 00000100:00100000:3.0:1746140882.746992:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10642 00000100:00100000:3.0:1746140882.746999:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32502:x1830960573575936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140882.747019:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140882.747037:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1000/0x8156357b7fdb93f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ed0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.747156:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747167:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747177:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747189:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747194:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747201:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747297:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747329:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747335:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140882.747342:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140882.747419:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747424:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747429:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747434:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a0400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.747437:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747443:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747451:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140882.747453:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.747457:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747464:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0400/0x8156357b7fdb93f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747493:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747498:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747501:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747505:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a0800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140882.747507:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747511:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747516:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871200) 00010000:00010000:3.0:1746140882.747517:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140882.747519:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747523:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0800/0x8156357b7fdb93ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140882.747557:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1000/0x8156357b7fdb93f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 275 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.747567:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 274 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.747577:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140882.747579:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140882.747581:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a0a00, rc 0) 00000100:00100000:3.0:1746140882.747642:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32502:x1830960573575936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 643us (1121us total) trans 8589944918 rc 0/0 00000100:00100000:3.0:1746140882.747648:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10642 00000100:00100000:0.0:1746140882.749013:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.749099:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573576192 00000100:00100000:3.0:1746140882.749106:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573576192 00002000:00100000:3.0:1746140882.749150:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f173b80 x1830960573576192/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.749161:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173b80 with x1830960573576192 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.749166:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f173b80 00000100:00100000:3.0:1746140882.749762:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8498 00000100:00100000:3.0:1746140882.749770:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1982:x1830960573576192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140882.749795:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.749822:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573576320 00000100:00100000:0.0:1746140882.749828:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573576320 00000100:00100000:0.0:1746140882.750449:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16588 00000100:00100000:0.0:1746140882.750458:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+10:1983:x1830960573576320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140882.750472:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140882.750487:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ed7 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.750497:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140882.750508:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140882.750514:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.750530:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.750539:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.750551:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573576576 00000100:00100000:1.0:1746140882.750554:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573576576 00000100:00100000:1.0:1746140882.750572:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573576832 00000100:00100000:1.0:1746140882.750574:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573576832 00000100:00100000:1.0:1746140882.750583:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573576448 00000100:00100000:1.0:1746140882.750585:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573576448 00000100:00100000:1.0:1746140882.750593:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573576704 00000100:00100000:1.0:1746140882.750595:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573576704 00000100:00100000:1.0:1746140882.750606:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16589 00010000:00010000:0.0:1746140882.750606:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140882.750611:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573576576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140882.750615:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 13 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.750619:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140882.750630:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 13 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.750638:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ee5 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.750640:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a815c00, rc 0) 00010000:00010000:1.0:1746140882.750655:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.750657:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.750663:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 23 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.750680:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 23 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140882.750680:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1983:x1830960573576320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 224us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.750686:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16588 00010000:00010000:1.0:1746140882.750688:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4ce00, rc 0) 00000100:00100000:0.0:1746140882.750701:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16590 00000100:00100000:0.0:1746140882.750706:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1983:x1830960573576832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140882.750712:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140882.750716:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1983:x1830960573576576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (220us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140882.750720:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ef3 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.750722:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16589 00000100:00100000:1.0:1746140882.750734:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16591 00000100:00100000:1.0:1746140882.750738:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573576448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.750742:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746140882.750744:0:4782:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fed3, atime: 0x6813fed2, ctime: 0x6813fed3, blocks: 0x1589 00010000:00010000:1.0:1746140882.750747:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ede expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.750753:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.750754:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.750755:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.750756:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.750758:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 13 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.750760:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 23 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.750767:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 23 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140882.750767:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 13 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.750772:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4da00, rc 0) 00010000:00010000:0.0:1746140882.750774:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a815600, rc 0) 00000100:00100000:1.0:1746140882.750783:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1983:x1830960573576448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 45us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.750787:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16591 00000100:00100000:0.0:1746140882.750790:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1983:x1830960573576832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.750795:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16592 00000100:00100000:1.0:1746140882.750799:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1983:x1830960573576704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.750804:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.750811:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0eec expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140882.750825:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed2, atime: 0x6813fed2, ctime: 0x6813fed2, blocks: 0x821 00010000:00010000:1.0:1746140882.750833:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.750834:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.750837:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 14 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.750844:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 14 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.750849:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d400, rc 0) 00000100:00100000:1.0:1746140882.750861:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1983:x1830960573576704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 62us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.750881:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16590 00000100:00100000:0.0:1746140882.751161:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.751179:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573576960 00000100:00100000:0.0:1746140882.751182:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573576960 00000100:00100000:0.0:1746140882.751199:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16593 00000100:00100000:0.0:1746140882.751203:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1983:x1830960573576960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140882.751210:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140882.751219:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0efa expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140882.751235:0:8458:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fed3, atime: 0x6813fed2, ctime: 0x6813fed3, blocks: 0x1029 00010000:00010000:0.0:1746140882.751242:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.751244:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140882.751249:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 24 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140882.751258:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 24 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140882.751264:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb8400, rc 0) 00000100:00100000:0.0:1746140882.751280:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1983:x1830960573576960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140882.751285:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16593 00000100:00100000:1.0:1746140882.751547:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16592 00000100:00100000:0.0:1746140882.752235:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.752549:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573577088 00000100:00100000:1.0:1746140882.752559:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573577088 00000100:00100000:1.0:1746140882.752641:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16594 00000100:00100000:1.0:1746140882.752647:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32498:x1830960573577088:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140882.752658:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.752670:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f01 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.752692:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 12 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.752698:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.752700:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.752703:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3325952->3883007] (req 3325952->3883007) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 9 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.752739:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 12 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.752750:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 12 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.752760:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575996160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.752828:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.757461:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.757634:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573577216 00000100:00100000:2.0:1746140882.757645:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573577216 00010000:00010000:2.0:1746140882.757682:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 13 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:2.0:1746140882.757718:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8583 00000100:00100000:2.0:1746140882.757725:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1985:x1830960573577216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.757739:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.757760:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 13 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.757771:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 13 pid: 4782 timeout: 961 lvb_type: 1 00010000:00010000:2.0:1746140882.757792:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.757794:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.757800:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 9 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.757812:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 9 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.757839:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 9 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.757849:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575996288:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140882.757919:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800930ef600 going to sleep for 11 seconds 00010000:00010000:1.0:1746140882.758103:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a815600/0x8156357b7fdb9422 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ef3 expref: 13 pid: 4782 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.758147:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575996160:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.758169:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 9 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.758182:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4c400, rc 0) 00000100:00100000:1.0:1746140882.758224:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32498:x1830960573577088:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5577us (5991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.758233:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16594 00000100:00100000:2.0:1746140882.761300:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575996288:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140882.761335:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.761371:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1985:x1830960573577216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3646us (3922us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.761380:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8583 00000100:00100000:1.0:1746140882.761780:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.761805:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573577472 00000100:00100000:1.0:1746140882.761813:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573577472 00002000:00100000:1.0:1746140882.761845:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3325952->3330047) req@ffff8800a6baf800 x1830960573577472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.761855:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baf800 with x1830960573577472 ext(3325952->3330047) 00002000:00010000:1.0:1746140882.761859:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baf800 00000100:00100000:1.0:1746140882.761886:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8499 00000100:00100000:1.0:1746140882.761893:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573577472:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140882.762034:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573577472:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 137us (256us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140882.762035:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1982:x1830960573576192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12265us (13052us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140882.762040:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8499 00000100:00100000:3.0:1746140882.762043:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8498 00002000:00100000:1.0:1746140882.762045:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3325952->3330047) req@ffff8800a6baf800 x1830960573577472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.762049:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f173b80 x1830960573576192/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.762053:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baf800 with x1830960573577472 ext(3325952->3330047) 00002000:00010000:1.0:1746140882.762055:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baf800 00002000:00100000:3.0:1746140882.762056:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173b80 with x1830960573576192 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.762059:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f173b80 00000100:00100000:0.0:1746140882.766243:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.766283:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.766337:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.766352:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573577600 00000100:00100000:0.0:1746140882.766356:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.766364:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573577600 00000100:00100000:3.0:1746140882.766403:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573577856 00000100:00100000:3.0:1746140882.766408:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573577856 00000100:00100000:1.0:1746140882.766415:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16595 00000100:00100000:1.0:1746140882.766422:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32496:x1830960573577600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.766433:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746140882.766436:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f172680 x1830960573577856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.766445:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f172680 with x1830960573577856 ext(0->1048575) 00010000:00010000:1.0:1746140882.766449:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f08 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140882.766450:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f172680 00000100:00100000:3.0:1746140882.766472:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573578112 00010000:00010000:1.0:1746140882.766474:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140882.766475:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573578112 00010000:00010000:1.0:1746140882.766475:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.766482:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 10 pid: 4784 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140882.766487:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f172300 x1830960573578112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.766493:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f172300 with x1830960573578112 ext(1048576->2097151) 00010000:00010000:1.0:1746140882.766494:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 10 pid: 4784 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140882.766497:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f172300 00010000:00010000:1.0:1746140882.766503:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a0c600, rc 0) 00000100:00100000:3.0:1746140882.766506:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573578240 00000100:00100000:3.0:1746140882.766508:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573578240 00002000:00100000:3.0:1746140882.766517:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f171880 x1830960573578240/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.766523:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171880 with x1830960573578240 ext(1048576->2097151) 00002000:00010000:3.0:1746140882.766525:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f171880 00000100:00100000:0.0:1746140882.766536:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.766537:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8500 00000100:00100000:3.0:1746140882.766542:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1982:x1830960573577856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.766561:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32496:x1830960573577600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 139us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.766566:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16595 00000100:00100000:0.0:1746140882.766569:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573578624 00000100:00100000:0.0:1746140882.766576:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573578624 00000100:00100000:1.0:1746140882.766587:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8501 00000100:00100000:1.0:1746140882.766592:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573578112:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:0.0:1746140882.766612:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f170e00 x1830960573578624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.766620:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170e00 with x1830960573578624 ext(1048576->2097151) 00002000:00010000:0.0:1746140882.766625:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f170e00 00000100:00100000:0.0:1746140882.766642:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8502 00000100:00100000:2.0:1746140882.766648:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8503 00000100:00100000:0.0:1746140882.766650:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573578240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.766654:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1982:x1830960573578624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.769435:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.769749:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573578880 00000100:00100000:3.0:1746140882.769757:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573578880 00002000:00100000:3.0:1746140882.769794:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (3878912->3883007) req@ffff8800a6baf100 x1830960573578880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.769803:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baf100 with x1830960573578880 ext(3878912->3883007) 00002000:00010000:3.0:1746140882.769809:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baf100 00000100:00100000:3.0:1746140882.769839:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8504 00000100:00100000:3.0:1746140882.769847:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573578880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140882.769967:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573578880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 120us (537us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140882.769973:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8504 00002000:00100000:3.0:1746140882.769978:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3878912->3883007) req@ffff8800a6baf100 x1830960573578880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.769990:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baf100 with x1830960573578880 ext(3878912->3883007) 00002000:00010000:3.0:1746140882.769993:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baf100 00000100:00100000:0.0:1746140882.776038:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.776299:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573579136 00000100:00100000:2.0:1746140882.776346:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573579136 00002000:00100000:2.0:1746140882.776393:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880093132d80 x1830960573579136/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.776402:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093132d80 with x1830960573579136 ext(1048576->2097151) 00002000:00010000:2.0:1746140882.776408:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093132d80 00000100:00100000:2.0:1746140882.776447:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8505 00000100:00100000:2.0:1746140882.776455:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573579136:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140882.778381:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573577856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11831us (12090us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.778391:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8500 00002000:00100000:3.0:1746140882.778399:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f172680 x1830960573577856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.778734:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f172680 with x1830960573577856 ext(0->1048575) 00002000:00010000:3.0:1746140882.778739:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f172680 00000100:00100000:0.0:1746140882.785623:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.786891:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573578112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20293us (20548us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140882.786901:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8501 00002000:00100000:1.0:1746140882.786913:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f172300 x1830960573578112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.786922:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f172300 with x1830960573578112 ext(1048576->2097151) 00002000:00010000:1.0:1746140882.786928:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f172300 00000100:00100000:2.0:1746140882.787021:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573579392 00000100:00100000:2.0:1746140882.787028:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573579392 00000100:00100000:2.0:1746140882.787077:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4648 00000100:00100000:2.0:1746140882.787084:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32498:x1830960573579392:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140882.787273:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32498:x1830960573579392:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 189us (1660us total) trans 8589944919 rc 0/0 00000100:00100000:2.0:1746140882.787278:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4648 00000100:00100000:2.0:1746140882.788926:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1982:x1830960573578624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22267us (22385us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140882.788936:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8503 00002000:00100000:2.0:1746140882.788945:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f170e00 x1830960573578624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.788954:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170e00 with x1830960573578624 ext(1048576->2097151) 00002000:00010000:2.0:1746140882.788959:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f170e00 00000100:00100000:0.0:1746140882.793847:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1982:x1830960573578240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27182us (27474us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140882.793859:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8502 00002000:00100000:0.0:1746140882.794024:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f171880 x1830960573578240/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.794035:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171880 with x1830960573578240 ext(1048576->2097151) 00002000:00010000:0.0:1746140882.794042:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f171880 00000100:00100000:2.0:1746140882.795442:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573579136:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 18985us (19408us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140882.795451:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8505 00002000:00100000:2.0:1746140882.795458:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880093132d80 x1830960573579136/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.795465:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093132d80 with x1830960573579136 ext(1048576->2097151) 00002000:00010000:2.0:1746140882.795469:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093132d80 00000100:00100000:0.0:1746140882.798201:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.798575:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573579520 00000100:00100000:1.0:1746140882.798583:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573579520 00000100:00100000:1.0:1746140882.799101:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16596 00000100:00100000:1.0:1746140882.799110:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:32495:x1830960573579520:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140882.799127:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.799155:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f0f expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.799183:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 25 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.799190:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.799192:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140882.799195:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 25 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.799224:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 25 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.799234:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 25 pid: 8458 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.799246:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575996416:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.800145:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1600 going to sleep for 11 seconds 00000100:00100000:3.0:1746140882.800406:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.800696:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573579648 00000100:00100000:0.0:1746140882.800703:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573579648 00000100:00100000:0.0:1746140882.800747:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16597 00000100:00100000:0.0:1746140882.800752:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:32502:x1830960573579648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140882.800764:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140882.800778:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f16 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.800799:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 9 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.800804:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.800806:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140882.800808:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.800829:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 9 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140882.800842:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 9 pid: 4784 timeout: 961 lvb_type: 0 00000100:00100000:0.0:1746140882.800851:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960575996544:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140882.800897:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.801204:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.801236:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573579904 00000100:00100000:2.0:1746140882.801239:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573579904 00002000:00100000:2.0:1746140882.801266:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880093131180 x1830960573579904/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.801275:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131180 with x1830960573579904 ext(2097152->3145727) 00010000:00010000:2.0:1746140882.801281:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 10 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.801289:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 10 pid: 4784 timeout: 961 lvb_type: 0 00002000:00010000:2.0:1746140882.801295:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093131180 00000100:00100000:2.0:1746140882.801337:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1753 00000100:00100000:2.0:1746140882.801343:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573579904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140882.803298:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.803360:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.803362:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573580160 00000100:00100000:3.0:1746140882.803370:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573580160 00000100:00100000:0.0:1746140882.803378:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573580032 00000100:00100000:0.0:1746140882.803381:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573580032 00010000:00010000:3.0:1746140882.803399:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 26 pid: 8458 timeout: 961 lvb_type: 1 00002000:00100000:0.0:1746140882.803405:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3325952->3883007) req@ffff880093133b80 x1830960573580032/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.803414:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093133b80 with x1830960573580032 ext(3325952->3883007) 00010000:00010000:0.0:1746140882.803421:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 11 pid: 4784 timeout: 961 lvb_type: 0 00000100:00100000:3.0:1746140882.803422:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8584 00000100:00100000:3.0:1746140882.803428:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573580160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140882.803430:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 11 pid: 4784 timeout: 961 lvb_type: 0 00002000:00010000:0.0:1746140882.803436:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093133b80 00010000:00010000:3.0:1746140882.803438:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140882.803450:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1754 00000100:00100000:0.0:1746140882.803456:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573580032:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746140882.803458:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 26 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.803469:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 26 pid: 8458 timeout: 961 lvb_type: 1 00010000:00010000:3.0:1746140882.803490:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.803492:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.803497:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.803506:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.803536:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.803547:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575996672:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140882.803613:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.803799:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960575996544:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.803823:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.803834:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb8600, rc 0) 00000100:00100000:1.0:1746140882.803864:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:32502:x1830960573579648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3111us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.803871:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16597 00010000:00010000:1.0:1746140882.803906:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ecb8400/0x8156357b7fdb9437 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0efa expref: 26 pid: 8458 timeout: 961 lvb_type: 1 00000100:00100000:1.0:1746140882.803921:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960575996416:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.803935:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 25 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.803942:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c3e000, rc 0) 00000100:00100000:1.0:1746140882.803958:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:32495:x1830960573579520:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4851us (5767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.803963:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16596 00000100:00100000:3.0:1746140882.806582:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575996672:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140882.806605:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.806630:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573580160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3200us (3339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.806641:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8584 00000100:00100000:2.0:1746140882.806775:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.807166:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573580416 00000100:00100000:3.0:1746140882.807172:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573580416 00002000:00100000:3.0:1746140882.807204:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3055616->3059711) req@ffff88012b06b100 x1830960573580416/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.807217:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06b100 with x1830960573580416 ext(3055616->3059711) 00002000:00010000:3.0:1746140882.807221:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b06b100 00000100:00100000:3.0:1746140882.807246:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8506 00000100:00100000:3.0:1746140882.807252:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573580416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.807419:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573580416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 166us (645us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140882.807425:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8506 00002000:00100000:3.0:1746140882.807430:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3055616->3059711) req@ffff88012b06b100 x1830960573580416/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.807437:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06b100 with x1830960573580416 ext(3055616->3059711) 00002000:00010000:3.0:1746140882.807440:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b06b100 00000100:00100000:3.0:1746140882.810928:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573580032:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7461us (7556us total) trans 21474841313 rc 0/0 00000100:00100000:3.0:1746140882.810942:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1754 00002000:00100000:3.0:1746140882.810953:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3325952->3883007) req@ffff880093133b80 x1830960573580032/t21474841313(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/448 e 0 to 0 dl 1746140893 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.810963:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093133b80 with x1830960573580032 ext(3325952->3883007) 00010000:00010000:3.0:1746140882.810972:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 14 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.810987:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 14 pid: 4784 timeout: 961 lvb_type: 0 00002000:00010000:3.0:1746140882.810999:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093133b80 00000100:00100000:2.0:1746140882.811249:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573579904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9904us (10043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140882.811257:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1753 00002000:00100000:2.0:1746140882.811263:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880093131180 x1830960573579904/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.811270:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131180 with x1830960573579904 ext(2097152->3145727) 00010000:00010000:2.0:1746140882.811275:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 12 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.811285:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 12 pid: 4784 timeout: 961 lvb_type: 0 00002000:00010000:2.0:1746140882.811291:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093131180 00000100:00100000:0.0:1746140882.811469:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.811620:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573580544 00000100:00100000:1.0:1746140882.811628:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573580544 00000100:00100000:1.0:1746140882.812031:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16598 00000100:00100000:1.0:1746140882.812039:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:32495:x1830960573580544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140882.812053:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.812067:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f1d expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.812091:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.812093:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.812097:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->3977215] (req 3145728->3977215) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 14 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.812113:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->3977215] (req 3145728->3977215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 14 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.812124:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363f3e00, rc 0) 00000100:00100000:1.0:1746140882.812171:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:32495:x1830960573580544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 133us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.812177:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16598 00000100:00100000:0.0:1746140882.814687:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.814822:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573580672 00000100:00100000:2.0:1746140882.814831:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573580672 00000100:00100000:2.0:1746140882.814883:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16599 00000100:00100000:2.0:1746140882.814890:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32496:x1830960573580672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.814914:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.814930:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f24 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.814960:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 23 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.814968:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140882.814969:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140882.814973:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 10 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.815001:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 23 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.815012:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 23 pid: 4784 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.815025:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575996800:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140882.815117:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800930ef600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.815300:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.815589:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573580800 00000100:00100000:2.0:1746140882.815592:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573580800 00010000:00010000:2.0:1746140882.815613:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 12 pid: 4784 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.815647:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8585 00000100:00100000:2.0:1746140882.815653:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573580800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.815662:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.815683:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 12 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.815692:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 12 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.815708:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdb943e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3325952->3883007) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f01 expref: 12 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.815722:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.815724:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.815729:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.815736:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.815742:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.815743:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.815746:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 13 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.815752:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 13 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.815774:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 13 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.815782:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575996928:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140882.815831:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.815838:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575997056:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140882.815853:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac9c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746140882.816599:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960575996800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140882.816619:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 10 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.816631:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0ca2200, rc 0) 00000100:00100000:2.0:1746140882.816668:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32496:x1830960573580672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1777us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.816675:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16599 00000100:00100000:2.0:1746140882.817135:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575996928:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140882.817155:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575997056:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140882.817168:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.817188:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573580800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1535us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.817195:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8585 00000100:00100000:0.0:1746140882.817520:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.817703:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573580928 00000100:00100000:2.0:1746140882.817708:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573580928 00002000:00100000:2.0:1746140882.817733:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3055616->3145727) req@ffff880093131f80 x1830960573580928/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.817742:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131f80 with x1830960573580928 ext(3055616->3145727) 00010000:00010000:2.0:1746140882.817749:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 24 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.817761:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 24 pid: 4784 timeout: 961 lvb_type: 0 00002000:00010000:2.0:1746140882.817767:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093131f80 00000100:00100000:2.0:1746140882.817787:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1755 00000100:00100000:2.0:1746140882.817793:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573580928:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140882.819813:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.820809:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573581184 00000100:00100000:3.0:1746140882.820818:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573581184 00002000:00100000:3.0:1746140882.820853:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009edc8000 x1830960573581184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.820863:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8000 with x1830960573581184 ext(2097152->3145727) 00002000:00010000:3.0:1746140882.820868:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8000 00000100:00100000:3.0:1746140882.820888:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8507 00000100:00100000:3.0:1746140882.820895:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573581184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.821839:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573580928:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4040us (4314us total) trans 17179874040 rc 0/0 00000100:00100000:2.0:1746140882.821848:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1755 00002000:00100000:2.0:1746140882.821856:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3055616->3145727) req@ffff880093131f80 x1830960573580928/t17179874040(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/448 e 0 to 0 dl 1746140893 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.821864:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131f80 with x1830960573580928 ext(3055616->3145727) 00010000:00010000:2.0:1746140882.821872:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.821885:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 961 lvb_type: 0 00002000:00010000:2.0:1746140882.821896:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093131f80 00000100:00100000:0.0:1746140882.825466:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.825564:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573581440 00000100:00100000:2.0:1746140882.825573:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573581440 00002000:00100000:2.0:1746140882.825617:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3973120->3977215) req@ffff88009edcad80 x1830960573581440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.825628:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830960573581440 ext(3973120->3977215) 00002000:00010000:2.0:1746140882.825633:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcad80 00000100:00100000:2.0:1746140882.825661:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8508 00000100:00100000:2.0:1746140882.825668:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573581440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.825898:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573581440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 231us (443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140882.825905:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8508 00002000:00100000:2.0:1746140882.825912:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3973120->3977215) req@ffff88009edcad80 x1830960573581440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.825919:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcad80 with x1830960573581440 ext(3973120->3977215) 00002000:00010000:2.0:1746140882.825922:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edcad80 00000100:00100000:1.0:1746140882.826297:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.826618:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573581568 00000100:00100000:2.0:1746140882.826622:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573581568 00010000:00010000:2.0:1746140882.826645:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.826684:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8586 00000100:00100000:2.0:1746140882.826689:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573581568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.826702:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.826721:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.826732:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.826754:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c3e000/0x8156357b7fdb944c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f0f expref: 26 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.826782:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.826784:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.826790:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 9 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.826800:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 9 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.826830:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 9 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.826842:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575997184:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140882.826912:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800930ef600 going to sleep for 11 seconds 00000100:00100000:3.0:1746140882.827949:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573581184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7051us (8142us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.827958:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8507 00002000:00100000:3.0:1746140882.827965:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009edc8000 x1830960573581184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.827974:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8000 with x1830960573581184 ext(2097152->3145727) 00002000:00010000:3.0:1746140882.827979:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8000 00000100:00100000:0.0:1746140882.828454:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.828810:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573581824 00000100:00100000:3.0:1746140882.828816:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573581824 00000100:00100000:3.0:1746140882.828859:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4649 00000100:00100000:3.0:1746140882.828865:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32495:x1830960573581824:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140882.829058:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32495:x1830960573581824:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 193us (606us total) trans 8589944920 rc 0/0 00000100:00100000:3.0:1746140882.829065:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4649 00000100:00100000:2.0:1746140882.830293:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960575997184:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140882.830339:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.830387:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573581568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3696us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.830397:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8586 00000100:00100000:2.0:1746140882.830793:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.830843:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573582080 00000100:00100000:3.0:1746140882.830849:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573582080 00002000:00100000:3.0:1746140882.830880:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b068700 x1830960573582080/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.830889:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068700 with x1830960573582080 ext(2097152->3145727) 00002000:00010000:3.0:1746140882.830894:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b068700 00000100:00100000:3.0:1746140882.830914:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8509 00000100:00100000:3.0:1746140882.830919:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573582080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140882.831159:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.831412:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573582208 00000100:00100000:2.0:1746140882.831416:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573582208 00000100:00100000:2.0:1746140882.831588:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16600 00000100:00100000:2.0:1746140882.831594:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:32502:x1830960573582208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140882.831604:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140882.831621:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f2b expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.831642:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.831643:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.831650:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 26 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.831664:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 26 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.831674:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4bb3000, rc 0) 00000100:00100000:2.0:1746140882.831710:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:32502:x1830960573582208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 116us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.831715:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16600 00000100:00100000:0.0:1746140882.839369:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.839404:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.839440:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.839488:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573582464 00000100:00100000:1.0:1746140882.839497:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573582464 00002000:00100000:1.0:1746140882.839538:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009edcb480 x1830960573582464/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.839549:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb480 with x1830960573582464 ext(2097152->3145727) 00002000:00010000:1.0:1746140882.839554:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcb480 00000100:00100000:1.0:1746140882.839568:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573582720 00000100:00100000:1.0:1746140882.839570:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573582720 00002000:00100000:1.0:1746140882.839577:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009edcb100 x1830960573582720/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.839583:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb100 with x1830960573582720 ext(3145728->4194303) 00002000:00010000:1.0:1746140882.839585:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcb100 00000100:00100000:3.0:1746140882.839589:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573582976 00000100:00100000:3.0:1746140882.839593:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573582976 00000100:00100000:1.0:1746140882.839595:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8510 00000100:00100000:1.0:1746140882.839600:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573582464:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140882.839613:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3977216->4194303) req@ffff88009edc8380 x1830960573582976/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.839622:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8380 with x1830960573582976 ext(3977216->4194303) 00002000:00010000:3.0:1746140882.839625:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8380 00000100:00100000:3.0:1746140882.839638:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8511 00000100:00100000:3.0:1746140882.839643:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573582720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140882.842349:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8512 00000100:00100000:2.0:1746140882.842364:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1983:x1830960573582976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.846218:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573582080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15285us (15413us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.846230:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8509 00002000:00100000:3.0:1746140882.846242:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b068700 x1830960573582080/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.846252:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068700 with x1830960573582080 ext(2097152->3145727) 00002000:00010000:3.0:1746140882.846258:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b068700 00000100:00100000:1.0:1746140882.854969:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1983:x1830960573582464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15357us (15598us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140882.854984:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8510 00002000:00100000:1.0:1746140882.854998:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009edcb480 x1830960573582464/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.855008:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb480 with x1830960573582464 ext(2097152->3145727) 00002000:00010000:1.0:1746140882.855014:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcb480 00000100:00100000:2.0:1746140882.856393:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1983:x1830960573582976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14027us (16945us total) trans 0 rc 217088/217088 00000100:00100000:2.0:1746140882.856406:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8512 00002000:00100000:2.0:1746140882.856414:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3977216->4194303) req@ffff88009edc8380 x1830960573582976/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 217088/217088 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.856422:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8380 with x1830960573582976 ext(3977216->4194303) 00002000:00010000:2.0:1746140882.856427:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8380 00000100:00100000:2.0:1746140882.857215:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.857267:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573583104 00000100:00100000:1.0:1746140882.857276:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573583104 00000100:00100000:1.0:1746140882.857327:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16601 00000100:00100000:1.0:1746140882.857333:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32496:x1830960573583104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.857346:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.857364:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f32 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.857392:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 13 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.857400:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746140882.857926:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573582720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18281us (18520us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140882.857935:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8511 00002000:00100000:3.0:1746140882.857942:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009edcb100 x1830960573582720/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.857950:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edcb100 with x1830960573582720 ext(3145728->4194303) 00002000:00010000:3.0:1746140882.857954:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edcb100 00010000:00010000:1.0:1746140882.866950:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.866963:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 12 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.867009:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 13 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.867025:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 13 pid: 4784 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.867045:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575997312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.867126:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.868276:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575997312:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.868299:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 12 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.868426:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013733b000, rc 0) 00000100:00100000:1.0:1746140882.868466:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32496:x1830960573583104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 11133us (11253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.868476:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16601 00000100:00100000:0.0:1746140882.872621:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.872863:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.872935:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573583360 00000100:00100000:1.0:1746140882.872944:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573583360 00000100:00100000:1.0:1746140882.872993:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16602 00000100:00100000:1.0:1746140882.873000:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573583360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.873017:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.873035:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013733b200/0x8156357b7fdb9476 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f39 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140882.873099:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575997440:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140882.873117:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573583232 00000100:00100000:3.0:1746140882.873122:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573583232 00002000:00100000:3.0:1746140882.873161:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->3977215) req@ffff88009edc8e00 x1830960573583232/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.873171:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8e00 with x1830960573583232 ext(3145728->3977215) 00010000:00010000:3.0:1746140882.873178:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 16 pid: 4784 timeout: 961 lvb_type: 0 00000100:00100000:1.0:1746140882.873182:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1600 going to sleep for 11 seconds 00010000:00010000:3.0:1746140882.873191:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 16 pid: 4784 timeout: 961 lvb_type: 0 00002000:00010000:3.0:1746140882.873198:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edc8e00 00000100:00100000:3.0:1746140882.873214:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1756 00000100:00100000:3.0:1746140882.873219:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573583232:12345-192.168.204.16@tcp:4:cat.0 00002000:00010000:1.0:1746140882.874247:0:4784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140882 -> 1746140883 00000100:00100000:1.0:1746140882.874263:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575997440:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140882.874286:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013733b200/0x8156357b7fdb9476 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f39 expref: 17 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.874298:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013733b200/0x8156357b7fdb9476 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f39 expref: 17 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140882.874346:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013733b200, rc 0) 00000100:00100000:1.0:1746140882.874384:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573583360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1384us (1520us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140882.874391:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16602 00000100:00100000:0.0:1746140882.877447:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.877527:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573583488 00000100:00100000:1.0:1746140882.877536:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573583488 00000100:00100000:1.0:1746140882.877587:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16603 00000100:00100000:1.0:1746140882.877594:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:32502:x1830960573583488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140882.877611:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.877626:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f40 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.877651:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.877654:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.877657:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4886527] (req 4194304->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.877668:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4886527] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.877678:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013733be00, rc 0) 00000100:00100000:1.0:1746140882.877728:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:32502:x1830960573583488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 134us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.877737:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16603 00000100:00100000:3.0:1746140882.884838:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960573583232:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11606us (12217us total) trans 21474841314 rc 0/0 00000100:00100000:3.0:1746140882.884851:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1756 00002000:00100000:3.0:1746140882.884865:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->3977215) req@ffff88009edc8e00 x1830960573583232/t21474841314(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/448 e 0 to 0 dl 1746140893 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.884881:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8e00 with x1830960573583232 ext(3145728->3977215) 00010000:00010000:3.0:1746140882.884891:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 17 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:3.0:1746140882.884908:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 17 pid: 4784 timeout: 961 lvb_type: 0 00002000:00010000:3.0:1746140882.884915:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009edc8e00 00000100:00100000:0.0:1746140882.891061:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.891184:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573583616 00000100:00100000:2.0:1746140882.891193:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573583616 00010000:00010000:2.0:1746140882.891231:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 17 pid: 4784 timeout: 961 lvb_type: 0 00000100:00100000:2.0:1746140882.891411:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8587 00000100:00100000:2.0:1746140882.891418:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960573583616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.891432:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.891453:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 17 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.891464:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 17 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.891484:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363f3e00/0x8156357b7fdb945a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3977215) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f1d expref: 17 pid: 4784 timeout: 961 lvb_type: 0 00010000:00010000:2.0:1746140882.891971:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.891973:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.891980:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 11 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.891989:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 11 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.891996:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.891997:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140882.892000:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.892006:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140882.892034:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.892044:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575997568:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140882.892165:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 11 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140882.892173:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575997696:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140882.892191:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800930ef600 going to sleep for 11 seconds 00000100:00100000:2.0:1746140882.893599:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575997568:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140882.893609:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960575997696:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140882.893622:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.893651:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573583616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2232us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.893659:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8587 00000100:00100000:0.0:1746140882.898898:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.898952:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.899012:0:14739:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573583872 00000100:00100000:1.0:1746140882.899023:0:14739:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573583872 00000100:00100000:3.0:1746140882.899028:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573584000 00000100:00100000:3.0:1746140882.899032:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573584000 00002000:00100000:3.0:1746140882.899063:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f2c1880 x1830960573584000/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.899072:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1880 with x1830960573584000 ext(4194304->4886527) 00000100:00100000:1.0:1746140882.899076:0:14739:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 218 00002000:00010000:3.0:1746140882.899077:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1880 00000100:00100000:1.0:1746140882.899083:0:14739:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d247991d-e844-4b62-b954-6487bd25e6e9+15:1985:x1830960573583872:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1746140882.899089:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8513 00000100:00100000:3.0:1746140882.899093:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573584000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.899160:0:14739:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d247991d-e844-4b62-b954-6487bd25e6e9+15:1985:x1830960573583872:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.899166:0:14739:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 218 00000100:00100000:0.0:1746140882.903148:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.903221:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.903366:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573584384 00000100:00100000:1.0:1746140882.903376:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573584384 00002000:00100000:1.0:1746140882.903417:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f2c2d80 x1830960573584384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.903426:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2d80 with x1830960573584384 ext(3145728->4194303) 00002000:00010000:1.0:1746140882.903431:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c2d80 00000100:00100000:1.0:1746140882.903462:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573584512 00000100:00100000:1.0:1746140882.903464:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573584512 00002000:00100000:1.0:1746140882.903476:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b069c00 x1830960573584512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.903482:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069c00 with x1830960573584512 ext(3145728->4194303) 00002000:00010000:1.0:1746140882.903486:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b069c00 00000100:00100000:1.0:1746140882.903506:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8514 00000100:00100000:2.0:1746140882.903542:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8515 00000100:00100000:2.0:1746140882.903550:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573584512:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.903585:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573584384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140882.917234:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573584000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18125us (18330us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140882.917249:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8513 00002000:00100000:3.0:1746140882.917263:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f2c1880 x1830960573584000/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140882.917274:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1880 with x1830960573584000 ext(4194304->4886527) 00002000:00010000:3.0:1746140882.917280:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1880 00000100:00100000:2.0:1746140882.920768:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573584512:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17208us (17536us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140882.920780:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8515 00002000:00100000:2.0:1746140882.920793:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b069c00 x1830960573584512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.920804:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069c00 with x1830960573584512 ext(3145728->4194303) 00002000:00010000:2.0:1746140882.920809:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b069c00 00000100:00100000:1.0:1746140882.921165:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573584384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17581us (18037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140882.921177:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8514 00002000:00100000:1.0:1746140882.921182:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f2c2d80 x1830960573584384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.921190:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2d80 with x1830960573584384 ext(3145728->4194303) 00002000:00010000:1.0:1746140882.921194:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c2d80 00000100:00100000:2.0:1746140882.926707:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140882.926822:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573584768 00000100:00100000:0.0:1746140882.926831:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573584768 00000100:00100000:0.0:1746140882.926888:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4650 00000100:00100000:0.0:1746140882.926895:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32502:x1830960573584768:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746140882.927215:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32502:x1830960573584768:12345-192.168.204.16@tcp:35:cat.0 Request processed in 319us (517us total) trans 8589944921 rc 0/0 00000100:00100000:0.0:1746140882.927222:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4650 00000100:00100000:2.0:1746140882.930779:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.930906:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573585024 00000100:00100000:1.0:1746140882.930915:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573585024 00002000:00100000:1.0:1746140882.930957:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b06a680 x1830960573585024/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.930967:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06a680 with x1830960573585024 ext(4194304->4886527) 00002000:00010000:1.0:1746140882.930972:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b06a680 00000100:00100000:1.0:1746140882.930991:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8516 00000100:00100000:1.0:1746140882.930998:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573585024:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140882.939516:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573585024:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8509us (8740us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140882.939528:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8516 00002000:00100000:1.0:1746140882.939542:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b06a680 x1830960573585024/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:298/0 lens 488/440 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140882.939551:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06a680 with x1830960573585024 ext(4194304->4886527) 00002000:00010000:1.0:1746140882.939556:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b06a680 00000100:00100000:0.0:1746140882.946371:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.946445:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573585280 00000100:00100000:3.0:1746140882.946456:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573585280 00000100:00100000:3.0:1746140882.946500:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4651 00000100:00100000:3.0:1746140882.946508:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32496:x1830960573585280:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140882.948919:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32496:x1830960573585280:12345-192.168.204.16@tcp:35:cat.0 Request processed in 2401us (2547us total) trans 8589944922 rc 0/0 00000100:00100000:3.0:1746140882.948931:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4651 00000100:00100000:0.0:1746140882.952777:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.952900:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573585536 00000100:00100000:1.0:1746140882.952909:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573585536 00000100:00100000:1.0:1746140882.952970:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10643 00000100:00100000:1.0:1746140882.952977:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32508:x1830960573585536:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140882.953004:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.953023:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb9484 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f47 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.953118:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140882.953131:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 277 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.953151:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140882.953185:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 277 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.953197:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 277 pid: 14785 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140882.953208:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575997824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.953295:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140882.954701:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.954801:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573585664 00000100:00100000:2.0:1746140882.954806:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573585664 00010000:00010000:2.0:1746140882.954828:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 278 pid: 14785 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140882.954853:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8588 00000100:00100000:2.0:1746140882.954858:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1985:x1830960573585664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.954865:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.954868:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 278 pid: 14785 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140882.954880:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 278 pid: 14785 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140882.954895:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140882.954898:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140882.954903:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140882.954907:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140882.954917:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.954939:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1985:x1830960573585664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.954943:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8588 00010000:00010000:1.0:1746140882.954959:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a0a00/0x8156357b7fdb9406 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed0 expref: 277 pid: 14785 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140882.954986:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575997824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.955002:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140882.955010:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140882.955015:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:1.0:1746140882.955029:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140882.955168:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb9484 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 278 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.955180:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 277 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.955187:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140882.955190:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746140882.955192:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb8800, rc 0) 00000100:00100000:1.0:1746140882.955227:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:32508:x1830960573585536:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2250us (2461us total) trans 8589944923 rc 0/0 00000100:00100000:1.0:1746140882.955233:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10643 00000100:00100000:0.0:1746140882.961129:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140882.961210:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573585792 00000100:00100000:1.0:1746140882.961221:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573585792 00000100:00100000:1.0:1746140882.961769:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16604 00000100:00100000:1.0:1746140882.961778:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:32508:x1830960573585792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140882.961796:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140882.961813:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f4e expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.961842:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 17 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.961855:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 11 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.961862:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.961867:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.961876:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140882.961880:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2252800->2457599] (req 2252800->2457599) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.961909:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.961920:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 17 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140882.961932:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575997952:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.962035:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 11 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.962043:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 11 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140882.962051:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575998080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.962076:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 17 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.962083:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 17 pid: 8459 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140882.962090:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575998208:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.962107:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.964526:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575997952:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.964540:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575998080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140882.964548:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960575998208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140882.964585:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2252800->2457599] (req 2252800->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140882.964601:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb9000, rc 0) 00000100:00100000:1.0:1746140882.964643:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:32508:x1830960573585792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2865us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140882.964650:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16604 00000100:00100000:0.0:1746140882.964845:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.964996:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573585920 00000100:00100000:3.0:1746140882.965002:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573585920 00010000:00010000:3.0:1746140882.965028:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 17 pid: 8459 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140882.965048:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8589 00000100:00100000:3.0:1746140882.965053:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960573585920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.965063:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.965084:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 17 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140882.965093:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 17 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140882.965116:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8600/0x8156357b7fdb9453 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f16 expref: 17 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140882.965131:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140882.965173:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573585920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.965182:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8589 00000100:00100000:0.0:1746140882.965429:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.965506:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573586048 00000100:00100000:2.0:1746140882.965509:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573586048 00010000:00010000:2.0:1746140882.965524:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 12 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140882.965540:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8590 00000100:00100000:2.0:1746140882.965545:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573586048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140882.965553:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140882.965561:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 12 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140882.965572:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 12 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140882.965584:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013733b000/0x8156357b7fdb946f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f32 expref: 12 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140882.965602:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140882.965620:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573586048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140882.965626:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8590 00000100:00100000:0.0:1746140882.966651:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.966689:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573586176 00000100:00100000:3.0:1746140882.966693:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573586176 00010000:00010000:3.0:1746140882.966710:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140882.966737:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8591 00000100:00100000:3.0:1746140882.966742:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573586176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140882.966752:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140882.966762:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140882.966770:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140882.966783:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013733be00/0x8156357b7fdb947d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f40 expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140882.966792:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.966794:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140882.966800:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 15 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.966808:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 15 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140882.966837:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 15 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140882.966849:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575998336:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140882.966953:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d480 going to sleep for 11 seconds 00000100:00100000:1.0:1746140882.968681:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140882.968738:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960575998336:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140882.968754:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573586432 00010000:00010000:3.0:1746140882.968755:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140882.968760:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573586432 00000100:00100000:3.0:1746140882.968785:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573586176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2042us (2136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140882.968792:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8591 00002000:00100000:0.0:1746140882.968794:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2252800->2256895) req@ffff8800948f9f80 x1830960573586432/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.968803:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948f9f80 with x1830960573586432 ext(2252800->2256895) 00002000:00010000:0.0:1746140882.968808:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948f9f80 00000100:00100000:0.0:1746140882.968832:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8517 00000100:00100000:0.0:1746140882.968838:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1984:x1830960573586432:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140882.969000:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1984:x1830960573586432:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 162us (324us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140882.969006:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8517 00002000:00100000:0.0:1746140882.969011:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2252800->2256895) req@ffff8800948f9f80 x1830960573586432/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140882.969018:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948f9f80 with x1830960573586432 ext(2252800->2256895) 00002000:00010000:0.0:1746140882.969020:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948f9f80 00000100:00100000:0.0:1746140882.971942:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140882.972032:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573586688 00000100:00100000:2.0:1746140882.972041:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573586688 00002000:00100000:2.0:1746140882.972077:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2453504->2457599) req@ffff880094af6680 x1830960573586688/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/0 e 0 to 0 dl 1746140893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.972085:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af6680 with x1830960573586688 ext(2453504->2457599) 00002000:00010000:2.0:1746140882.972090:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af6680 00000100:00100000:2.0:1746140882.972331:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8518 00000100:00100000:2.0:1746140882.972339:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1984:x1830960573586688:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140882.972512:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1984:x1830960573586688:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 174us (578us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140882.972518:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8518 00002000:00100000:2.0:1746140882.972523:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2453504->2457599) req@ffff880094af6680 x1830960573586688/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746140893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140882.972535:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af6680 with x1830960573586688 ext(2453504->2457599) 00002000:00010000:2.0:1746140882.972537:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af6680 00000100:00100000:0.0:1746140883.016111:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.016205:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573586944 00000100:00100000:1.0:1746140883.016215:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573586944 00000100:00100000:1.0:1746140883.016280:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10644 00000100:00100000:1.0:1746140883.016288:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32512:x1830960573586944:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140883.016347:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.016365:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f55 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.016622:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016636:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016646:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016660:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016666:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016670:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016869:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016877:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016883:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:1.0:1746140883.016892:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140883.016976:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016982:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016989:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.016993:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecb9e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140883.016997:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017003:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017011:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140883.017014:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140883.017018:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017022:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9e00/0x8156357b7fdb94a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017433:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017440:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017445:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017450:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecb9200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140883.017464:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017469:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017480:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630ad00) 00010000:00010000:1.0:1746140883.017483:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140883.017485:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017489:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9200/0x8156357b7fdb94ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.017575:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f55 expref: 17 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.017589:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f55 expref: 16 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.017594:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140883.017596:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746140883.017598:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb9800, rc 0) 00000100:00100000:1.0:1746140883.017660:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32512:x1830960573586944:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1371us (1558us total) trans 8589944924 rc 0/0 00000100:00100000:1.0:1746140883.017668:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10644 00000100:00100000:0.0:1746140883.021763:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.022184:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573587072 00000100:00100000:3.0:1746140883.022194:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573587072 00000100:00100000:3.0:1746140883.022253:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 760 00000100:00100000:3.0:1746140883.022260:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573587072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.022273:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.022298:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94b5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f55 expref: 16 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.022351:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.022356:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.022410:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573587072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 151us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.022416:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 760 00000100:00100000:0.0:1746140883.045100:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.045247:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573587200 00000100:00100000:1.0:1746140883.045255:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573587200 00000100:00100000:1.0:1746140883.045385:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10645 00000100:00100000:1.0:1746140883.045393:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:32513:x1830960573587200:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140883.045414:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.045430:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8000/0x8156357b7fdb94c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f5c expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.045485:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.045496:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.045506:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.045518:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.045523:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.045529:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.045619:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.045626:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 276 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.045630:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.045652:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 276 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.045659:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 276 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.045670:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575998464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.045953:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.049765:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.049828:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573587456 00000100:00100000:3.0:1746140883.049836:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573587456 00000100:00100000:3.0:1746140883.049874:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4652 00000100:00100000:3.0:1746140883.049880:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:31971:x1830960573587456:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746140883.049955:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960575998464:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.049980:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:3.0:1746140883.050376:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:31971:x1830960573587456:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 495us (618us total) trans 8589944925 rc 0/0 00000100:00100000:3.0:1746140883.050383:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4652 00000100:00100000:3.0:1746140883.052894:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.053072:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573587584 00000100:00100000:1.0:1746140883.053082:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573587584 00010000:00010000:1.0:1746140883.053119:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 278 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.053173:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8592 00000100:00100000:1.0:1746140883.053181:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1982:x1830960573587584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.053199:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.053205:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 278 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.053217:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 278 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.053238:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8800/0x8156357b7fdb948b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f47 expref: 278 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.053386:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140883.053391:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.053405:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.053411:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.053554:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140883.053868:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.053879:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:0.0:1746140883.053923:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140883.053927:0:14743:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140883.053943:0:14743:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.053953:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.053962:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.053968:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.053973:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.053979:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecb8200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140883.053982:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.053988:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.053997:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140883.053999:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140883.054002:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054007:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8200/0x8156357b7fdb94ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054021:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054026:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054030:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054033:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecb9800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140883.054036:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054040:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054046:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630ab00) 00010000:00010000:0.0:1746140883.054048:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140883.054050:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054054:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb9800/0x8156357b7fdb94d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.054087:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8000/0x8156357b7fdb94c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 12 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.054097:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 11 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.054103:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140883.054105:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140883.054107:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb8e00, rc 0) 00000100:00100000:1.0:1746140883.054202:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:1982:x1830960573587584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1020us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.054209:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8592 00000100:00100000:0.0:1746140883.054464:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:32513:x1830960573587200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9072us (9372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140883.054470:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10645 00000100:00100000:2.0:1746140883.059581:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.059586:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.059940:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.059965:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.060128:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.060534:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.060623:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573587840 00000100:00100000:0.0:1746140883.060634:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573587840 00000100:00100000:0.0:1746140883.060691:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10646 00000100:00100000:0.0:1746140883.060701:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:32516:x1830960573587840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140883.060726:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140883.060747:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb94df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f63 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.060872:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.060887:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.060897:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.060911:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.060917:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.060923:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:3.0:1746140883.061011:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573587968 00000100:00100000:3.0:1746140883.061016:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573587968 00000100:00080000:0.0:1746140883.061046:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746140883.061055:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573588224 00000100:00100000:3.0:1746140883.061057:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573588224 00000100:00100000:0.0:1746140883.061062:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573588480 00000100:00100000:0.0:1746140883.061066:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573588480 00000100:00100000:3.0:1746140883.061073:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573588096 00000100:00100000:3.0:1746140883.061075:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573588096 00000100:00100000:0.0:1746140883.061092:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16605 00000100:00100000:0.0:1746140883.061097:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1982:x1830960573587968:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746140883.061104:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16606 00010000:00010000:0.0:1746140883.061105:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140883.061110:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:1982:x1830960573588224:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140883.061115:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f6a expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.061119:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.061130:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f78 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.061140:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.061142:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.061150:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.061153:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.061154:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.061160:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 7 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.061163:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.061172:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 7 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.061172:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ac874c00, rc 0) 00010000:00010000:3.0:1746140883.061180:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009454ca00, rc 0) 00000100:00100000:0.0:1746140883.061531:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16607 00000100:00100000:0.0:1746140883.061539:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573588480:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140883.061549:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140883.061558:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ac874400/0x8156357b7fdb9502 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f86 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140883.061603:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575998592:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140883.061670:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6e40 going to sleep for 11 seconds 00000100:00080000:0.0:1746140883.061687:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746140883.061703:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573587968:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 603us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140883.061709:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16605 00000100:00100000:0.0:1746140883.061731:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16608 00000100:00100000:0.0:1746140883.061738:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573588096:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140883.061745:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140883.061754:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f71 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.061767:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.061768:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.061774:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.061785:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.061793:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ac875800, rc 0) 00000100:00100000:0.0:1746140883.061816:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573588096:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 79us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140883.061822:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16608 00010000:00010000:0.0:1746140883.061863:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.061873:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.061879:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:0.0:1746140883.061892:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:3.0:1746140883.061924:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573588224:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 812us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.061930:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16606 00010000:00010000:0.0:1746140883.061976:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.061982:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.061987:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.061992:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ac4a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140883.061996:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062002:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062011:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140883.062014:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140883.062018:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062022:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4a00/0x8156357b7fdb94e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062036:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062041:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062045:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062052:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ac4400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140883.062054:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062059:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062064:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130d2f400) 00010000:00010000:0.0:1746140883.062066:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140883.062068:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062072:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac4400/0x8156357b7fdb94ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140883.062112:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdb94df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 280 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.062121:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 279 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.062126:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140883.062128:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140883.062130:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ac874000, rc 0) 00000100:00100000:0.0:1746140883.062160:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:32516:x1830960573587840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1462us (2578us total) trans 8589944926 rc 0/0 00000100:00100000:0.0:1746140883.062165:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10646 00000100:00100000:2.0:1746140883.062254:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.062275:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573588352 00000100:00100000:2.0:1746140883.062279:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573588352 00000100:00100000:1.0:1746140883.062292:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573588608 00000100:00100000:1.0:1746140883.062296:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573588608 00000100:00100000:2.0:1746140883.062298:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16609 00000100:00100000:2.0:1746140883.062321:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573588352:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746140883.062326:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16610 00010000:00010000:2.0:1746140883.062329:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140883.062331:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573588608:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140883.062337:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f7f expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.062337:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.062344:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f8d expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.062348:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.062350:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.062355:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 9 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.062355:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.062356:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.062361:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.062366:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 9 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.062370:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.062373:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135256400, rc 0) 00010000:00010000:1.0:1746140883.062376:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb9200, rc 0) 00000100:00100000:1.0:1746140883.062393:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573588608:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.062394:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573588352:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 90us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.062399:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16610 00000100:00100000:2.0:1746140883.062402:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16609 00000100:00100000:2.0:1746140883.068034:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575998592:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140883.068067:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ac874400/0x8156357b7fdb9502 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f86 expref: 8 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.068081:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ac874400/0x8156357b7fdb9502 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f86 expref: 8 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.069466:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ac874400, rc 0) 00000100:00100000:2.0:1746140883.069656:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573588480:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 8113us (9685us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140883.069666:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16607 00000100:00100000:0.0:1746140883.070252:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.072837:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573588864 00000100:00100000:2.0:1746140883.072850:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573588864 00000100:00100000:2.0:1746140883.073014:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10647 00000100:00100000:2.0:1746140883.073022:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32519:x1830960573588864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.073041:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140883.073264:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.073462:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573589120 00000100:00100000:2.0:1746140883.073465:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573589120 00000100:00100000:2.0:1746140883.073486:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10648 00000100:00100000:2.0:1746140883.073491:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:32513:x1830960573589120:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140883.073499:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.073510:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135257c00/0x8156357b7fdb9533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f9b expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.073618:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.073902:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 12 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.073910:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 278 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.073917:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.073950:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 278 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.073962:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 278 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.073974:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575998720:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.074225:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 12 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.074233:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 12 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.074241:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575998848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140883.074454:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800930ef840 going to sleep for 11 seconds 00010000:00010000:2.0:1746140883.074467:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135257000/0x8156357b7fdb952c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0f94 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.074558:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074567:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074576:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074588:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074593:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074598:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074683:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb954f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074690:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb954f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074695:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb954f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:2.0:1746140883.074704:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.074785:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074791:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074798:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074803:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff15a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.074806:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074812:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074822:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.074825:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.074828:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074833:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb9541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074842:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074847:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074851:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074855:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff14400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.074857:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074862:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074871:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152100) 00010000:00010000:2.0:1746140883.074873:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.074876:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074880:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb9548 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.074914:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135257000/0x8156357b7fdb952c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f94 expref: 18 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.074925:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb954f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f94 expref: 17 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.074931:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.074933:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140883.074935:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff15800, rc 0) 00000100:00100000:2.0:1746140883.074966:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32519:x1830960573588864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1945us (4715us total) trans 8589944927 rc 0/0 00000100:00100000:2.0:1746140883.074972:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10647 00000100:00100000:0.0:1746140883.076105:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.076151:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.076206:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573589376 00000100:00100000:3.0:1746140883.076212:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573589376 00002000:00100000:3.0:1746140883.076261:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3350527) req@ffff880094af4380 x1830960573589376/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 504/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.076271:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4380 with x1830960573589376 ext(2097152->3350527) 00002000:00010000:3.0:1746140883.076276:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af4380 00000100:00100000:3.0:1746140883.076318:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573589504 00000100:00100000:3.0:1746140883.076321:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573589504 00002000:00100000:3.0:1746140883.076333:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3350528->4194303) req@ffff880094af5f80 x1830960573589504/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.076339:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5f80 with x1830960573589504 ext(3350528->4194303) 00002000:00010000:3.0:1746140883.076341:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5f80 00000100:00100000:3.0:1746140883.076360:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8519 00000100:00100000:3.0:1746140883.076366:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960573589376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140883.076735:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8520 00000100:00100000:2.0:1746140883.076743:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960573589504:12345-192.168.204.16@tcp:3:cat.0 00000100:00080000:0.0:1746140883.077879:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140883.082702:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.082767:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573589760 00000100:00100000:1.0:1746140883.082777:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573589760 00000100:00100000:0.0:1746140883.082809:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140883.082813:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 13 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.083065:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575998848:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.083250:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573589888 00000100:00100000:1.0:1746140883.083253:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573589888 00000100:00100000:3.0:1746140883.083600:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8593 00000100:00100000:3.0:1746140883.083609:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573589760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.083623:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.083629:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 13 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.083640:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 13 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.083659:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecb8e00/0x8156357b7fdb94d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f5c expref: 13 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.083680:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.083685:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140883.083693:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140883.083697:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.083733:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573589760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 126us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.083738:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8593 00000100:00100000:3.0:1746140883.083753:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 761 00000100:00100000:3.0:1746140883.083757:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573589888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.083763:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.083769:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb954f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f94 expref: 17 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.083776:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.083779:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140883.083783:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140883.083786:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.083795:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573589888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 38us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.083800:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 761 00000100:00100000:0.0:1746140883.085984:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.086074:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575998720:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.086104:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140883.086179:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.086227:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573590016 00000100:00100000:3.0:1746140883.086232:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573590016 00000100:00100000:3.0:1746140883.086266:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16611 00000100:00100000:3.0:1746140883.086271:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573590016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140883.086285:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.086299:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a53ad200/0x8156357b7fdb955d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fa2 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.086371:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575998976:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140883.086442:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.086530:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573590144 00000100:00100000:2.0:1746140883.086533:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573590144 00010000:00010000:2.0:1746140883.086551:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 279 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.086572:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8594 00000100:00100000:2.0:1746140883.086577:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:1982:x1830960573590144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140883.086588:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.086592:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 279 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.086603:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 279 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.086619:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac874000/0x8156357b7fdb9510 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f63 expref: 279 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.086639:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.086643:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.086652:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.086659:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.086669:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.086686:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1982:x1830960573590144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.086693:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8594 00010000:00010000:2.0:1746140883.086709:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.086714:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140883.086732:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.086859:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135257c00/0x8156357b7fdb9533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.086871:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.086877:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.086879:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140883.086881:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135257600, rc 0) 00000100:00100000:2.0:1746140883.086917:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:32513:x1830960573589120:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 13425us (13654us total) trans 8589944928 rc 0/0 00000100:00100000:2.0:1746140883.086923:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10648 00000100:00100000:2.0:1746140883.091777:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1983:x1830960573589504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15027us (15617us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746140883.091789:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8520 00002000:00100000:2.0:1746140883.091801:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3350528->4194303) req@ffff880094af5f80 x1830960573589504/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.091810:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5f80 with x1830960573589504 ext(3350528->4194303) 00002000:00010000:2.0:1746140883.091815:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5f80 00000100:00100000:2.0:1746140883.095429:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.095467:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573590400 00000100:00100000:2.0:1746140883.095474:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573590400 00000100:00100000:3.0:1746140883.095485:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575998976:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140883.095514:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10649 00010000:00010000:3.0:1746140883.095516:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a53ad200/0x8156357b7fdb955d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa2 expref: 12 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140883.095522:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:32521:x1830960573590400:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140883.095535:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a53ad200/0x8156357b7fdb955d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa2 expref: 12 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.095540:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.095548:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53ad200, rc 0) 00010000:00010000:2.0:1746140883.095555:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14000/0x8156357b7fdb956b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fa9 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.095641:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095650:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095658:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095665:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095668:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095671:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095739:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095744:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095747:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140883.095757:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.095814:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095818:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095822:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095825:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff15e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.095827:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095833:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095839:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.095841:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.095843:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095845:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb9572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095851:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095853:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095856:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095861:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff15000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.095862:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095865:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095867:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293900) 00010000:00010000:2.0:1746140883.095868:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.095870:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095872:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15000/0x8156357b7fdb9579 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.095893:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14000/0x8156357b7fdb956b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 281 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.095900:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 280 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.095903:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.095904:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140883.095905:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff15200, rc 0) 00000100:00100000:2.0:1746140883.095938:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:32521:x1830960573590400:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 418us (519us total) trans 8589944929 rc 0/0 00000100:00100000:2.0:1746140883.095943:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10649 00000100:00100000:3.0:1746140883.096115:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573590016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9842us (10138us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140883.096122:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16611 00000100:00100000:0.0:1746140883.096238:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.096291:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573590528 00000100:00100000:3.0:1746140883.096295:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573590528 00000100:00100000:3.0:1746140883.096341:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10650 00000100:00100000:3.0:1746140883.096346:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:32513:x1830960573590528:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746140883.096348:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1983:x1830960573589376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19983us (20247us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746140883.096355:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140883.096356:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8519 00010000:00010000:3.0:1746140883.096362:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ad400/0x8156357b7fdb958e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fb0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746140883.096362:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3350527) req@ffff880094af4380 x1830960573589376/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 504/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.096368:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4380 with x1830960573589376 ext(2097152->3350527) 00002000:00010000:2.0:1746140883.096371:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af4380 00010000:00010000:3.0:1746140883.096405:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140883.096414:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.096419:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140883.096442:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.096543:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 13 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.096554:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575999104:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.096656:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.099582:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.099675:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573590656 00000100:00100000:1.0:1746140883.099684:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573590656 00000100:00100000:3.0:1746140883.099698:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960575999104:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.099719:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 14 pid: 14741 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.099720:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:1.0:1746140883.099761:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8595 00000100:00100000:1.0:1746140883.099824:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573590656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.099836:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.099842:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 14 pid: 14741 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.099851:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 14 pid: 14741 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.099871:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135257600/0x8156357b7fdb953a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f9b expref: 14 pid: 14741 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.099892:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140883.099897:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140883.099910:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140883.099916:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140883.099930:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140883.099938:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140883.099945:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:1.0:1746140883.099971:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573590656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 150us (399us total) trans 0 rc 0/0 00000004:00200000:3.0:1746140883.099981:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140883.099985:0:14741:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140883.099997:0:14741:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140883.100023:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ad400/0x8156357b7fdb958e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 14 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.100035:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.100042:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.100045:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140883.100047:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53ada00, rc 0) 00000100:00100000:1.0:1746140883.100063:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8595 00000100:00100000:3.0:1746140883.100074:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:32513:x1830960573590528:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3727us (3841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.100080:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10650 00000100:00100000:0.0:1746140883.100552:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.100597:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573590912 00000100:00100000:3.0:1746140883.100602:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573590912 00002000:00100000:3.0:1746140883.100626:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880093136d80 x1830960573590912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.100632:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136d80 with x1830960573590912 ext(4194304->4886527) 00002000:00010000:3.0:1746140883.100635:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093136d80 00000100:00100000:3.0:1746140883.100647:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8521 00000100:00100000:3.0:1746140883.100650:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573590912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140883.106144:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.106182:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.106275:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573591040 00000100:00100000:3.0:1746140883.106288:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573591040 00000100:00100000:3.0:1746140883.106363:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573591168 00000100:00100000:3.0:1746140883.106366:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573591168 00000100:00100000:3.0:1746140883.106386:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16612 00000100:00100000:3.0:1746140883.106394:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573591040:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140883.106414:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.106431:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a53ad200/0x8156357b7fdb959c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fb7 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.106483:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575999232:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140883.106551:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16613 00000100:00100000:3.0:1746140883.106554:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d840 going to sleep for 11 seconds 00000100:00100000:1.0:1746140883.106563:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32519:x1830960573591168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.106588:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.106602:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fbe expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.106626:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.106633:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.106635:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.106639:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.106661:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 15 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.106673:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 15 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.106683:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573590912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6029us (6131us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140883.106684:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575999360:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140883.106692:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8521 00002000:00100000:2.0:1746140883.106700:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880093136d80 x1830960573590912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.106708:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136d80 with x1830960573590912 ext(4194304->4886527) 00010000:00010000:2.0:1746140883.106713:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 15 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.106725:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 15 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.106726:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1540 going to sleep for 11 seconds 00002000:00010000:2.0:1746140883.106731:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093136d80 00000100:00100000:0.0:1746140883.110129:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.110202:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960575999232:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140883.110232:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960575999360:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140883.110239:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a53ad200/0x8156357b7fdb959c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb7 expref: 8 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.110253:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a53ad200/0x8156357b7fdb959c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb7 expref: 8 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.110262:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.110264:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53ad200, rc 0) 00010000:00010000:1.0:1746140883.110274:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094aca200, rc 0) 00000100:00100000:2.0:1746140883.110381:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573591424 00000100:00100000:2.0:1746140883.110387:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573591424 00000100:00100000:2.0:1746140883.110425:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16614 00000100:00100000:2.0:1746140883.110432:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:32516:x1830960573591424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.110444:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.110456:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fc5 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.110475:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140883.110477:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140883.110480:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4206592->4886527] (req 4206592->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.110488:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4206592->4886527] (req 4206592->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.110493:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff14000, rc 0) 00000100:00100000:1.0:1746140883.110519:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32519:x1830960573591168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3959us (4336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.110525:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16613 00000100:00100000:0.0:1746140883.110634:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.110641:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:32516:x1830960573591424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 209us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.110642:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573591040:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4247us (4520us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140883.110646:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16614 00000100:00100000:3.0:1746140883.110648:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16612 00000100:00100000:2.0:1746140883.110947:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573591296 00000100:00100000:2.0:1746140883.110950:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573591296 00002000:00100000:2.0:1746140883.110975:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2252800->2457599) req@ffff880135b66300 x1830960573591296/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.110983:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66300 with x1830960573591296 ext(2252800->2457599) 00010000:00010000:2.0:1746140883.110988:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.110999:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.111005:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b66300 00000100:00100000:2.0:1746140883.111018:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1757 00000100:00100000:2.0:1746140883.111023:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573591296:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140883.111027:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.111044:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573591552 00000100:00100000:2.0:1746140883.111047:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573591552 00000100:00100000:2.0:1746140883.111060:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16615 00000100:00100000:2.0:1746140883.111064:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:32521:x1830960573591552:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140883.111070:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.111076:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fcc expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.111088:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140883.111092:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.111102:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140883.111105:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.111142:0:4784:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.111152:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.111163:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff15e00, rc 0) 00000100:00100000:2.0:1746140883.111196:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:32521:x1830960573591552:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 130us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.111201:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16615 00000100:00100000:2.0:1746140883.114129:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.114184:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573591808 00000100:00100000:2.0:1746140883.114198:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573591808 00000100:00100000:2.0:1746140883.114247:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10651 00000100:00100000:2.0:1746140883.114255:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:32513:x1830960573591808:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140883.114275:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.114415:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb95b8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fd3 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.114567:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114581:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114591:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114602:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114607:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114613:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114618:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff15800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.114622:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114628:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114641:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.114644:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140883.114647:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.114651:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15800/0x8156357b7fdb95bf lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.115288:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb95b8 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fd3 expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.115296:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff14400/0x8156357b7fdb95b8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fd3 expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.115323:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff14400, rc 0) 00000100:00100000:2.0:1746140883.115373:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:32513:x1830960573591808:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1118us (1253us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140883.115379:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10651 00000100:00100000:0.0:1746140883.115748:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960573591296:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4715us (5105us total) trans 21474841315 rc 0/0 00000100:00100000:0.0:1746140883.115758:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1757 00002000:00100000:0.0:1746140883.115769:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2252800->2457599) req@ffff880135b66300 x1830960573591296/t21474841315(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140883.115777:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66300 with x1830960573591296 ext(2252800->2457599) 00010000:00010000:0.0:1746140883.115786:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:0.0:1746140883.116219:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00002000:00010000:0.0:1746140883.116233:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b66300 00000100:00100000:0.0:1746140883.118498:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.118626:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573592064 00000100:00100000:3.0:1746140883.118636:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573592064 00000100:00100000:3.0:1746140883.118686:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4653 00000100:00100000:3.0:1746140883.118694:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a979450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:32513:x1830960573592064:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746140883.118891:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a979450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:32513:x1830960573592064:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 197us (400us total) trans 8589944930 rc 0/0 00000100:00100000:3.0:1746140883.118901:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4653 00000100:00100000:0.0:1746140883.126088:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.126339:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573592192 00000100:00100000:1.0:1746140883.126350:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573592192 00010000:00010000:1.0:1746140883.126385:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.126426:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8596 00000100:00100000:1.0:1746140883.126433:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573592192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.126447:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.126465:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.126480:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.126505:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9000/0x8156357b7fdb9499 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2252800->2457599) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f4e expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.126536:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.126538:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.126544:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.126552:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.126559:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.126561:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.126563:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.126569:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.127091:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.127105:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575999616:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140883.127205:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.127456:0:7110:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 11 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.127465:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575999744:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.127887:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1540 going to sleep for 11 seconds 00000100:00100000:1.0:1746140883.129613:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575999744:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140883.133102:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.133146:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.133228:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.133373:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575999616:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140883.133391:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573592448 00000100:00100000:2.0:1746140883.133399:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573592448 00010000:00010000:1.0:1746140883.133401:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.133443:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573592192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7011us (7363us total) trans 0 rc 0/0 00002000:00100000:2.0:1746140883.133444:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4206592->4886527) req@ffff880135b65180 x1830960573592448/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746140883.133453:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8596 00002000:00100000:2.0:1746140883.133454:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b65180 with x1830960573592448 ext(4206592->4886527) 00002000:00010000:2.0:1746140883.133458:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b65180 00000100:00100000:2.0:1746140883.133473:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573592832 00000100:00100000:2.0:1746140883.133475:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573592832 00000100:00100000:1.0:1746140883.133481:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573592704 00000100:00100000:1.0:1746140883.133484:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573592704 00002000:00100000:2.0:1746140883.133492:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135b67800 x1830960573592832/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140883.133498:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880135b64700 x1830960573592704/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.133504:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67800 with x1830960573592832 ext(3145728->4194303) 00002000:00100000:1.0:1746140883.133505:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64700 with x1830960573592704 ext(2097152->3145727) 00010000:00010000:2.0:1746140883.133510:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.133510:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.133521:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.133523:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.133526:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b67800 00002000:00010000:1.0:1746140883.133529:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b64700 00000100:00100000:2.0:1746140883.133539:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1758 00000100:00100000:2.0:1746140883.133545:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573592832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140883.133549:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1759 00000100:00100000:1.0:1746140883.133556:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573592704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140883.133595:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8522 00000100:00100000:2.0:1746140883.135493:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1983:x1830960573592448:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140883.144977:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573592704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11411us (11738us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140883.144990:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1759 00002000:00100000:1.0:1746140883.145002:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880135b64700 x1830960573592704/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140883.145011:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64700 with x1830960573592704 ext(2097152->3145727) 00010000:00010000:1.0:1746140883.145021:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 14 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.145035:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 14 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:1.0:1746140883.145041:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b64700 00000100:00100000:2.0:1746140883.150355:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1983:x1830960573592448:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 16743us (17250us total) trans 0 rc 679936/679936 00000100:00100000:2.0:1746140883.150366:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8522 00002000:00100000:2.0:1746140883.150379:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4206592->4886527) req@ffff880135b65180 x1830960573592448/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 679936/679936 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.150388:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b65180 with x1830960573592448 ext(4206592->4886527) 00002000:00010000:2.0:1746140883.150394:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b65180 00000100:00100000:0.0:1746140883.151101:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.151186:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573593216 00000100:00100000:2.0:1746140883.151193:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573593216 00002000:00100000:2.0:1746140883.151219:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880135b65f80 x1830960573593216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.151226:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b65f80 with x1830960573593216 ext(4194304->4886527) 00010000:00010000:2.0:1746140883.151234:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 14 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.151247:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 14 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.151253:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b65f80 00000100:00100000:2.0:1746140883.151281:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1760 00000100:00100000:2.0:1746140883.151287:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573593216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140883.153577:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573592832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20025us (20423us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.153587:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1758 00002000:00100000:3.0:1746140883.153596:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135b67800 x1830960573592832/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.153604:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67800 with x1830960573592832 ext(3145728->4194303) 00010000:00010000:3.0:1746140883.153611:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 14 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.153624:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 14 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.153629:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b67800 00000100:00100000:0.0:1746140883.154410:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.154513:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.154532:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573593344 00000100:00100000:0.0:1746140883.154538:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573593344 00000100:00100000:0.0:1746140883.154582:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573593472 00000100:00100000:0.0:1746140883.154584:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573593472 00000100:00100000:0.0:1746140883.154605:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16616 00000100:00100000:0.0:1746140883.154612:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32519:x1830960573593344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140883.154626:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140883.154635:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16617 00010000:00010000:0.0:1746140883.154640:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fda expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.154644:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1982:x1830960573593472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.154651:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.154658:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9600/0x8156357b7fdb95cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fe1 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.154661:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.154664:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.154672:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 15 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.154902:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.154912:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 15 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.154916:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9600/0x8156357b7fdb95cd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fe1 expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.154926:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb9600/0x8156357b7fdb95cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fe1 expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.154927:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb7c00, rc 0) 00000100:00100000:0.0:1746140883.154951:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32519:x1830960573593344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 340us (543us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140883.154952:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecb9600, rc 0) 00000100:00100000:0.0:1746140883.154957:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16616 00000100:00100000:1.0:1746140883.154973:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1982:x1830960573593472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 331us (459us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.154978:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16617 00000100:00100000:0.0:1746140883.158421:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.159013:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573593600 00000100:00100000:1.0:1746140883.159021:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573593600 00000100:00100000:1.0:1746140883.159073:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16618 00000100:00100000:1.0:1746140883.159088:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1982:x1830960573593600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.159109:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.159125:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb95d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fe8 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.159155:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.159166:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb95d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fe8 expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.159176:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb95d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fe8 expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.159185:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a3ba400, rc 0) 00000100:00100000:1.0:1746140883.159235:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1982:x1830960573593600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 154us (820us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.159240:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16618 00000100:00100000:0.0:1746140883.159953:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.160079:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573593856 00000100:00100000:3.0:1746140883.160083:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573593856 00002000:00100000:3.0:1746140883.160108:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135b66d80 x1830960573593856/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.160116:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66d80 with x1830960573593856 ext(3145728->4194303) 00010000:00010000:3.0:1746140883.160123:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.160147:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.160157:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b66d80 00000100:00100000:3.0:1746140883.160171:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1761 00000100:00100000:3.0:1746140883.160176:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573593856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140883.160808:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573593216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9520us (9708us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140883.160815:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1760 00002000:00100000:2.0:1746140883.160821:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880135b65f80 x1830960573593216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.160827:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b65f80 with x1830960573593216 ext(4194304->4886527) 00010000:00010000:2.0:1746140883.160832:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 14 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.160841:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 14 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.160847:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b65f80 00000100:00100000:0.0:1746140883.169660:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.169700:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.169778:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573593984 00000100:00100000:2.0:1746140883.169787:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573593984 00010000:00010000:2.0:1746140883.169820:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.169854:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8597 00000100:00100000:2.0:1746140883.169861:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573593984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140883.169874:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.169896:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.169907:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.169930:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094aca200/0x8156357b7fdb95a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fbe expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.169954:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.169956:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.169964:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.170335:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573594240 00000100:00100000:3.0:1746140883.170339:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573594240 00000100:00100000:3.0:1746140883.170362:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4654 00000100:00100000:3.0:1746140883.170368:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:32516:x1830960573594240:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140883.170550:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:32516:x1830960573594240:12345-192.168.204.16@tcp:35:cat.0 Request processed in 181us (848us total) trans 8589944931 rc 0/0 00000100:00100000:3.0:1746140883.170557:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4654 00010000:00010000:2.0:1746140883.171735:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.171776:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.171788:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575999872:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140883.171856:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800930ef840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.174191:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.174279:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573594368 00000100:00100000:1.0:1746140883.174286:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573594368 00000100:00100000:1.0:1746140883.175570:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16619 00000100:00100000:1.0:1746140883.175578:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32512:x1830960573594368:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140883.175597:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.175613:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0fef expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.175638:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 17 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.175645:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 6 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.175652:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.175657:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.175659:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.175662:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1941504->2097151] (req 1941504->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 16 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.175689:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.175700:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.175712:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000000:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.175806:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 6 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.175814:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 6 pid: 9872 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.175821:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000128:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.175849:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 17 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.175856:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 17 pid: 9872 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.175863:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000256:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.175878:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1540 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.176813:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960575999872:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140883.176827:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.176853:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573593984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6992us (7200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.176863:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8597 00000100:00100000:3.0:1746140883.177286:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573593856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17109us (17333us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.177299:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1761 00002000:00100000:3.0:1746140883.177329:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135b66d80 x1830960573593856/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.177337:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66d80 with x1830960573593856 ext(3145728->4194303) 00002000:00010000:3.0:1746140883.177346:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b66d80 00000100:00100000:0.0:1746140883.177432:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.177954:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573594624 00000100:00100000:3.0:1746140883.177960:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573594624 00002000:00100000:3.0:1746140883.177985:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2772992->2777087) req@ffff880135b67b80 x1830960573594624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.177991:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67b80 with x1830960573594624 ext(2772992->2777087) 00002000:00010000:3.0:1746140883.177995:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b67b80 00000100:00100000:3.0:1746140883.178483:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8523 00000100:00100000:3.0:1746140883.178491:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960573594624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140883.178749:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000000:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.178885:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960573594624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 394us (1453us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140883.178891:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8523 00002000:00100000:3.0:1746140883.178896:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2772992->2777087) req@ffff880135b67b80 x1830960573594624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.178902:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67b80 with x1830960573594624 ext(2772992->2777087) 00002000:00010000:3.0:1746140883.178905:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b67b80 00000100:00100000:0.0:1746140883.180645:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.180758:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.180835:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.181153:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000128:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.181164:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000256:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.181202:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1941504->2097151] (req 1941504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 13 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.181204:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573594752 00000100:00100000:2.0:1746140883.181210:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573594752 00000100:00100000:3.0:1746140883.181216:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573594880 00010000:00010000:1.0:1746140883.181219:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930e9c00, rc 0) 00000100:00100000:3.0:1746140883.181220:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573594880 00010000:00010000:3.0:1746140883.181237:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 7 pid: 9872 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.181237:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 14 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.181256:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573595008 00000100:00100000:2.0:1746140883.181258:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573595008 00000100:00100000:1.0:1746140883.181262:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32512:x1830960573594368:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5685us (7078us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140883.181267:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 18 pid: 9872 timeout: 962 lvb_type: 1 00000100:00100000:3.0:1746140883.181272:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8598 00000100:00100000:1.0:1746140883.181272:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16619 00000100:00100000:3.0:1746140883.181280:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573594752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140883.181282:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8599 00000100:00100000:2.0:1746140883.181287:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573594880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.181292:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.181293:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140883.181319:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8600 00000100:00100000:1.0:1746140883.181326:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1983:x1830960573595008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.181330:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 13 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.181330:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 7 pid: 9872 timeout: 962 lvb_type: 1 00010000:00010000:1.0:1746140883.181332:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.181338:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 7 pid: 9872 timeout: 962 lvb_type: 1 00010000:00010000:3.0:1746140883.181346:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 13 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.181355:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 18 pid: 9872 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.181365:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135256400/0x8156357b7fdb951e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f7f expref: 7 pid: 9872 timeout: 962 lvb_type: 1 00010000:00010000:3.0:1746140883.181371:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a0c600/0x8156357b7fdb9445 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f08 expref: 13 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.181373:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 18 pid: 9872 timeout: 962 lvb_type: 1 00010000:00010000:1.0:1746140883.181386:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdb9430 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eec expref: 18 pid: 9872 timeout: 962 lvb_type: 1 00010000:00010000:3.0:1746140883.181389:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.181391:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.181398:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.181406:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.181688:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140883.181688:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.181711:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1983:x1830960573595008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 386us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.181716:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8600 00000100:00100000:2.0:1746140883.181718:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573594880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 429us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.181725:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8599 00010000:00010000:3.0:1746140883.181823:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.181836:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576000384:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140883.181892:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.185460:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.185550:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.185607:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573595264 00000100:00100000:2.0:1746140883.185618:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573595264 00000100:00100000:0.0:1746140883.185637:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.185657:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573595136 00000100:00100000:2.0:1746140883.185659:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573595136 00000100:00100000:2.0:1746140883.185677:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16620 00000100:00100000:2.0:1746140883.185683:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573595264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.185700:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140883.185712:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576000384:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.185717:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16621 00010000:00010000:2.0:1746140883.185722:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb95e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ffd expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.185729:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573595136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140883.185733:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140883.185746:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.185750:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb95e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ffd expref: 15 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.185759:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff15a00/0x8156357b7fdb95e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ffd expref: 15 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.185761:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb95e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a0ff6 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.185770:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff15a00, rc 0) 00000100:00100000:3.0:1746140883.185788:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573594752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4509us (5148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.185796:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8598 00000100:00100000:2.0:1746140883.185805:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573595264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 122us (361us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.185809:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000512:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140883.185811:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16620 00000100:00100000:3.0:1746140883.185830:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573595520 00000100:00100000:3.0:1746140883.185835:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573595520 00002000:00100000:3.0:1746140883.185860:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1941504->1945599) req@ffff88009f24ed80 x1830960573595520/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746140883.185868:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1540 going to sleep for 11 seconds 00002000:00100000:3.0:1746140883.185870:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ed80 with x1830960573595520 ext(1941504->1945599) 00002000:00010000:3.0:1746140883.185874:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24ed80 00000100:00100000:3.0:1746140883.185889:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8524 00000100:00100000:3.0:1746140883.185896:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573595520:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140883.186068:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573595520:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 172us (430us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140883.186074:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8524 00002000:00100000:3.0:1746140883.186080:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1941504->1945599) req@ffff88009f24ed80 x1830960573595520/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.186086:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ed80 with x1830960573595520 ext(1941504->1945599) 00002000:00010000:3.0:1746140883.186089:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24ed80 00000100:00100000:0.0:1746140883.186472:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.186583:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573595776 00000100:00100000:2.0:1746140883.186588:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573595776 00002000:00100000:2.0:1746140883.186607:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3006464->3010559) req@ffff88009f24c000 x1830960573595776/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.186615:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24c000 with x1830960573595776 ext(3006464->3010559) 00002000:00010000:2.0:1746140883.186618:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24c000 00000100:00100000:2.0:1746140883.186637:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8525 00000100:00100000:2.0:1746140883.186642:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1983:x1830960573595776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140883.186765:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1983:x1830960573595776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 121us (588us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140883.186771:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8525 00002000:00100000:2.0:1746140883.186776:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3006464->3010559) req@ffff88009f24c000 x1830960573595776/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.186783:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24c000 with x1830960573595776 ext(3006464->3010559) 00002000:00010000:2.0:1746140883.186786:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24c000 00000100:00100000:2.0:1746140883.190535:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.190579:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.190583:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573596032 00000100:00100000:0.0:1746140883.190602:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573596032 00000100:00100000:0.0:1746140883.190650:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4655 00000100:00100000:0.0:1746140883.190658:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:32521:x1830960573596032:12345-192.168.204.16@tcp:35:multiop.0 00002000:00010000:1.0:1746140883.190690:0:8458:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140882 -> 1746140883 00002000:00010000:1.0:1746140883.190695:0:8458:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140882 -> 1746140883 00002000:00010000:1.0:1746140883.190696:0:8458:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140882 -> 1746140883 00000100:00100000:1.0:1746140883.190718:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000512:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140883.190754:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb95e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ff6 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.190767:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb95e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ff6 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.190781:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fcd3600, rc 0) 00000100:00100000:1.0:1746140883.190826:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573595136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5101us (5276us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.190833:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16621 00000100:00100000:0.0:1746140883.190848:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:32521:x1830960573596032:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 190us (325us total) trans 8589944932 rc 0/0 00000100:00100000:1.0:1746140883.190854:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573596160 00000100:00100000:0.0:1746140883.190854:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4655 00000100:00100000:1.0:1746140883.190859:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573596160 00000100:00100000:1.0:1746140883.190881:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16622 00000100:00100000:1.0:1746140883.190886:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32512:x1830960573596160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140883.190897:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.190909:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1004 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.190930:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.190937:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.190939:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.190943:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->2924543] (req 2097152->2924543) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 13 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.191025:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.191037:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.191049:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000640:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.192017:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.196449:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.196557:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573596288 00000100:00100000:3.0:1746140883.196567:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573596288 00002000:00100000:3.0:1746140883.196610:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2772992->3010559) req@ffff88009f24c380 x1830960573596288/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.196621:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24c380 with x1830960573596288 ext(2772992->3010559) 00010000:00010000:3.0:1746140883.196630:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 17 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.196644:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 17 pid: 4784 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.196651:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f24c380 00000100:00100000:3.0:1746140883.196669:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1762 00000100:00100000:3.0:1746140883.196675:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960573596288:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140883.197170:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576000640:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.197199:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->2924543] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 13 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.197213:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac1000, rc 0) 00000100:00100000:1.0:1746140883.197239:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32512:x1830960573596160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6353us (6660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.197246:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16622 00000100:00100000:0.0:1746140883.197510:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.197686:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573596544 00000100:00100000:3.0:1746140883.197690:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573596544 00002000:00100000:3.0:1746140883.197707:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f24ca80 x1830960573596544/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.197716:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ca80 with x1830960573596544 ext(4194304->4886527) 00002000:00010000:3.0:1746140883.197719:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24ca80 00000100:00100000:3.0:1746140883.198059:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8526 00000100:00100000:3.0:1746140883.198065:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573596544:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140883.200899:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960573596288:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4212us (4452us total) trans 21474841316 rc 0/0 00000100:00100000:2.0:1746140883.200911:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1762 00002000:00100000:2.0:1746140883.200924:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2772992->3010559) req@ffff88009f24c380 x1830960573596288/t21474841316(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.200933:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24c380 with x1830960573596288 ext(2772992->3010559) 00010000:00010000:2.0:1746140883.200943:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.200963:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.200970:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f24c380 00000100:00100000:0.0:1746140883.205195:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.205295:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573596672 00000100:00100000:3.0:1746140883.205351:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573596672 00010000:00010000:3.0:1746140883.205405:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.205442:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8601 00000100:00100000:3.0:1746140883.205450:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573596672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.205464:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.205486:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.205498:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.205521:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff15e00/0x8156357b7fdb95b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2772992->3010559] (req 2772992->3010559) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fcc expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.205551:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.205553:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.205560:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.205573:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.205606:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.205618:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576000768:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140883.205709:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.206998:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573596544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8928us (9483us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140883.207009:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8526 00002000:00100000:2.0:1746140883.207020:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f24ca80 x1830960573596544/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.207030:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ca80 with x1830960573596544 ext(4194304->4886527) 00002000:00010000:2.0:1746140883.207035:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24ca80 00000100:00100000:3.0:1746140883.208640:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576000768:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140883.208672:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.208745:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960573596672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3295us (3557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.208756:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8601 00000100:00100000:0.0:1746140883.210008:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.210086:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573596800 00000100:00100000:1.0:1746140883.210096:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573596800 00000100:00100000:1.0:1746140883.210186:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16623 00000100:00100000:1.0:1746140883.210441:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573596800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.210544:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.210562:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eac0e00/0x8156357b7fdb95f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a100b expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.210597:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eac0e00/0x8156357b7fdb95f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a100b expref: 14 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.210607:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eac0e00/0x8156357b7fdb95f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a100b expref: 14 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.210626:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac0e00, rc 0) 00000100:00100000:1.0:1746140883.210659:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573596800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 465us (657us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.211387:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16623 00000100:00100000:0.0:1746140883.212521:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.212569:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573596928 00000100:00100000:1.0:1746140883.212575:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573596928 00000100:00100000:1.0:1746140883.212616:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16624 00000100:00100000:1.0:1746140883.212623:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573596928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.212635:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.212647:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eac1400/0x8156357b7fdb95fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1012 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.212670:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eac1400/0x8156357b7fdb95fe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1012 expref: 14 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.212678:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1400/0x8156357b7fdb95fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1012 expref: 14 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.212688:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac1400, rc 0) 00000100:00100000:1.0:1746140883.212728:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573596928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (209us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.212733:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16624 00000100:00100000:0.0:1746140883.216291:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.216604:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.216735:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573597184 00000100:00100000:2.0:1746140883.216746:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573597184 00000100:00100000:3.0:1746140883.216751:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573597440 00000100:00100000:3.0:1746140883.216755:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573597440 00002000:00100000:2.0:1746140883.216789:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2920448->2924543) req@ffff88009f24df80 x1830960573597184/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.216797:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24df80 with x1830960573597184 ext(2920448->2924543) 00000100:00100000:3.0:1746140883.216801:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4656 00002000:00010000:2.0:1746140883.216801:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24df80 00000100:00100000:3.0:1746140883.216809:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32519:x1830960573597440:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140883.216813:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8527 00000100:00100000:2.0:1746140883.216817:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573597184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140883.217037:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32519:x1830960573597440:12345-192.168.204.16@tcp:35:cat.0 Request processed in 228us (433us total) trans 8589944933 rc 0/0 00000100:00100000:3.0:1746140883.217044:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4656 00000100:00100000:2.0:1746140883.217789:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573597184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 969us (1506us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140883.217797:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8527 00002000:00100000:2.0:1746140883.217805:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2920448->2924543) req@ffff88009f24df80 x1830960573597184/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.217814:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24df80 with x1830960573597184 ext(2920448->2924543) 00002000:00010000:2.0:1746140883.217818:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24df80 00000100:00100000:0.0:1746140883.222215:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.222346:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573597696 00000100:00100000:3.0:1746140883.222358:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573597696 00000100:00100000:3.0:1746140883.222425:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4657 00000100:00100000:3.0:1746140883.222433:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32512:x1830960573597696:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140883.222676:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32512:x1830960573597696:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 244us (468us total) trans 8589944934 rc 0/0 00000100:00100000:3.0:1746140883.222683:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4657 00000100:00100000:0.0:1746140883.306300:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.307657:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573597952 00000100:00100000:2.0:1746140883.307668:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573597952 00000100:00100000:2.0:1746140883.307733:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10652 00000100:00100000:2.0:1746140883.307741:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:32529:x1830960573597952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.307765:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.307783:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef200/0x8156357b7fdb9605 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1019 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.307886:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.307899:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.307908:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.307920:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.307925:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.307930:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308034:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308046:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308052:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140883.308065:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.308156:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308162:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308167:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308172:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008feeec00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.308176:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308181:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308190:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.308193:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.308197:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308201:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdb960c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308231:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308239:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308244:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308248:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008feee800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.308251:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308255:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308261:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293f00) 00010000:00010000:2.0:1746140883.308264:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.308266:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308270:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee800/0x8156357b7fdb9613 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.308487:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef200/0x8156357b7fdb9605 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 285 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.308500:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 284 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.308507:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.308509:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140883.308511:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008feefe00, rc 0) 00000100:00100000:2.0:1746140883.308564:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:32529:x1830960573597952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 824us (2275us total) trans 8589944935 rc 0/0 00000100:00100000:2.0:1746140883.308571:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10652 00000100:00100000:0.0:1746140883.311049:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.311102:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.311114:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573598080 00000100:00100000:2.0:1746140883.311123:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573598080 00000100:00100000:2.0:1746140883.311183:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573598208 00000100:00100000:2.0:1746140883.311185:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573598208 00000100:00100000:2.0:1746140883.311922:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16625 00000100:00100000:2.0:1746140883.311931:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573598080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.311947:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.311964:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008feee400/0x8156357b7fdb9628 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1020 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.311995:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16626 00000100:00100000:3.0:1746140883.312003:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573598208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140883.312009:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.312015:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb962f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1027 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.312015:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576000896:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140883.312030:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb962f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1027 expref: 21 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.312037:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb962f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1027 expref: 21 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.312047:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009963fc00, rc 0) 00000100:00100000:3.0:1746140883.312239:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573598208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 236us (1135us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140883.312245:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16626 00000100:00100000:2.0:1746140883.312258:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538780 going to sleep for 11 seconds 00000100:00100000:3.0:1746140883.315017:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576000896:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140883.315048:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008feee400/0x8156357b7fdb9628 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1020 expref: 19 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.315062:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008feee400/0x8156357b7fdb9628 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1020 expref: 19 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.315076:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008feee400, rc 0) 00000100:00100000:3.0:1746140883.315113:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960573598080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3183us (4074us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140883.315121:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16625 00000100:00100000:0.0:1746140883.321286:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.321438:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573598336 00000100:00100000:3.0:1746140883.321447:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573598336 00000100:00100000:3.0:1746140883.321732:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16627 00000100:00100000:3.0:1746140883.321740:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:32529:x1830960573598336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140883.321755:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.321772:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a102e expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.321803:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.321810:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140883.321812:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140883.321815:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 19 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.321843:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.321854:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 12 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.321871:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576001024:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.322350:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.324180:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.324274:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573598464 00000100:00100000:2.0:1746140883.324283:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573598464 00002000:00100000:2.0:1746140883.324337:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1941504->2097151) req@ffff88009f24fb80 x1830960573598464/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.324348:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24fb80 with x1830960573598464 ext(1941504->2097151) 00010000:00010000:2.0:1746140883.324356:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.324370:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.324376:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f24fb80 00000100:00100000:2.0:1746140883.324394:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1763 00000100:00100000:2.0:1746140883.324402:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573598464:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140883.324780:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576001024:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140883.324800:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 19 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.324814:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009963fc00, rc 0) 00000100:00100000:3.0:1746140883.324836:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:32529:x1830960573598336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3097us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.324842:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16627 00000100:00100000:2.0:1746140883.327949:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573598464:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3537us (3765us total) trans 21474841317 rc 0/0 00000100:00100000:2.0:1746140883.327962:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1763 00002000:00100000:2.0:1746140883.327974:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1941504->2097151) req@ffff88009f24fb80 x1830960573598464/t21474841317(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.327984:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24fb80 with x1830960573598464 ext(1941504->2097151) 00010000:00010000:2.0:1746140883.327993:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.328008:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.328022:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f24fb80 00000100:00100000:0.0:1746140883.331806:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.331905:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573598592 00000100:00100000:3.0:1746140883.331915:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573598592 00010000:00010000:3.0:1746140883.331951:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.331980:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8602 00000100:00100000:3.0:1746140883.331987:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573598592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.332000:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.332024:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.332035:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.332061:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930e9c00/0x8156357b7fdb95db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fef expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.332649:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.332652:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.332660:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 18 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.332670:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 18 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.332704:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 18 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.332717:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576001152:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140883.332798:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140883.336512:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576001152:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140883.336538:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.336578:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960573598592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4591us (4781us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.336587:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8602 00000100:00100000:0.0:1746140883.336985:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.337070:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573598848 00000100:00100000:3.0:1746140883.337076:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573598848 00002000:00100000:3.0:1746140883.337106:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880094add500 x1830960573598848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.337121:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094add500 with x1830960573598848 ext(1048576->2097151) 00002000:00010000:3.0:1746140883.337125:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094add500 00000100:00100000:3.0:1746140883.337147:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8528 00000100:00100000:3.0:1746140883.337152:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573598848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140883.346060:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.346167:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573599104 00000100:00100000:2.0:1746140883.346176:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573599104 00000100:00100000:2.0:1746140883.346232:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10653 00000100:00100000:2.0:1746140883.346240:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32532:x1830960573599104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.346263:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.346281:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009396ea00/0x8156357b7fdb963d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1035 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.346429:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346441:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346451:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346464:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346470:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346475:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346578:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346586:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346591:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140883.346599:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.346674:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346679:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346685:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346690:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008feee400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.346694:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346701:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346711:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.346713:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.346717:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346721:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feee400/0x8156357b7fdb9644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346748:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346753:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346758:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346761:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008feefa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.346763:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346768:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346773:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293900) 00010000:00010000:2.0:1746140883.346775:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.346778:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346782:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefa00/0x8156357b7fdb964b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.346817:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009396ea00/0x8156357b7fdb963d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 21 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.346829:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 20 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.346836:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.346837:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140883.346840:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b48a0600, rc 0) 00000100:00100000:2.0:1746140883.346887:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32532:x1830960573599104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 649us (838us total) trans 8589944936 rc 0/0 00000100:00100000:2.0:1746140883.346894:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10653 00000100:00100000:0.0:1746140883.349654:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.350432:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.350531:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573599360 00000100:00100000:1.0:1746140883.350539:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573599360 00000100:00100000:1.0:1746140883.350576:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573599232 00000100:00100000:1.0:1746140883.350578:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573599232 00000100:00100000:1.0:1746140883.350653:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16628 00000100:00100000:1.0:1746140883.350661:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573599360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.350675:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.350691:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eac1600/0x8156357b7fdb9660 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1043 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.350720:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eac1600/0x8156357b7fdb9660 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1043 expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.350730:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1600/0x8156357b7fdb9660 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1043 expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.350749:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac1600, rc 0) 00000100:00100000:1.0:1746140883.350793:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573599360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 133us (1148us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.350798:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16628 00000100:00100000:1.0:1746140883.350812:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16629 00000100:00100000:1.0:1746140883.350817:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573599232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.350823:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.350829:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a103c expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.350843:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.350845:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.350853:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 15 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.350865:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 15 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.350873:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac1a00, rc 0) 00000100:00100000:1.0:1746140883.350889:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573599232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 72us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.350894:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16629 00000100:00100000:3.0:1746140883.351850:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573598848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14692us (14861us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.351859:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8528 00002000:00100000:3.0:1746140883.351869:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880094add500 x1830960573598848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.351880:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094add500 with x1830960573598848 ext(1048576->2097151) 00002000:00010000:3.0:1746140883.351884:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094add500 00000100:00100000:0.0:1746140883.359288:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.359395:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573599488 00000100:00100000:2.0:1746140883.359404:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573599488 00000100:00100000:0.0:1746140883.359423:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.359449:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16630 00000100:00100000:2.0:1746140883.359455:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:32529:x1830960573599488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.359472:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140883.359617:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573599744 00000100:00100000:3.0:1746140883.359621:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573599744 00010000:00010000:2.0:1746140883.359711:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a104a expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140883.359789:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880094aded80 x1830960573599744/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746140883.359789:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 15 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.359796:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140883.359798:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00002000:00100000:3.0:1746140883.359799:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094aded80 with x1830960573599744 ext(1048576->2097151) 00010000:00010000:2.0:1746140883.359802:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 20 pid: 8458 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140883.359803:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094aded80 00010000:00010000:2.0:1746140883.359837:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 15 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.359848:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 15 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.359859:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576001280:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.359887:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8529 00000100:00100000:3.0:1746140883.359893:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573599744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140883.360063:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.362110:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576001280:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.362146:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 20 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.362160:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009396ea00, rc 0) 00000100:00100000:2.0:1746140883.362390:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:32529:x1830960573599488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2931us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.362398:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16630 00000100:00100000:1.0:1746140883.362526:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.362835:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573599872 00000100:00100000:1.0:1746140883.362841:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573599872 00002000:00100000:1.0:1746140883.362873:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2924543) req@ffff8800948f9880 x1830960573599872/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140883.362882:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948f9880 with x1830960573599872 ext(2097152->2924543) 00010000:00010000:1.0:1746140883.362888:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 17 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.362902:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 17 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:1.0:1746140883.362908:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800948f9880 00000100:00100000:1.0:1746140883.362930:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1764 00000100:00100000:1.0:1746140883.362937:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573599872:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140883.368105:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573599744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8199us (8669us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.368118:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8529 00002000:00100000:3.0:1746140883.368298:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880094aded80 x1830960573599744/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.368324:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094aded80 with x1830960573599744 ext(1048576->2097151) 00002000:00010000:3.0:1746140883.368330:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094aded80 00000100:00100000:3.0:1746140883.373797:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573599872:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10848us (11258us total) trans 21474841318 rc 0/0 00000100:00100000:3.0:1746140883.373811:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1764 00002000:00100000:3.0:1746140883.373822:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2924543) req@ffff8800948f9880 x1830960573599872/t21474841318(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.373831:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948f9880 with x1830960573599872 ext(2097152->2924543) 00010000:00010000:3.0:1746140883.373840:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 17 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.373856:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 17 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.373863:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800948f9880 00000100:00100000:0.0:1746140883.374963:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.375042:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573600000 00000100:00100000:2.0:1746140883.375050:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573600000 00000100:00100000:2.0:1746140883.375144:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16631 00000100:00100000:2.0:1746140883.375151:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32532:x1830960573600000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.375165:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.375179:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1051 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.375208:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140883.375213:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.375222:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.375232:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009243f800, rc 0) 00000100:00100000:2.0:1746140883.375545:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32532:x1830960573600000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 394us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.375551:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16631 00000100:00100000:0.0:1746140883.380531:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.380653:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573600128 00000100:00100000:3.0:1746140883.380662:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573600128 00010000:00010000:3.0:1746140883.380696:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.380736:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8603 00000100:00100000:3.0:1746140883.380743:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573600128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.380757:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.380781:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.380793:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.380815:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1000/0x8156357b7fdb95f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->3006463] (req 2097152->2924543) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1004 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.380845:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.380846:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.380853:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 19 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.380861:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 19 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.380869:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.380870:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.380873:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.380880:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.380908:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.380920:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576001408:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140883.381026:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 19 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.381034:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576001536:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140883.381054:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.384726:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.384798:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573600384 00000100:00100000:2.0:1746140883.384806:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573600384 00002000:00100000:2.0:1746140883.384848:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2924544->3145727) req@ffff880094addf80 x1830960573600384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.384859:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094addf80 with x1830960573600384 ext(2924544->3145727) 00002000:00010000:2.0:1746140883.384864:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094addf80 00000100:00100000:2.0:1746140883.384884:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8530 00000100:00100000:2.0:1746140883.384891:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573600384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140883.385116:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576001408:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140883.385136:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576001536:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140883.385155:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.385596:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1983:x1830960573600128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4851us (5072us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.385605:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8603 00000100:00100000:2.0:1746140883.387105:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573600384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2212us (2386us total) trans 0 rc 221184/221184 00000100:00100000:2.0:1746140883.387114:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8530 00002000:00100000:2.0:1746140883.387122:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2924544->3145727) req@ffff880094addf80 x1830960573600384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 221184/221184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.387146:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094addf80 with x1830960573600384 ext(2924544->3145727) 00002000:00010000:2.0:1746140883.387151:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094addf80 00000100:00100000:0.0:1746140883.390226:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.390274:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.390419:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573600768 00000100:00100000:1.0:1746140883.390428:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573600768 00002000:00100000:1.0:1746140883.390470:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880094adf480 x1830960573600768/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140883.390480:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adf480 with x1830960573600768 ext(3145728->4194303) 00002000:00010000:1.0:1746140883.390485:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094adf480 00000100:00100000:1.0:1746140883.390517:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573600640 00000100:00100000:1.0:1746140883.390520:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573600640 00002000:00100000:1.0:1746140883.390531:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880094ade680 x1830960573600640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140883.390538:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ade680 with x1830960573600640 ext(2097152->3145727) 00002000:00010000:1.0:1746140883.390540:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ade680 00000100:00100000:1.0:1746140883.390552:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8531 00000100:00100000:1.0:1746140883.390559:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573600768:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140883.391654:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8532 00000100:00100000:2.0:1746140883.391663:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573600640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140883.408565:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.409037:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573601152 00000100:00100000:3.0:1746140883.409049:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573601152 00000100:00100000:1.0:1746140883.409065:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573600768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18505us (18848us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140883.409075:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8531 00000100:00100000:3.0:1746140883.409118:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4658 00000100:00100000:3.0:1746140883.409151:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32532:x1830960573601152:12345-192.168.204.16@tcp:35:cat.0 00002000:00100000:1.0:1746140883.409637:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880094adf480 x1830960573600768/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140883.409646:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adf480 with x1830960573600768 ext(3145728->4194303) 00002000:00010000:1.0:1746140883.409652:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094adf480 00000100:00100000:3.0:1746140883.410507:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32532:x1830960573601152:12345-192.168.204.16@tcp:35:cat.0 Request processed in 1379us (1947us total) trans 8589944937 rc 0/0 00000100:00100000:3.0:1746140883.410516:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4658 00000100:00100000:2.0:1746140883.411414:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573600640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19750us (21137us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140883.411422:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8532 00002000:00100000:2.0:1746140883.411431:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880094ade680 x1830960573600640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.411440:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ade680 with x1830960573600640 ext(2097152->3145727) 00002000:00010000:2.0:1746140883.411445:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ade680 00000100:00100000:0.0:1746140883.417983:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.418040:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573601408 00000100:00100000:2.0:1746140883.418049:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573601408 00002000:00100000:2.0:1746140883.418088:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4206591) req@ffff880094addc00 x1830960573601408/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.418098:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094addc00 with x1830960573601408 ext(4194304->4206591) 00002000:00010000:2.0:1746140883.418102:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094addc00 00000100:00100000:2.0:1746140883.418140:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8533 00000100:00100000:2.0:1746140883.418146:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573601408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140883.418358:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573601408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 211us (383us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1746140883.418365:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8533 00002000:00100000:2.0:1746140883.418371:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4206591) req@ffff880094addc00 x1830960573601408/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/12728 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 12288/12288 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.418378:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094addc00 with x1830960573601408 ext(4194304->4206591) 00002000:00010000:2.0:1746140883.418381:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094addc00 00000100:00100000:0.0:1746140883.424632:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.426086:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573601664 00000100:00100000:3.0:1746140883.426097:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573601664 00000100:00100000:3.0:1746140883.426165:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4659 00000100:00100000:3.0:1746140883.426172:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:32529:x1830960573601664:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140883.426586:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.426630:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573601920 00000100:00100000:2.0:1746140883.426634:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573601920 00000100:00100000:2.0:1746140883.426673:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10654 00000100:00100000:2.0:1746140883.426679:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:32535:x1830960573601920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140883.426689:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.426707:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009243fa00/0x8156357b7fdb967c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1058 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.426779:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.426793:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.426800:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 287 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.426806:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 20 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.426812:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00000100:00100000:3.0:1746140883.426836:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:32529:x1830960573601664:12345-192.168.204.16@tcp:35:cat.0 Request processed in 663us (2214us total) trans 8589944938 rc 0/0 00010000:00010000:2.0:1746140883.426844:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 20 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.426847:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4659 00010000:00010000:2.0:1746140883.426860:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 20 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.426871:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576001664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.426929:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 286 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.426937:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 286 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.426945:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576001792:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.426969:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.426977:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 12 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.426985:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576001920:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140883.427007:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.428662:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.428693:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.428724:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.428908:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573602176 00000100:00100000:1.0:1746140883.428919:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573602176 00010000:00010000:1.0:1746140883.428958:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 287 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.428998:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573602048 00000100:00100000:1.0:1746140883.429001:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573602048 00010000:00010000:1.0:1746140883.429010:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 21 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.429022:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573602304 00000100:00100000:1.0:1746140883.429024:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573602304 00010000:00010000:1.0:1746140883.429030:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 13 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.429042:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8604 00000100:00100000:1.0:1746140883.429048:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1985:x1830960573602176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.429059:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.429063:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 287 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.429067:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8605 00010000:00010000:1.0:1746140883.429073:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 287 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.429077:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8606 00000100:00100000:2.0:1746140883.429078:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573602048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140883.429086:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573602304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.429091:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.429092:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.429094:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.429096:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.429100:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 13 pid: 14741 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.429100:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 21 pid: 14741 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.429103:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.429108:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140883.429111:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 13 pid: 14741 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.429121:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 21 pid: 14741 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.429154:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.429158:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.429167:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14743 initiator: MDT0 00000100:00100000:1.0:1746140883.429169:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1985:x1830960573602176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (514us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140883.429173:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14743 initiator: MDT0 00000100:00100000:1.0:1746140883.429175:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8604 00010000:00010000:2.0:1746140883.429180:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.429183:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140883.429188:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.429211:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573602304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.429211:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573602048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 136us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.429218:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8605 00000100:00100000:3.0:1746140883.429221:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8606 00010000:00010000:2.0:1746140883.429259:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0600/0x8156357b7fdb9652 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1035 expref: 20 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.429283:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576001664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.429295:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feefe00/0x8156357b7fdb961a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1019 expref: 286 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.429320:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576001792:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.429331:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53ada00/0x8156357b7fdb9595 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fb0 expref: 12 pid: 14741 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.429340:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576001920:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.429356:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.429364:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.429369:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:2.0:1746140883.429386:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.429506:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009243fa00/0x8156357b7fdb967c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 287 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.429519:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 286 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.429525:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.429527:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140883.429529:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940a7e00, rc 0) 00000100:00100000:2.0:1746140883.429569:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:32535:x1830960573601920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2889us (2982us total) trans 8589944939 rc 0/0 00000100:00100000:2.0:1746140883.429576:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10654 00000100:00100000:0.0:1746140883.440474:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.440623:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573602432 00000100:00100000:2.0:1746140883.440633:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573602432 00000100:00100000:2.0:1746140883.440706:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16632 00000100:00100000:2.0:1746140883.440714:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:32535:x1830960573602432:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140883.440729:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.440748:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a105f expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.440776:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.440784:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 7 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.440794:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.440799:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.440800:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.440803:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1253376->1523711] (req 1253376->1523711) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.440830:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00000100:00080000:0.0:1746140883.440913:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746140883.440973:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 27 pid: 9872 timeout: 962 lvb_type: 1 00000100:00100000:2.0:1746140883.440985:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576002048:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.441093:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 7 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.441101:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 7 pid: 8459 timeout: 962 lvb_type: 1 00000100:00100000:2.0:1746140883.441109:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576002176:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.441149:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.441160:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 9 pid: 12255 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.441168:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576002304:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140883.441388:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.443358:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.443506:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573602688 00000100:00100000:2.0:1746140883.443514:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573602688 00000100:00100000:2.0:1746140883.443554:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10655 00000100:00100000:2.0:1746140883.443561:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32538:x1830960573602688:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140883.443582:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.444023:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009243fa00/0x8156357b7fdb9698 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1066 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.444143:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444154:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444163:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444176:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444182:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444186:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444285:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e200/0x8156357b7fdb96ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444292:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e200/0x8156357b7fdb96ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444298:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e200/0x8156357b7fdb96ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:2.0:1746140883.444323:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.444404:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444410:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444415:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444420:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009243ee00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.444423:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444428:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444437:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.444440:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.444443:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444447:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009243ee00/0x8156357b7fdb969f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444466:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444471:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444476:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444479:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013105e000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.444482:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444486:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444491:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293400) 00010000:00010000:2.0:1746140883.444493:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.444494:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444498:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e000/0x8156357b7fdb96a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.444530:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009243fa00/0x8156357b7fdb9698 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1066 expref: 23 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.444541:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e200/0x8156357b7fdb96ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1066 expref: 22 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.444547:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.444549:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140883.444551:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013105e200, rc 0) 00000100:00100000:2.0:1746140883.445392:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32538:x1830960573602688:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1827us (2037us total) trans 8589944940 rc 0/0 00000100:00100000:2.0:1746140883.445401:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10655 00000100:00100000:1.0:1746140883.445830:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.445859:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.445885:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.445903:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573602816 00000100:00100000:1.0:1746140883.445909:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573602816 00010000:00010000:1.0:1746140883.445951:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 10 pid: 12255 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.445970:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573602944 00000100:00100000:1.0:1746140883.445972:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573602944 00010000:00010000:1.0:1746140883.445982:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 8 pid: 8459 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.445993:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573603072 00000100:00100000:1.0:1746140883.445994:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573603072 00010000:00010000:1.0:1746140883.446003:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 28 pid: 9872 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.446015:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8607 00000100:00100000:1.0:1746140883.446021:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573602816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.446031:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.446049:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 10 pid: 12255 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.446057:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 10 pid: 12255 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.446075:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.446104:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573602816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.446110:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8607 00000100:00100000:1.0:1746140883.446120:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8608 00000100:00100000:1.0:1746140883.446124:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573602944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1746140883.446134:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746140883.446141:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.446148:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 8 pid: 8459 timeout: 962 lvb_type: 1 00000100:00100000:0.0:1746140883.446149:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8609 00010000:00010000:1.0:1746140883.446156:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 8 pid: 8459 timeout: 962 lvb_type: 1 00000100:00100000:0.0:1746140883.446156:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573603072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140883.446161:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.446166:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140883.446168:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 28 pid: 9872 timeout: 962 lvb_type: 1 00010000:00010000:0.0:1746140883.446177:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 28 pid: 9872 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.446178:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573602944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.446183:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8608 00010000:00010000:0.0:1746140883.446188:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.446190:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.446196:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.446203:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.446229:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140883.446241:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576002432:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140883.446297:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6240 going to sleep for 11 seconds 00010000:00010000:2.0:1746140883.446401:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdb941b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ee5 expref: 28 pid: 9872 timeout: 962 lvb_type: 1 00000100:00100000:2.0:1746140883.446415:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576002048:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.446426:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009454ca00/0x8156357b7fdb94fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f78 expref: 7 pid: 8459 timeout: 962 lvb_type: 1 00000100:00100000:2.0:1746140883.446433:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576002176:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.446445:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdb93ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec9 expref: 9 pid: 12255 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.446452:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576002304:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.446474:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.446482:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940a7800, rc 0) 00000100:00100000:2.0:1746140883.446512:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:32535:x1830960573602432:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5799us (6051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.446518:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16632 00000100:00100000:0.0:1746140883.449271:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.449415:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573603200 00000100:00100000:3.0:1746140883.449424:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573603200 00000100:00100000:3.0:1746140883.449523:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 762 00000100:00100000:3.0:1746140883.449531:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573603200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.449546:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.449569:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013105e200/0x8156357b7fdb96ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1066 expref: 22 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.449587:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.449592:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.449990:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573603200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 458us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.449996:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 762 00000100:00100000:2.0:1746140883.450620:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576002432:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140883.450645:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.450706:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573603072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4548us (4816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.450714:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8609 00000100:00100000:0.0:1746140883.450776:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.451036:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573603456 00000100:00100000:2.0:1746140883.451044:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573603456 00002000:00100000:2.0:1746140883.451086:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1253376->1257471) req@ffff880094adfb80 x1830960573603456/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.451095:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adfb80 with x1830960573603456 ext(1253376->1257471) 00002000:00010000:2.0:1746140883.451099:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094adfb80 00000100:00100000:2.0:1746140883.451139:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8534 00000100:00100000:2.0:1746140883.451148:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573603456:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140883.451550:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573603456:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 401us (772us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140883.451557:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8534 00002000:00100000:2.0:1746140883.451564:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1253376->1257471) req@ffff880094adfb80 x1830960573603456/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.451570:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adfb80 with x1830960573603456 ext(1253376->1257471) 00002000:00010000:2.0:1746140883.451574:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094adfb80 00000100:00100000:1.0:1746140883.457626:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.457760:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573603712 00000100:00100000:2.0:1746140883.457772:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573603712 00002000:00100000:2.0:1746140883.457821:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1519616->1523711) req@ffff8800a6bad880 x1830960573603712/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.457831:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bad880 with x1830960573603712 ext(1519616->1523711) 00002000:00010000:2.0:1746140883.457839:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6bad880 00000100:00100000:2.0:1746140883.457886:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8535 00000100:00100000:2.0:1746140883.457896:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573603712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140883.458437:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573603712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 539us (820us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140883.458445:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8535 00002000:00100000:2.0:1746140883.458453:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1519616->1523711) req@ffff8800a6bad880 x1830960573603712/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.458460:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bad880 with x1830960573603712 ext(1519616->1523711) 00002000:00010000:2.0:1746140883.458464:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6bad880 00000100:00100000:0.0:1746140883.509010:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.511040:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573603840 00000100:00100000:2.0:1746140883.511053:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573603840 00000100:00100000:1.0:1746140883.511481:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16633 00000100:00100000:1.0:1746140883.511491:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32538:x1830960573603840:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140883.511508:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.511529:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a106d expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.511557:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 18 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.511566:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 5 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.511573:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.511579:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.511580:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.511583:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [81920->745471] (req 81920->745471) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.511613:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.511624:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 19 pid: 4782 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.511634:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576002560:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.511737:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 5 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.511745:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 5 pid: 8460 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.511752:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576002688:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.511780:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 18 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.511787:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.511794:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576002816:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.511809:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.515911:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.516069:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576002560:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.516081:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576002688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.516099:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576002816:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.516142:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [81920->745471] (req 81920->745471) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.516158:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4182400, rc 0) 00000100:00100000:1.0:1746140883.516209:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32538:x1830960573603840:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4720us (7209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.516218:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16633 00000100:00100000:2.0:1746140883.517069:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573603968 00000100:00100000:2.0:1746140883.517076:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573603968 00010000:00010000:2.0:1746140883.517104:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 6 pid: 8460 timeout: 962 lvb_type: 1 00000100:00100000:2.0:1746140883.517150:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8610 00000100:00100000:2.0:1746140883.517157:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573603968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140883.517168:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.517191:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 6 pid: 8460 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.517201:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 6 pid: 8460 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.517226:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ac874c00/0x8156357b7fdb94f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f6a expref: 6 pid: 8460 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.517242:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.517270:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+5:1983:x1830960573603968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 115us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.517277:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8610 00000100:00100000:2.0:1746140883.517379:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.517414:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573604096 00000100:00100000:3.0:1746140883.517417:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573604096 00010000:00010000:3.0:1746140883.517433:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 20 pid: 4782 timeout: 962 lvb_type: 1 00000100:00100000:0.0:1746140883.517619:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.517894:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573604224 00000100:00100000:3.0:1746140883.517898:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573604224 00010000:00010000:3.0:1746140883.517911:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.517948:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8611 00000100:00100000:2.0:1746140883.517954:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573604096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140883.517995:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8612 00010000:00010000:2.0:1746140883.518064:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.518076:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 20 pid: 4782 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.518085:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 20 pid: 4782 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.518096:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a815c00/0x8156357b7fdb9414 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ed7 expref: 20 pid: 4782 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.518105:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.518134:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573604096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 171us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.518139:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8611 00000100:00100000:1.0:1746140883.518208:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573604224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.518216:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.518228:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.518236:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.518248:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecb8c00/0x8156357b7fdb93b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0eb4 expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.518261:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.518262:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.518269:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.518276:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.518329:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.518341:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576002944:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.518385:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.521094:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576002944:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.521101:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140883.521117:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.521176:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1983:x1830960573604224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3173us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.521185:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8612 00000100:00100000:3.0:1746140883.521265:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573604480 00000100:00100000:3.0:1746140883.521271:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573604480 00002000:00100000:3.0:1746140883.521327:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (81920->86015) req@ffff8800a6baf480 x1830960573604480/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.521336:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baf480 with x1830960573604480 ext(81920->86015) 00002000:00010000:3.0:1746140883.521341:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baf480 00000100:00100000:3.0:1746140883.521368:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8536 00000100:00100000:3.0:1746140883.521375:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573604480:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140883.522080:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573604480:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 705us (979us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140883.522087:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8536 00002000:00100000:3.0:1746140883.522093:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (81920->86015) req@ffff8800a6baf480 x1830960573604480/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.522100:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baf480 with x1830960573604480 ext(81920->86015) 00002000:00010000:3.0:1746140883.522103:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baf480 00000100:00100000:0.0:1746140883.529403:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.529582:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573604736 00000100:00100000:3.0:1746140883.529591:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573604736 00002000:00100000:3.0:1746140883.529633:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (741376->745471) req@ffff880093134380 x1830960573604736/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.529643:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093134380 with x1830960573604736 ext(741376->745471) 00002000:00010000:3.0:1746140883.529648:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093134380 00000100:00100000:3.0:1746140883.529675:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8537 00000100:00100000:3.0:1746140883.529682:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573604736:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140883.529893:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573604736:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 211us (500us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140883.529900:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8537 00002000:00100000:3.0:1746140883.529906:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (741376->745471) req@ffff880093134380 x1830960573604736/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.529913:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093134380 with x1830960573604736 ext(741376->745471) 00002000:00010000:3.0:1746140883.529916:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093134380 00000100:00100000:0.0:1746140883.532646:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.533239:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573604992 00000100:00100000:3.0:1746140883.533249:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573604992 00000100:00100000:3.0:1746140883.533321:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4660 00000100:00100000:3.0:1746140883.533329:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32538:x1830960573604992:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140883.533578:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32538:x1830960573604992:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 249us (938us total) trans 8589944941 rc 0/0 00000100:00100000:3.0:1746140883.533584:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4660 00000100:00100000:0.0:1746140883.544636:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.545687:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573605248 00000100:00100000:2.0:1746140883.545698:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573605248 00000100:00100000:2.0:1746140883.545829:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10656 00000100:00100000:2.0:1746140883.545838:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:32543:x1830960573605248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.545862:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.545879:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7400/0x8156357b7fdb96c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1074 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.546166:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546179:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546188:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546200:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546205:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546209:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546298:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7200/0x8156357b7fdb96d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546321:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7200/0x8156357b7fdb96d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546327:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7200/0x8156357b7fdb96d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:2.0:1746140883.546335:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.546410:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546415:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546421:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546425:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940a7600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.546428:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546433:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546441:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.546443:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.546446:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546450:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7600/0x8156357b7fdb96c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546469:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546480:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546484:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546487:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940a6200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.546489:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546493:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546497:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293400) 00010000:00010000:2.0:1746140883.546499:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.546500:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546504:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a6200/0x8156357b7fdb96d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.546538:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7400/0x8156357b7fdb96c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1074 expref: 289 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.546548:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7200/0x8156357b7fdb96d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1074 expref: 288 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.546554:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.546556:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140883.546558:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940a7200, rc 0) 00000100:00100000:2.0:1746140883.546617:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:32543:x1830960573605248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 780us (1993us total) trans 8589944942 rc 0/0 00000100:00100000:2.0:1746140883.546624:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10656 00000100:00100000:0.0:1746140883.549870:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.549927:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.549943:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573605504 00000100:00100000:2.0:1746140883.549953:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573605504 00000100:00100000:1.0:1746140883.550037:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573605376 00000100:00100000:1.0:1746140883.550042:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573605376 00000100:00100000:1.0:1746140883.550075:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16634 00000100:00100000:1.0:1746140883.550082:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573605376:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140883.550085:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 763 00000100:00100000:2.0:1746140883.550092:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:1985:x1830960573605504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.550101:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.550105:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.550118:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb96e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a107b expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.550141:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7200/0x8156357b7fdb96d7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1074 expref: 288 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.550156:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.550160:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.550176:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576003072:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140883.550200:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1985:x1830960573605504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.550205:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 763 00000100:00100000:1.0:1746140883.550235:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746140883.552251:0:4784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime: 1746140882 -> 1746140884 00002000:00010000:1.0:1746140883.552258:0:4784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime: 1746140882 -> 1746140884 00002000:00010000:1.0:1746140883.552260:0:4784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime: 1746140882 -> 1746140884 00000100:00100000:1.0:1746140883.552283:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576003072:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140883.552342:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb96e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a107b expref: 20 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.552354:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009243fa00/0x8156357b7fdb96e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a107b expref: 20 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.552371:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009243fa00, rc 0) 00000100:00100000:1.0:1746140883.552415:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573605376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2333us (2486us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.552423:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16634 00000100:00100000:0.0:1746140883.554192:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.555096:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573605632 00000100:00100000:1.0:1746140883.555105:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573605632 00000100:00100000:1.0:1746140883.555492:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16635 00000100:00100000:1.0:1746140883.555501:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:32543:x1830960573605632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.555519:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.555537:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1082 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.555567:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.555580:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.555582:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.555585:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 20 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.555614:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.555626:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 16 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.555637:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576003200:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.556282:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140883.558004:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576003200:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.558030:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 20 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.558045:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4182000, rc 0) 00000100:00100000:1.0:1746140883.558145:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:32543:x1830960573605632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2644us (3960us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.558153:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16635 00000100:00100000:1.0:1746140883.560576:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.560670:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573605760 00000100:00100000:2.0:1746140883.560680:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573605760 00002000:00100000:2.0:1746140883.560723:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (81920->745471) req@ffff8800a6bace00 x1830960573605760/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.560733:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bace00 with x1830960573605760 ext(81920->745471) 00010000:00010000:2.0:1746140883.560742:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 17 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.560756:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 17 pid: 4784 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.560763:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6bace00 00000100:00100000:2.0:1746140883.560979:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1765 00000100:00100000:2.0:1746140883.560985:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573605760:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140883.567513:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573605760:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6518us (6939us total) trans 21474841319 rc 0/0 00000100:00100000:2.0:1746140883.567523:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1765 00002000:00100000:2.0:1746140883.567533:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (81920->745471) req@ffff8800a6bace00 x1830960573605760/t21474841319(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.567539:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bace00 with x1830960573605760 ext(81920->745471) 00010000:00010000:2.0:1746140883.567547:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.567560:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.567566:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6bace00 00000100:00100000:0.0:1746140883.569281:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.569395:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573605888 00000100:00100000:2.0:1746140883.569403:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573605888 00010000:00010000:2.0:1746140883.569433:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.570028:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8613 00000100:00100000:2.0:1746140883.570037:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573605888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140883.570051:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.570073:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.570091:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.570112:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4182400/0x8156357b7fdb96bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->745471) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a106d expref: 19 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.570172:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.570174:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.570182:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 19 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.570191:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 19 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.570221:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 19 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.570232:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576003328:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140883.570328:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.571340:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576003328:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140883.571358:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.571379:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573605888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1344us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.571387:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8613 00000100:00100000:0.0:1746140883.574880:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.574936:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.575093:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573606272 00000100:00100000:2.0:1746140883.575104:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573606272 00002000:00100000:2.0:1746140883.575156:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880093136a00 x1830960573606272/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.575166:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136a00 with x1830960573606272 ext(0->1048575) 00002000:00010000:2.0:1746140883.575171:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093136a00 00000100:00100000:2.0:1746140883.575187:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573606400 00000100:00100000:2.0:1746140883.575189:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573606400 00002000:00100000:2.0:1746140883.575205:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800a513d500 x1830960573606400/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 504/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.575212:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d500 with x1830960573606400 ext(1048576->2097151) 00002000:00010000:2.0:1746140883.575215:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513d500 00000100:00100000:2.0:1746140883.575235:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8538 00000100:00100000:2.0:1746140883.575242:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573606272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140883.575269:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8539 00000100:00100000:1.0:1746140883.575277:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573606400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140883.583838:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573606400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8550us (8890us total) trans 0 rc 778240/778240 00000100:00100000:1.0:1746140883.583851:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8539 00002000:00100000:1.0:1746140883.583863:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800a513d500 x1830960573606400/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 504/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140883.583873:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d500 with x1830960573606400 ext(1048576->2097151) 00002000:00010000:1.0:1746140883.583880:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513d500 00000100:00100000:0.0:1746140883.585359:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.585382:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573606656 00000100:00100000:2.0:1746140883.585392:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573606656 00000100:00100000:2.0:1746140883.585451:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10657 00000100:00100000:2.0:1746140883.585459:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:32545:x1830960573606656:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140883.585482:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.585505:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0x8156357b7fdb96f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1089 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.585631:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585645:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585655:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585670:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585676:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585681:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585798:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9708 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585807:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9708 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585813:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9708 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:2.0:1746140883.585821:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.585904:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585910:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585916:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585921:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2baa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.585925:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585930:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585940:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.585943:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.585947:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585951:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2baa00/0x8156357b7fdb96fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585977:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585982:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585985:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.585989:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8bee00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.585991:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.586060:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.586071:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293f00) 00010000:00010000:2.0:1746140883.586073:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.586075:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.586080:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb9701 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.586114:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0x8156357b7fdb96f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1089 expref: 290 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.586135:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9708 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1089 expref: 289 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.586142:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.586144:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140883.586146:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8bf000, rc 0) 00000100:00100000:2.0:1746140883.586957:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:32545:x1830960573606656:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1495us (1598us total) trans 8589944943 rc 0/0 00000100:00100000:2.0:1746140883.586964:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10657 00000100:00100000:3.0:1746140883.587479:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573606272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12235us (12608us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.587489:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8538 00002000:00100000:3.0:1746140883.587499:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880093136a00 x1830960573606272/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.587508:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136a00 with x1830960573606272 ext(0->1048575) 00002000:00010000:3.0:1746140883.587512:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093136a00 00000100:00100000:0.0:1746140883.590483:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.590540:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.590977:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573606912 00000100:00100000:2.0:1746140883.590986:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573606912 00000100:00100000:2.0:1746140883.591028:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4661 00000100:00100000:2.0:1746140883.591034:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:32545:x1830960573606912:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140883.591152:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573607040 00000100:00100000:3.0:1746140883.591156:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573607040 00000100:00100000:3.0:1746140883.591185:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 764 00000100:00100000:3.0:1746140883.591191:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:1984:x1830960573607040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.591205:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.591229:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9708 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1089 expref: 290 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.591265:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.591270:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.591343:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:1984:x1830960573607040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 151us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.591352:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 764 00000100:00100000:2.0:1746140883.591651:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:32545:x1830960573606912:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 616us (1178us total) trans 8589944944 rc 0/0 00000100:00100000:2.0:1746140883.591656:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4661 00000100:00100000:0.0:1746140883.609195:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.610050:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573607296 00000100:00100000:2.0:1746140883.610060:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573607296 00000100:00100000:2.0:1746140883.610104:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4662 00000100:00100000:2.0:1746140883.610111:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+289:32543:x1830960573607296:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140883.611282:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:32543:x1830960573607296:12345-192.168.204.16@tcp:35:cat.0 Request processed in 1164us (2091us total) trans 8589944945 rc 0/0 00000100:00100000:2.0:1746140883.611292:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4662 00000100:00100000:0.0:1746140883.635285:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.635495:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573607552 00000100:00100000:2.0:1746140883.635505:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573607552 00000100:00100000:2.0:1746140883.635548:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10658 00000100:00100000:2.0:1746140883.635555:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32549:x1830960573607552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.635577:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.635598:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8be600/0x8156357b7fdb9716 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1090 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.635708:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635722:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635731:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635744:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635749:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635753:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635858:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb972b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635867:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb972b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635873:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb972b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:2.0:1746140883.635884:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.635957:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635963:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635968:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635972:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8bf800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.635975:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635980:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635988:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.635990:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.635994:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.635998:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdb971d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.636663:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.636671:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.636676:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.636684:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8bf000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.636687:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.636692:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.636700:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293400) 00010000:00010000:2.0:1746140883.636702:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.636705:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.636709:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9724 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.636753:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8be600/0x8156357b7fdb9716 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1090 expref: 25 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.636765:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb972b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1090 expref: 24 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.636771:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.636773:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140883.636776:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8bee00, rc 0) 00000100:00100000:2.0:1746140883.637739:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:32549:x1830960573607552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2182us (2462us total) trans 8589944946 rc 0/0 00000100:00100000:2.0:1746140883.637749:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10658 00000100:00100000:0.0:1746140883.642260:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.643243:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573607680 00000100:00100000:3.0:1746140883.643256:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573607680 00000100:00100000:3.0:1746140883.643364:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 765 00000100:00100000:3.0:1746140883.643375:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573607680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.643391:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.643422:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdb972b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1090 expref: 24 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.643468:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.643473:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.643527:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573607680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 154us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.643534:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 765 00000100:00100000:2.0:1746140883.645417:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.645455:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.645490:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573607808 00000100:00100000:2.0:1746140883.645494:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.645499:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573607808 00000100:00100000:2.0:1746140883.645509:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573607936 00000100:00100000:2.0:1746140883.645512:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573607936 00000100:00100000:2.0:1746140883.645541:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573608064 00000100:00100000:2.0:1746140883.645543:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573608064 00000100:00100000:2.0:1746140883.645564:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16636 00000100:00100000:2.0:1746140883.645570:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573607808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.645586:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140883.645592:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16637 00010000:00010000:2.0:1746140883.645601:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1097 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140883.645601:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573607936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140883.645609:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.645621:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.645623:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.645625:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800934e0a00/0x8156357b7fdb9740 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a109e expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.645630:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.645644:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.645655:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8bf000, rc 0) 00000100:00100000:0.0:1746140883.645674:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092610a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576003456:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140883.645695:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573607808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 125us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.645701:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16636 00000100:00100000:2.0:1746140883.645718:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16638 00000100:00100000:2.0:1746140883.645723:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:32545:x1830960573608064:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140883.645730:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140883.645732:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746140883.645737:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10a5 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.645755:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 10 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.645763:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 6 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.645770:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 27 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.645774:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.645776:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.645779:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3731456->4194303] (req 3731456->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 27 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.645794:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 27 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.645806:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 27 pid: 8459 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.645815:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576003584:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.645844:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 6 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.645852:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 6 pid: 20960 timeout: 962 lvb_type: 1 00000100:00100000:2.0:1746140883.645859:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576003712:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.645882:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 10 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.645889:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 10 pid: 8459 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.645896:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576003840:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140883.645909:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538780 going to sleep for 11 seconds 00002000:00010000:2.0:1746140883.652713:0:32376:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime: 1746140883 -> 1746140884 00002000:00010000:2.0:1746140883.652720:0:32376:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140882 -> 1746140884 00002000:00010000:2.0:1746140883.652722:0:32376:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime: 1746140883 -> 1746140884 00000100:00100000:3.0:1746140883.652724:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576003584:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.652734:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576003712:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140883.652744:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092610a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576003456:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140883.652779:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800934e0a00/0x8156357b7fdb9740 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a109e expref: 10 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.652792:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800934e0a00/0x8156357b7fdb9740 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a109e expref: 10 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.652817:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800934e0a00, rc 0) 00000100:00100000:2.0:1746140883.652863:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573607936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7262us (7405us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140883.652871:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16637 00000100:00100000:3.0:1746140883.653582:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.653692:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573608448 00000100:00100000:2.0:1746140883.653700:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573608448 00000100:00100000:2.0:1746140883.653741:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10659 00000100:00100000:2.0:1746140883.653748:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:32551:x1830960573608448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140883.653767:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.653784:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da6a00/0x8156357b7fdb974e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10ac expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.653900:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00000100:00100000:1.0:1746140883.653901:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140883.653912:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.653921:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:1.0:1746140883.653923:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.653946:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573608192 00000100:00100000:1.0:1746140883.653949:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573608192 00010000:00010000:1.0:1746140883.653968:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 7 pid: 20960 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.653984:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573608576 00000100:00100000:1.0:1746140883.653985:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573608576 00010000:00010000:1.0:1746140883.653994:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 28 pid: 8459 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.654011:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8614 00000100:00100000:1.0:1746140883.654016:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573608192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.654025:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.654039:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 7 pid: 20960 timeout: 962 lvb_type: 1 00010000:00010000:1.0:1746140883.654051:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 7 pid: 20960 timeout: 962 lvb_type: 1 00010000:00010000:1.0:1746140883.654065:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ecb9200/0x8156357b7fdb9525 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f8d expref: 7 pid: 20960 timeout: 962 lvb_type: 1 00010000:00010000:1.0:1746140883.654081:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.654103:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573608192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.654108:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8614 00000100:00100000:1.0:1746140883.654161:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8615 00000100:00100000:1.0:1746140883.654166:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573608576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.654172:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.654179:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 28 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.654188:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 28 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.654199:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4bb3000/0x8156357b7fdb9468 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f2b expref: 28 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.654211:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.654224:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573608576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.654233:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8615 00000100:00100000:3.0:1746140883.654369:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576003840:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140883.654394:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3731456->4194303] (req 3731456->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 26 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.654401:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8bf800, rc 0) 00000100:00100000:3.0:1746140883.654421:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:32545:x1830960573608064:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8697us (8927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.654430:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16638 00010000:00010000:2.0:1746140883.654724:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.654731:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.654737:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.654866:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb9763 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.654875:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb9763 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.654880:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb9763 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:2.0:1746140883.654891:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.654983:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.654990:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.654996:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655002:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed43800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.655005:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655012:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655020:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.655022:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.655026:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655031:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43800/0x8156357b7fdb9755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655041:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655046:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655051:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655059:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed43200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.655062:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655066:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655072:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293f00) 00010000:00010000:2.0:1746140883.655074:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.655076:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655081:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb975c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.655117:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0da6a00/0x8156357b7fdb974e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ac expref: 26 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.655140:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb9763 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ac expref: 25 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.655147:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.655149:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140883.655151:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42e00, rc 0) 00000100:00100000:2.0:1746140883.656400:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:32551:x1830960573608448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2650us (2817us total) trans 8589944947 rc 0/0 00000100:00100000:2.0:1746140883.656409:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10659 00000100:00100000:0.0:1746140883.658351:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.658409:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.658522:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573608960 00000100:00100000:3.0:1746140883.658532:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573608960 00002000:00100000:3.0:1746140883.658572:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880092610a80 x1830960573608960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.658582:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092610a80 with x1830960573608960 ext(0->1048575) 00002000:00010000:3.0:1746140883.658588:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092610a80 00000100:00100000:3.0:1746140883.658608:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8540 00000100:00100000:3.0:1746140883.658614:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573608960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140883.659587:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573608704 00000100:00100000:1.0:1746140883.659596:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573608704 00010000:00010000:1.0:1746140883.659635:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 9 pid: 8459 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.659667:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8616 00000100:00100000:1.0:1746140883.659675:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573608704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.659689:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.659713:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 9 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.659726:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 9 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.659748:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ca2200/0x8156357b7fdb9461 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f24 expref: 9 pid: 8459 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.659763:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.659765:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.659773:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 25 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.659782:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 25 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.659821:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 25 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.659836:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576003968:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.659931:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.660281:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.660535:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573609088 00000100:00100000:1.0:1746140883.660539:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573609088 00000100:00100000:1.0:1746140883.660579:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 766 00000100:00100000:1.0:1746140883.660584:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573609088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.660591:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.660605:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb9763 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ac expref: 25 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.660615:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140883.660619:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.660642:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573609088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.660649:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 766 00000100:00100000:1.0:1746140883.662029:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576003968:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140883.662056:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.662103:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573608704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2428us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.662111:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8616 00000100:00100000:0.0:1746140883.664401:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.664483:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573609344 00000100:00100000:2.0:1746140883.664494:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573609344 00002000:00100000:2.0:1746140883.664536:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3731456->3735551) req@ffff88009f518700 x1830960573609344/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.664546:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518700 with x1830960573609344 ext(3731456->3735551) 00002000:00010000:2.0:1746140883.664551:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f518700 00000100:00100000:2.0:1746140883.664583:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8541 00000100:00100000:2.0:1746140883.664590:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573609344:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140883.664764:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573609344:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 174us (373us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140883.664771:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8541 00002000:00100000:2.0:1746140883.664776:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3731456->3735551) req@ffff88009f518700 x1830960573609344/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.664782:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518700 with x1830960573609344 ext(3731456->3735551) 00002000:00010000:2.0:1746140883.664785:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f518700 00000100:00100000:3.0:1746140883.672220:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573608960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13589us (13861us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.672233:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8540 00002000:00100000:3.0:1746140883.672246:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880092610a80 x1830960573608960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.672257:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092610a80 with x1830960573608960 ext(0->1048575) 00002000:00010000:3.0:1746140883.672263:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092610a80 00010000:00010000:2.0:1746140883.675581:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140883.676181:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.676282:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573609472 00000100:00100000:3.0:1746140883.676291:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573609472 00000100:00100000:3.0:1746140883.676415:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16639 00000100:00100000:3.0:1746140883.676537:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:32545:x1830960573609472:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140883.676554:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.676569:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10b3 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.676609:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 21 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.676618:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.676624:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 21 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.676630:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 18 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.676636:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746140883.676638:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746140883.676641:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->4284415] (req 4194304->4284415) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.676671:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 18 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.676682:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 18 pid: 4782 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.676694:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576004096:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140883.677221:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 21 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.677231:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 21 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.677241:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576004224:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140883.677452:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.677460:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.677467:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576004352:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140883.677491:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 21 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.677498:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 21 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.677505:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576004480:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.677519:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.678755:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.679002:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576004096:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.679155:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573609600 00000100:00100000:1.0:1746140883.679161:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573609600 00010000:00010000:1.0:1746140883.679190:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 19 pid: 4782 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.679221:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8617 00000100:00100000:1.0:1746140883.679227:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573609600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.679238:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.679259:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 19 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.679269:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 19 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.679288:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdb95c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fda expref: 19 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.679334:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.679362:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573609600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.679368:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8617 00000100:00100000:3.0:1746140883.679598:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576004224:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140883.686228:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.686262:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.686279:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.686353:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.686453:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576004352:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.686465:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576004480:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.686493:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573609728 00000100:00100000:1.0:1746140883.686501:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573609728 00010000:00010000:3.0:1746140883.686504:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4284415] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.686521:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a3ba400, rc 0) 00000100:00100000:2.0:1746140883.686527:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573609984 00000100:00100000:2.0:1746140883.686531:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573609984 00010000:00010000:1.0:1746140883.686536:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 22 pid: 4784 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.686561:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573609856 00000100:00100000:2.0:1746140883.686562:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16640 00000100:00100000:1.0:1746140883.686564:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573609856 00000100:00100000:3.0:1746140883.686565:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:32545:x1830960573609472:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10030us (10391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.686569:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32549:x1830960573609984:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140883.686572:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16639 00010000:00010000:1.0:1746140883.686577:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.686583:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.686598:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10ba expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.686599:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573610112 00000100:00100000:1.0:1746140883.686602:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573610112 00010000:00010000:1.0:1746140883.686615:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 22 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.686620:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 25 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.686633:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140883.686635:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746140883.686635:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8618 00010000:00010000:2.0:1746140883.686638:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 9 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140883.686641:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8619 00000100:00100000:1.0:1746140883.686643:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573609728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140883.686649:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573609856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.686654:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140883.686656:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.686664:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 25 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.686676:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.686678:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 22 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:0.0:1746140883.686686:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.687102:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 25 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.687115:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576004608:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.687183:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 22 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:0.0:1746140883.687203:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009243f800/0x8156357b7fdb9675 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1051 expref: 18 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.687235:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff14000/0x8156357b7fdb95aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3010560->18446744073709551615] (req 4206592->4886527) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fc5 expref: 22 pid: 4784 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.687249:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.687267:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573609728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 626us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.687273:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8618 00000100:00100000:2.0:1746140883.687274:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00010000:00010000:0.0:1746140883.687275:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.687284:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8620 00000100:00100000:1.0:1746140883.687289:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573610112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140883.687292:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573609856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 645us (1030us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140883.687296:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140883.687299:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8619 00010000:00010000:1.0:1746140883.687332:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 20 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.687341:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 20 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.687351:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009396ea00/0x8156357b7fdb966e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a104a expref: 20 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.687361:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.687363:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.687367:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 19 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.687374:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 19 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.687393:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 19 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.687401:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576004736:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.687436:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.689629:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576004608:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.689646:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140883.689658:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 9 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.689672:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43a00, rc 0) 00000100:00100000:2.0:1746140883.689714:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32549:x1830960573609984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3145us (3433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140883.689718:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576004736:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140883.689722:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16640 00010000:00010000:0.0:1746140883.689729:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140883.689747:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1982:x1830960573610112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2458us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.689818:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.689841:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573610240 00000100:00100000:2.0:1746140883.689847:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573610240 00002000:00100000:2.0:1746140883.689879:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1253376->1523711) req@ffff880093137800 x1830960573610240/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746140883.689888:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8620 00002000:00100000:2.0:1746140883.689895:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137800 with x1830960573610240 ext(1253376->1523711) 00010000:00010000:2.0:1746140883.689902:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 26 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.689913:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 26 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.689919:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093137800 00000100:00100000:2.0:1746140883.689953:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573610496 00000100:00100000:2.0:1746140883.689957:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573610496 00000100:00100000:3.0:1746140883.689959:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1766 00002000:00100000:2.0:1746140883.689969:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4280320->4284415) req@ffff880093137b80 x1830960573610496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746140883.689973:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573610240:12345-192.168.204.16@tcp:4:multiop.0 00002000:00100000:2.0:1746140883.689976:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137b80 with x1830960573610496 ext(4280320->4284415) 00002000:00010000:2.0:1746140883.689979:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093137b80 00000100:00100000:2.0:1746140883.689999:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8542 00000100:00100000:2.0:1746140883.690005:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573610496:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140883.690276:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573610496:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 153us (340us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140883.690284:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8542 00002000:00100000:2.0:1746140883.690290:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4280320->4284415) req@ffff880093137b80 x1830960573610496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.690297:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137b80 with x1830960573610496 ext(4280320->4284415) 00002000:00010000:2.0:1746140883.690300:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093137b80 00000100:00100000:3.0:1746140883.695114:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573610240:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5137us (5457us total) trans 17179874041 rc 0/0 00000100:00100000:3.0:1746140883.695148:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1766 00002000:00100000:3.0:1746140883.695159:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1253376->1523711) req@ffff880093137800 x1830960573610240/t17179874041(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.695168:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137800 with x1830960573610240 ext(1253376->1523711) 00010000:00010000:3.0:1746140883.695177:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.695193:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.695199:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093137800 00000100:00100000:0.0:1746140883.701771:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.701887:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573610624 00000100:00100000:1.0:1746140883.702267:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573610624 00010000:00010000:1.0:1746140883.702353:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.702402:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8621 00000100:00100000:1.0:1746140883.702410:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573610624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.702422:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.702441:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.702453:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.702473:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940a7800/0x8156357b7fdb9691 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1523711) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a105f expref: 28 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.702494:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.702496:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.702502:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 8 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.702510:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 8 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.702540:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 8 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.702551:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576004864:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.702630:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.706494:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.706607:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576004864:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140883.706628:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.706665:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573610624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4256us (4904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.706674:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8621 00000100:00100000:3.0:1746140883.706865:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573610880 00000100:00100000:3.0:1746140883.706874:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573610880 00002000:00100000:3.0:1746140883.706912:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f519c00 x1830960573610880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.706920:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519c00 with x1830960573610880 ext(1048576->2097151) 00002000:00010000:3.0:1746140883.706925:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f519c00 00000100:00100000:3.0:1746140883.706952:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8543 00000100:00100000:3.0:1746140883.706958:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1982:x1830960573610880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140883.717820:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1982:x1830960573610880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10853us (11325us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.717833:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8543 00002000:00100000:3.0:1746140883.717844:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f519c00 x1830960573610880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.717852:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519c00 with x1830960573610880 ext(1048576->2097151) 00002000:00010000:3.0:1746140883.717858:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f519c00 00000100:00100000:0.0:1746140883.725400:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.725742:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573611008 00000100:00100000:2.0:1746140883.725751:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573611008 00000100:00100000:2.0:1746140883.725804:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16641 00000100:00100000:2.0:1746140883.725812:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1983:x1830960573611008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.725830:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.725845:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdb977f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10c1 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.725894:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576004992:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140883.725981:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.726891:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.727081:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573611136 00000100:00100000:3.0:1746140883.727087:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573611136 00000100:00100000:3.0:1746140883.727116:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16642 00000100:00100000:3.0:1746140883.727140:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573611136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140883.727149:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.727162:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009454de00/0x8156357b7fdb9786 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10c8 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.727192:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576005120:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140883.727344:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746140883.728822:0:32376:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime: 1746140883 -> 1746140884 00002000:00010000:2.0:1746140883.728827:0:32376:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140883 -> 1746140884 00002000:00010000:2.0:1746140883.728829:0:32376:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime: 1746140883 -> 1746140884 00000100:00100000:2.0:1746140883.728851:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576004992:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140883.728880:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdb977f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10c1 expref: 18 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.728893:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdb977f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10c1 expref: 18 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.728908:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42400, rc 0) 00000100:00100000:2.0:1746140883.728965:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1983:x1830960573611008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3153us (3572us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140883.728974:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16641 00002000:00010000:3.0:1746140883.729067:0:8458:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime: 1746140883 -> 1746140884 00002000:00010000:3.0:1746140883.729071:0:8458:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140882 -> 1746140884 00002000:00010000:3.0:1746140883.729073:0:8458:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime: 1746140883 -> 1746140884 00000100:00100000:3.0:1746140883.729085:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576005120:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140883.729103:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009454de00/0x8156357b7fdb9786 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10c8 expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.729119:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009454de00/0x8156357b7fdb9786 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10c8 expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140883.729141:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009454de00, rc 0) 00000100:00100000:3.0:1746140883.729159:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573611136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2037us (2275us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140883.729165:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16642 00000100:00100000:0.0:1746140883.733039:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.733885:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573611264 00000100:00100000:3.0:1746140883.733895:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573611264 00000100:00100000:3.0:1746140883.733958:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16643 00000100:00100000:3.0:1746140883.733966:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32549:x1830960573611264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140883.733983:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.733999:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10cf expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.734031:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 18 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.734038:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140883.734040:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140883.734044:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.734074:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 18 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.734085:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 18 pid: 4782 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.734097:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576005248:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.734196:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.736612:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.736776:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573611520 00000100:00100000:2.0:1746140883.736784:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573611520 00000100:00100000:2.0:1746140883.736823:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10660 00000100:00100000:2.0:1746140883.736830:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:32556:x1830960573611520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.736851:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.736866:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42000/0x8156357b7fdb9794 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10d6 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.737208:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737220:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737230:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737241:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737246:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737251:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737453:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42200/0x8156357b7fdb97a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737463:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42200/0x8156357b7fdb97a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737468:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42200/0x8156357b7fdb97a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:2.0:1746140883.737477:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.737559:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737569:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737575:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737580:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed42a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.737584:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737590:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737601:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.737603:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.737607:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737612:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb979b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737622:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737628:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737632:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737636:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed43e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.737638:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737646:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737652:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293f00) 00010000:00010000:2.0:1746140883.737653:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.737655:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737660:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43e00/0x8156357b7fdb97a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.737695:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42000/0x8156357b7fdb9794 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10d6 expref: 293 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.737707:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42200/0x8156357b7fdb97a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10d6 expref: 292 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.737713:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.737715:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140883.737717:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42200, rc 0) 00000100:00100000:2.0:1746140883.737831:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:32556:x1830960573611520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 999us (1225us total) trans 8589944948 rc 0/0 00000100:00100000:2.0:1746140883.737838:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10660 00000100:00100000:0.0:1746140883.738863:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576005248:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140883.738886:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.739114:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf1b800, rc 0) 00000100:00100000:0.0:1746140883.739155:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32549:x1830960573611264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5190us (6125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140883.739163:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16643 00000100:00100000:0.0:1746140883.741007:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.741358:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573611776 00000100:00100000:2.0:1746140883.741366:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573611776 00000100:00100000:2.0:1746140883.741406:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10661 00000100:00100000:2.0:1746140883.741412:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:32554:x1830960573611776:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140883.741433:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.741450:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdb97b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10dd expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.741507:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.741517:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.741526:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.741537:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.741542:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.741547:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.741651:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.741660:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 291 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.741665:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.741694:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 291 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.741704:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 291 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.741716:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576005376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140883.741798:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00000100:00100000:3.0:1746140883.742262:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.742333:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.742351:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.742374:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.742399:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573611648 00000100:00100000:3.0:1746140883.742402:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573611648 00002000:00100000:3.0:1746140883.742429:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4284415) req@ffff8801354bf480 x1830960573611648/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.742437:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bf480 with x1830960573611648 ext(4194304->4284415) 00010000:00010000:3.0:1746140883.742444:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 19 pid: 4782 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.742451:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573612160 00010000:00010000:3.0:1746140883.742454:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 19 pid: 4782 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.742459:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801354bf480 00000100:00100000:3.0:1746140883.742477:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1767 00000100:00100000:3.0:1746140883.742483:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960573611648:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140883.742508:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573612160 00000100:00100000:1.0:1746140883.742539:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 767 00000100:00100000:1.0:1746140883.742544:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:1982:x1830960573612160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.742552:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.742565:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42200/0x8156357b7fdb97a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10d6 expref: 292 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.742582:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140883.742586:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.742592:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.742597:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.742601:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.742621:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+291:1982:x1830960573612160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.742626:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 767 00000100:00100000:0.0:1746140883.742693:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573611904 00000100:00100000:0.0:1746140883.742697:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573611904 00000100:00100000:0.0:1746140883.742716:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573612032 00000100:00100000:0.0:1746140883.742718:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573612032 00000100:00100000:0.0:1746140883.742731:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16644 00000100:00100000:0.0:1746140883.742736:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573611904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140883.742744:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140883.742754:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10e4 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.742768:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140883.742769:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16645 00010000:00010000:0.0:1746140883.742770:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140883.742776:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573612032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140883.742777:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 28 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.742784:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140883.742788:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 28 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.742793:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940a7800/0x8156357b7fdb97da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10eb expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.742796:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093877e00, rc 0) 00000100:00100000:0.0:1746140883.742814:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1983:x1830960573611904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 78us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140883.742820:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16644 00000100:00100000:1.0:1746140883.742821:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576005504:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140883.742861:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.745987:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.746053:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573612416 00000100:00100000:2.0:1746140883.746064:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573612416 00000100:00100000:2.0:1746140883.746113:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4663 00000100:00100000:2.0:1746140883.746131:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+291:11714:x1830960573612416:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746140883.746353:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:11714:x1830960573612416:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 232us (373us total) trans 8589944949 rc 0/0 00000100:00100000:2.0:1746140883.746359:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4663 00000100:00100000:2.0:1746140883.746401:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576005376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140883.746418:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:1.0:1746140883.747140:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576005504:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140883.747166:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940a7800/0x8156357b7fdb97da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10eb expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.747177:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940a7800/0x8156357b7fdb97da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10eb expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.747186:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940a7800, rc 0) 00000100:00100000:1.0:1746140883.747212:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573612032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4437us (4879us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.747219:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16645 00000100:00100000:3.0:1746140883.747552:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573611648:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5068us (5199us total) trans 21474841320 rc 0/0 00000100:00100000:3.0:1746140883.747561:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1767 00002000:00100000:3.0:1746140883.747568:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4284415) req@ffff8801354bf480 x1830960573611648/t21474841320(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.747577:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bf480 with x1830960573611648 ext(4194304->4284415) 00010000:00010000:3.0:1746140883.747583:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 21 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.747592:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 21 pid: 4782 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.747597:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801354bf480 00000100:00100000:1.0:1746140883.749330:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.749408:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573612544 00000100:00100000:2.0:1746140883.749415:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573612544 00010000:00010000:2.0:1746140883.749442:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 292 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.749462:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8622 00000100:00100000:2.0:1746140883.749467:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:1984:x1830960573612544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140883.749478:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.749483:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 292 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.749492:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 292 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.749510:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940a7e00/0x8156357b7fdb9683 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1058 expref: 292 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.749521:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.749525:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.749533:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.749539:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140883.749562:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.749587:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+291:1984:x1830960573612544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.749592:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8622 00010000:00010000:3.0:1746140883.750206:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750216:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:3.0:1746140883.750264:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140883.750270:0:14743:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140883.750289:0:14743:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750300:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750359:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750366:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750372:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750377:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed42c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140883.750381:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750387:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750397:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140883.750399:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140883.750403:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750407:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42c00/0x8156357b7fdb97be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750442:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750448:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750453:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750456:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed42e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140883.750458:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750466:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750474:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293600) 00010000:00010000:3.0:1746140883.750476:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140883.750478:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750482:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42e00/0x8156357b7fdb97c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.750521:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdb97b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 14 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.750534:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 13 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.750541:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.750543:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140883.750545:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43200, rc 0) 00000100:00100000:3.0:1746140883.750583:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:32554:x1830960573611776:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 9169us (9580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.750591:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10661 00000100:00100000:0.0:1746140883.751186:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.751230:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573612672 00000100:00100000:1.0:1746140883.751234:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573612672 00010000:00010000:1.0:1746140883.751253:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 21 pid: 4782 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.751359:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8623 00000100:00100000:1.0:1746140883.751366:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573612672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.751380:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.751399:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 21 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.751409:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 21 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.751423:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a3ba400/0x8156357b7fdb9771 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10b3 expref: 21 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.751434:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.751436:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.751442:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.751449:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.751477:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.751489:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094450a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576005632:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.752225:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.755726:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.755917:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.756464:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.756779:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.756804:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573612800 00000100:00100000:1.0:1746140883.756814:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573612800 00000100:00100000:1.0:1746140883.756869:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573612928 00000100:00100000:1.0:1746140883.756874:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573612928 00000100:00100000:1.0:1746140883.756894:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573613056 00000100:00100000:1.0:1746140883.756898:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573613056 00000100:00100000:1.0:1746140883.756920:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16646 00000100:00100000:1.0:1746140883.756929:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+6:1982:x1830960573612800:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140883.756949:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.756971:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10f2 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.756996:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.756998:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.757008:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 7 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.757024:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 7 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.757036:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299b800, rc 0) 00000100:00100000:1.0:1746140883.757090:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573612800:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 162us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.757096:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16646 00000100:00100000:1.0:1746140883.757115:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16647 00000100:00100000:1.0:1746140883.757136:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573612928:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140883.757151:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140883.757157:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16648 00000100:00100000:2.0:1746140883.757163:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+6:1982:x1830960573613056:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140883.757164:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a10f9 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.757169:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.757175:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1100 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.757177:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.757180:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.757186:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.757186:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 7 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.757188:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.757193:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 7 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.757196:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 7 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.757204:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299aa00, rc 0) 00010000:00010000:2.0:1746140883.757206:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 7 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.757213:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42800, rc 0) 00000100:00100000:1.0:1746140883.757227:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573612928:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 105us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.757232:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573613056:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 69us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.757232:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16647 00000100:00100000:2.0:1746140883.757236:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16648 00000100:00100000:0.0:1746140883.757361:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573613184 00000100:00100000:0.0:1746140883.757366:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573613184 00000100:00100000:0.0:1746140883.757406:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16649 00000100:00100000:0.0:1746140883.757413:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573613184:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140883.757424:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140883.757432:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1107 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140883.757444:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.757445:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140883.757451:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.757472:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.757479:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093876800, rc 0) 00000100:00100000:0.0:1746140883.757502:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573613184:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 89us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140883.757507:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16649 00000100:00100000:0.0:1746140883.757596:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.757769:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573613312 00000100:00100000:2.0:1746140883.757774:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573613312 00000100:00100000:2.0:1746140883.757805:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16650 00000100:00100000:2.0:1746140883.757810:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573613312:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140883.757818:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.757827:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed43e00/0x8156357b7fdb97fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a110e expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.757866:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576005760:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140883.757923:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.758129:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.758743:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573613568 00000100:00100000:3.0:1746140883.758749:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573613568 00002000:00100000:3.0:1746140883.758783:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009eea8700 x1830960573613568/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.758793:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eea8700 with x1830960573613568 ext(1048576->2097151) 00002000:00010000:3.0:1746140883.758800:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eea8700 00000100:00100000:3.0:1746140883.758818:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8544 00000100:00100000:3.0:1746140883.758824:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573613568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140883.759158:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094450a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576005632:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140883.759179:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.759214:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573612672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7846us (8026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.759223:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8623 00000100:00100000:0.0:1746140883.759555:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.759580:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576005760:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140883.759600:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43e00/0x8156357b7fdb97fd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a110e expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.759611:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43e00/0x8156357b7fdb97fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a110e expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.759626:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43e00, rc 0) 00000100:00100000:2.0:1746140883.759658:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573613312:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1847us (2063us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140883.759663:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16650 00000100:00100000:3.0:1746140883.759704:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573613824 00000100:00100000:3.0:1746140883.759710:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573613824 00002000:00100000:3.0:1746140883.759949:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009eeaad80 x1830960573613824/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.759959:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eeaad80 with x1830960573613824 ext(2097152->3145727) 00002000:00010000:3.0:1746140883.759962:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eeaad80 00000100:00100000:3.0:1746140883.759982:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8545 00000100:00100000:3.0:1746140883.759987:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573613824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140883.762721:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.762807:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573614080 00000100:00100000:3.0:1746140883.762814:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573614080 00000100:00100000:3.0:1746140883.762854:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10662 00000100:00100000:3.0:1746140883.762865:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:32554:x1830960573614080:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140883.762880:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.762894:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992600/0x8156357b7fdb9804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1115 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.762980:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.762994:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 14 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.763000:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.763162:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 14 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.763174:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 14 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:3.0:1746140883.763184:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576005888:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.763281:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.768574:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.768676:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576005888:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140883.768702:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:1.0:1746140883.768865:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573614208 00000100:00100000:1.0:1746140883.768873:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573614208 00010000:00010000:1.0:1746140883.768906:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 15 pid: 14743 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.768941:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8624 00000100:00100000:1.0:1746140883.768953:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573614208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.768964:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.768970:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 15 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.768986:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 15 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.769009:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb97cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10dd expref: 15 pid: 14743 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.769023:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140883.769028:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.769036:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.769043:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140883.769070:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.769130:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573614208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 172us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.769137:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8624 00000100:00100000:0.0:1746140883.769144:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140883.769148:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.769154:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:3.0:1746140883.769171:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:2.0:1746140883.769177:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573614336 00000100:00100000:2.0:1746140883.769181:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573614336 00000100:00100000:2.0:1746140883.769205:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16651 00000100:00100000:2.0:1746140883.769210:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32551:x1830960573614336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140883.769223:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.769235:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a111c expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.769256:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 29 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.769263:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140883.769265:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140883.769268:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3952640->4194303] (req 3952640->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.769288:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992600/0x8156357b7fdb9804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1115 expref: 15 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.769289:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 29 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.769298:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 29 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.769322:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1115 expref: 14 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.769327:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.769329:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746140883.769330:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c992800, rc 0) 00000100:00100000:2.0:1746140883.769332:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576006016:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140883.769349:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:32554:x1830960573614080:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 6486us (6635us total) trans 8589944950 rc 0/0 00000100:00100000:3.0:1746140883.769354:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10662 00000100:00100000:2.0:1746140883.769381:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538300 going to sleep for 11 seconds 00000100:00100000:3.0:1746140883.770515:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573613824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10526us (10959us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.770523:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8545 00002000:00100000:3.0:1746140883.770531:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009eeaad80 x1830960573613824/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.770540:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eeaad80 with x1830960573613824 ext(2097152->3145727) 00002000:00010000:3.0:1746140883.770544:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eeaad80 00000100:00100000:2.0:1746140883.771106:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573613568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12281us (12985us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140883.771112:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8544 00002000:00100000:2.0:1746140883.771129:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009eea8700 x1830960573613568/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.771137:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eea8700 with x1830960573613568 ext(1048576->2097151) 00002000:00010000:2.0:1746140883.771141:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eea8700 00000100:00100000:0.0:1746140883.771212:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.771245:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576006016:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140883.771260:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573614464 00010000:00010000:3.0:1746140883.771263:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3952640->4194303] (req 3952640->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.771264:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573614464 00010000:00010000:3.0:1746140883.771276:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42a00, rc 0) 00002000:00100000:2.0:1746140883.771286:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3731456->4194303) req@ffff88009eeaa300 x1830960573614464/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.771292:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eeaa300 with x1830960573614464 ext(3731456->4194303) 00010000:00010000:2.0:1746140883.771297:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 28 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.771330:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 28 pid: 4782 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.771336:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eeaa300 00000100:00100000:2.0:1746140883.771348:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1768 00000100:00100000:2.0:1746140883.771353:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573614464:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140883.771360:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32551:x1830960573614336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2148us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.771366:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16651 00000100:00100000:2.0:1746140883.772416:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.772521:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573614720 00000100:00100000:3.0:1746140883.772529:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573614720 00000100:00100000:3.0:1746140883.772574:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10663 00000100:00100000:3.0:1746140883.772581:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:32554:x1830960573614720:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140883.772601:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.772603:0:14743:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746140883.772626:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992800/0x8156357b7fdb980b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1115 expref: 14 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.772642:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.772646:0:14743:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140883.772657:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993e00/0x8156357b7fdb9820 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1123 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.772729:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772739:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772747:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772756:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772761:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772766:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772771:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c993800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140883.772774:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772780:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772786:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.772788:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140883.772791:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772795:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993800/0x8156357b7fdb9827 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.772812:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993e00/0x8156357b7fdb9820 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1123 expref: 14 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.772818:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993e00/0x8156357b7fdb9820 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1123 expref: 14 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.772823:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993e00, rc 0) 00000100:00100000:3.0:1746140883.772862:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:32554:x1830960573614720:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 282us (454us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140883.772868:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10663 00000100:00100000:0.0:1746140883.776541:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.776735:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.776767:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573614848 00000100:00100000:3.0:1746140883.776776:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573614848 00000100:00100000:1.0:1746140883.776797:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573615104 00000100:00100000:1.0:1746140883.776801:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573615104 00000100:00100000:3.0:1746140883.776823:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16652 00000100:00100000:3.0:1746140883.776829:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32549:x1830960573614848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140883.776846:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.776863:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a112a expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.776889:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140883.776891:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140883.776895:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.776906:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.776917:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993c00, rc 0) 00000100:00100000:3.0:1746140883.776960:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32549:x1830960573614848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 131us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.776965:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16652 00000100:00100000:1.0:1746140883.777049:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4664 00000100:00100000:1.0:1746140883.777056:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:32554:x1830960573615104:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746140883.777219:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+14:32554:x1830960573615104:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 163us (484us total) trans 8589944951 rc 0/0 00000100:00100000:1.0:1746140883.777225:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4664 00000100:00100000:3.0:1746140883.778971:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.778995:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573615232 00000100:00100000:1.0:1746140883.779001:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573615232 00000100:00100000:1.0:1746140883.779040:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16653 00000100:00100000:1.0:1746140883.779046:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:32556:x1830960573615232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.779057:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.779145:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1131 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.779166:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.779167:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.779175:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.779187:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.779195:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427000, rc 0) 00000100:00100000:1.0:1746140883.779220:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:32556:x1830960573615232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 175us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.779226:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16653 00000100:00100000:0.0:1746140883.782317:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.782383:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573615488 00000100:00100000:3.0:1746140883.782391:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573615488 00002000:00100000:3.0:1746140883.782432:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8801355bd180 x1830960573615488/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.782442:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bd180 with x1830960573615488 ext(2097152->3145727) 00002000:00010000:3.0:1746140883.782447:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bd180 00000100:00100000:3.0:1746140883.782466:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8546 00000100:00100000:3.0:1746140883.782472:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573615488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140883.784565:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573614464:12345-192.168.204.16@tcp:4:cat.0 Request processed in 13204us (13346us total) trans 17179874042 rc 0/0 00000100:00100000:2.0:1746140883.784576:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1768 00002000:00100000:2.0:1746140883.784585:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3731456->4194303) req@ffff88009eeaa300 x1830960573614464/t17179874042(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.784593:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eeaa300 with x1830960573614464 ext(3731456->4194303) 00010000:00010000:2.0:1746140883.784601:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 30 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.784614:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 30 pid: 4782 timeout: 962 lvb_type: 0 00002000:00010000:2.0:1746140883.784620:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eeaa300 00000100:00100000:0.0:1746140883.787724:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.787813:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573615616 00000100:00100000:2.0:1746140883.787822:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573615616 00010000:00010000:2.0:1746140883.787859:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 30 pid: 4782 timeout: 962 lvb_type: 0 00000100:00100000:2.0:1746140883.788479:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8625 00000100:00100000:2.0:1746140883.788487:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573615616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140883.788501:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.788524:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 30 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.788542:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 30 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.788566:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf800/0x8156357b7fdb9747 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3731456->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10a5 expref: 30 pid: 4782 timeout: 962 lvb_type: 0 00010000:00010000:2.0:1746140883.788597:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.788600:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.788606:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.788614:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.788622:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.788623:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140883.788626:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.788633:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.788743:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.788756:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576006144:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140883.788852:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140883.788859:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576006272:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140883.788876:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.789475:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573615488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7002us (7180us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140883.789485:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8546 00002000:00100000:2.0:1746140883.789495:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8801355bd180 x1830960573615488/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.789504:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bd180 with x1830960573615488 ext(2097152->3145727) 00002000:00010000:2.0:1746140883.789508:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bd180 00000100:00100000:2.0:1746140883.790614:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576006144:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140883.790616:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.790622:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576006272:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140883.790636:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.791020:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573615616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2533us (3305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.791027:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573615872 00000100:00100000:2.0:1746140883.791028:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8625 00000100:00100000:3.0:1746140883.791033:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573615872 00002000:00100000:3.0:1746140883.791061:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3952640->3956735) req@ffff88013569aa00 x1830960573615872/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.791069:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569aa00 with x1830960573615872 ext(3952640->3956735) 00002000:00010000:3.0:1746140883.791073:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569aa00 00000100:00100000:3.0:1746140883.791096:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8547 00000100:00100000:3.0:1746140883.791102:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573615872:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140883.791248:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573615872:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 146us (632us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140883.791258:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8547 00002000:00100000:3.0:1746140883.791262:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3952640->3956735) req@ffff88013569aa00 x1830960573615872/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.791269:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569aa00 with x1830960573615872 ext(3952640->3956735) 00002000:00010000:3.0:1746140883.791272:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569aa00 00000100:00100000:0.0:1746140883.793369:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.793453:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573616000 00000100:00100000:1.0:1746140883.793460:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573616000 00000100:00100000:1.0:1746140883.793506:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16654 00000100:00100000:1.0:1746140883.793512:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:32556:x1830960573616000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.793524:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.793542:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1138 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.793566:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.793568:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.793575:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.793588:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.793597:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e426e00, rc 0) 00000100:00100000:1.0:1746140883.793638:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:32556:x1830960573616000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.793644:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16654 00000100:00100000:0.0:1746140883.794038:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.794072:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573616128 00000100:00100000:1.0:1746140883.794076:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573616128 00000100:00100000:1.0:1746140883.794134:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16655 00000100:00100000:1.0:1746140883.794141:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32551:x1830960573616128:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140883.794150:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.794161:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a113f expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.794178:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.794187:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.794194:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 7 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.794205:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.794206:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.794209:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4804607] (req 4194304->4804607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.794234:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 7 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.794245:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 7 pid: 8458 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.794255:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094450a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576006400:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.794371:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.794379:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 20 pid: 20960 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.794386:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576006528:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.794414:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.794428:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.794441:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576006656:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.794462:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.796509:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.796749:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.796779:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.796850:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.796891:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573616512 00000100:00100000:3.0:1746140883.796898:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573616512 00002000:00100000:3.0:1746140883.796931:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88013569b100 x1830960573616512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.796941:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b100 with x1830960573616512 ext(3145728->4194303) 00010000:00010000:3.0:1746140883.796948:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 20 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.796960:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 20 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.796967:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013569b100 00000100:00100000:3.0:1746140883.796988:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573616640 00000100:00100000:3.0:1746140883.796990:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573616640 00002000:00100000:3.0:1746140883.797002:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88013569b800 x1830960573616640/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.797010:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b800 with x1830960573616640 ext(2097152->3145727) 00002000:00010000:3.0:1746140883.797013:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569b800 00000100:00100000:2.0:1746140883.797020:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573616768 00000100:00100000:2.0:1746140883.797026:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573616768 00000100:00100000:3.0:1746140883.797032:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1769 00000100:00100000:3.0:1746140883.797037:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573616512:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140883.797037:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573617024 00000100:00100000:0.0:1746140883.797037:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8548 00000100:00100000:2.0:1746140883.797039:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573617024 00000100:00100000:0.0:1746140883.797043:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573616640:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:2.0:1746140883.797059:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 8 pid: 8458 timeout: 962 lvb_type: 1 00000100:00100000:2.0:1746140883.797086:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8626 00000100:00100000:2.0:1746140883.797092:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573617024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140883.797101:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.797114:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 8 pid: 8458 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.797136:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 8 pid: 8458 timeout: 962 lvb_type: 1 00010000:00010000:2.0:1746140883.797156:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.797188:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573617024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.797195:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8626 00002000:00100000:2.0:1746140883.797251:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->3952639) req@ffff880135698700 x1830960573616768/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.797259:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698700 with x1830960573616768 ext(3145728->3952639) 00002000:00010000:2.0:1746140883.797262:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135698700 00000100:00100000:2.0:1746140883.797280:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8549 00000100:00100000:2.0:1746140883.797286:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573616768:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:1.0:1746140883.797325:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093876800/0x8156357b7fdb97f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1107 expref: 7 pid: 8458 timeout: 962 lvb_type: 1 00000100:00100000:1.0:1746140883.797345:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094450a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576006400:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.797356:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576006528:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.797362:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576006656:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.797382:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4194304->4804607] (req 4194304->4804607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.797390:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427600, rc 0) 00000100:00100000:1.0:1746140883.797406:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32551:x1830960573616128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3267us (3369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.797411:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16655 00000100:00100000:0.0:1746140883.798081:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.798117:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573617152 00000100:00100000:1.0:1746140883.798131:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573617152 00010000:00010000:1.0:1746140883.798193:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.798215:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8627 00000100:00100000:1.0:1746140883.798222:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573617152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.798229:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.798239:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.798247:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.798260:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e427000/0x8156357b7fdb9835 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1131 expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.798268:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140883.798287:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.798289:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1983:x1830960573617152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.798295:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8627 00000100:00100000:3.0:1746140883.798341:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573617408 00000100:00100000:3.0:1746140883.798345:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573617408 00002000:00100000:3.0:1746140883.798360:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88013569bb80 x1830960573617408/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.798367:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569bb80 with x1830960573617408 ext(2097152->3145727) 00002000:00010000:3.0:1746140883.798371:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569bb80 00000100:00100000:3.0:1746140883.798382:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8550 00000100:00100000:3.0:1746140883.798388:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573617408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140883.805928:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573616512:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8878us (9413us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.805940:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1769 00002000:00100000:3.0:1746140883.805951:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88013569b100 x1830960573616512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.805961:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b100 with x1830960573616512 ext(3145728->4194303) 00010000:00010000:3.0:1746140883.805970:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.805985:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.805991:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013569b100 00000100:00100000:2.0:1746140883.808974:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573616768:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11677us (12184us total) trans 0 rc 806912/806912 00000100:00100000:2.0:1746140883.808984:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8549 00002000:00100000:2.0:1746140883.808993:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->3952639) req@ffff880135698700 x1830960573616768/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 806912/806912 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.809001:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698700 with x1830960573616768 ext(3145728->3952639) 00002000:00010000:2.0:1746140883.809005:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135698700 00000100:00100000:3.0:1746140883.814940:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573616640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 17884us (18178us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.814952:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8548 00002000:00100000:3.0:1746140883.814966:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88013569b800 x1830960573616640/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.814976:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b800 with x1830960573616640 ext(2097152->3145727) 00002000:00010000:3.0:1746140883.814982:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569b800 00000100:00100000:0.0:1746140883.815061:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.815083:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573617536 00000100:00100000:1.0:1746140883.815091:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573617536 00010000:00010000:1.0:1746140883.815135:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.815173:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8628 00000100:00100000:1.0:1746140883.815180:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573617536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.815195:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.815216:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.815227:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.815255:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf1b800/0x8156357b7fdb978d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10cf expref: 19 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.815280:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.815282:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.815289:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.815297:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.815351:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.815363:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576006784:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.815429:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140883.815947:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573617408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17557us (17659us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.815954:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8550 00002000:00100000:3.0:1746140883.815960:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88013569bb80 x1830960573617408/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.815966:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569bb80 with x1830960573617408 ext(2097152->3145727) 00002000:00010000:3.0:1746140883.815970:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569bb80 00000100:00100000:1.0:1746140883.816480:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576006784:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140883.816495:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.816577:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573617536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1396us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.816584:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8628 00000100:00100000:0.0:1746140883.818866:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.818947:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573617664 00000100:00100000:1.0:1746140883.818955:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573617664 00000100:00100000:1.0:1746140883.819002:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16656 00000100:00100000:1.0:1746140883.819010:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:32556:x1830960573617664:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.819030:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.819047:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1146 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.819084:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.819092:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.819094:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.819098:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.819134:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.819145:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 17 pid: 20960 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.819157:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576006912:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.819251:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.819735:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.819795:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573617920 00000100:00100000:3.0:1746140883.819799:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573617920 00002000:00100000:3.0:1746140883.819829:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135698e00 x1830960573617920/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.819838:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698e00 with x1830960573617920 ext(3145728->4194303) 00010000:00010000:3.0:1746140883.819845:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.819856:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.819862:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135698e00 00000100:00100000:3.0:1746140883.819875:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1770 00000100:00100000:3.0:1746140883.819880:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573617920:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140883.820209:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576006912:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.820227:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.820235:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e426200, rc 0) 00000100:00100000:1.0:1746140883.820256:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:32556:x1830960573617664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1247us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.820261:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16656 00000100:00100000:0.0:1746140883.825899:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.826973:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573617920:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7089us (7235us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.826983:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1770 00002000:00100000:3.0:1746140883.826994:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135698e00 x1830960573617920/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.827003:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698e00 with x1830960573617920 ext(3145728->4194303) 00010000:00010000:3.0:1746140883.827012:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.827026:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.827032:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135698e00 00000100:00100000:3.0:1746140883.827053:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573618176 00000100:00100000:3.0:1746140883.827060:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573618176 00002000:00100000:3.0:1746140883.827085:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4800512->4804607) req@ffff88013569ad80 x1830960573618176/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.827092:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569ad80 with x1830960573618176 ext(4800512->4804607) 00010000:00010000:3.0:1746140883.827096:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.827103:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.827109:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013569ad80 00000100:00100000:3.0:1746140883.827291:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1771 00000100:00100000:3.0:1746140883.827298:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573618176:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140883.827453:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573618176:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 155us (1563us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140883.827458:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1771 00002000:00100000:3.0:1746140883.827463:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4800512->4804607) req@ffff88013569ad80 x1830960573618176/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.827470:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569ad80 with x1830960573618176 ext(4800512->4804607) 00010000:00010000:3.0:1746140883.827474:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.827483:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.827488:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013569ad80 00000100:00100000:0.0:1746140883.829660:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.830542:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.830608:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573618560 00000100:00100000:3.0:1746140883.830617:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573618560 00002000:00100000:3.0:1746140883.830657:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4804607) req@ffff880135699180 x1830960573618560/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.830667:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699180 with x1830960573618560 ext(4194304->4804607) 00010000:00010000:3.0:1746140883.830676:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.830690:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 18 pid: 20960 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.830702:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135699180 00000100:00100000:3.0:1746140883.830721:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1772 00000100:00100000:3.0:1746140883.830727:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573618560:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140883.830938:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573618688 00000100:00100000:2.0:1746140883.830942:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573618688 00000100:00100000:2.0:1746140883.830974:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4665 00000100:00100000:2.0:1746140883.830979:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:32551:x1830960573618688:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140883.832108:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:32551:x1830960573618688:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1124us (2452us total) trans 8589944952 rc 0/0 00000100:00100000:2.0:1746140883.832115:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4665 00000100:00100000:0.0:1746140883.832347:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.832509:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.832564:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573618816 00000100:00100000:1.0:1746140883.832568:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573618816 00000100:00100000:1.0:1746140883.832595:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573618944 00000100:00100000:1.0:1746140883.832597:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573618944 00000100:00100000:1.0:1746140883.832611:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16657 00000100:00100000:1.0:1746140883.832616:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573618816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.832628:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.832645:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdb9851 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a114d expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.832691:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576007040:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140883.832736:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.832784:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16658 00000100:00100000:0.0:1746140883.832791:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573618944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140883.832797:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140883.832807:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a815600/0x8156357b7fdb9858 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1154 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140883.832830:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576007168:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140883.832849:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140883.835291:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576007040:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140883.835344:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdb9851 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a114d expref: 21 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.835360:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdb9851 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a114d expref: 21 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.835382:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427a00, rc 0) 00000100:00100000:1.0:1746140883.835421:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573618816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2803us (3074us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.835429:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16657 00000100:00100000:0.0:1746140883.835555:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576007168:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140883.835576:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a815600/0x8156357b7fdb9858 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1154 expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.835585:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a815600/0x8156357b7fdb9858 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1154 expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140883.835609:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a815600, rc 0) 00000100:00100000:0.0:1746140883.835628:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573618944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2838us (3118us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140883.835633:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16658 00000100:00100000:0.0:1746140883.839165:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.839325:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573619072 00000100:00100000:1.0:1746140883.839335:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573619072 00000100:00100000:1.0:1746140883.839417:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16659 00000100:00100000:1.0:1746140883.840005:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32549:x1830960573619072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.840021:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.840037:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a115b expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.840062:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.840064:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.840068:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4804608->4886527] (req 4804608->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 21 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.840080:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [4804608->4886527] (req 4804608->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 21 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.840091:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427e00, rc 0) 00000100:00100000:1.0:1746140883.840162:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32549:x1830960573619072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 738us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.840169:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16659 00000100:00100000:3.0:1746140883.841366:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573618560:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 10633us (10820us total) trans 21474841321 rc 0/0 00000100:00100000:3.0:1746140883.841378:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1772 00002000:00100000:3.0:1746140883.841387:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4804607) req@ffff880135699180 x1830960573618560/t21474841321(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.841397:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699180 with x1830960573618560 ext(4194304->4804607) 00010000:00010000:3.0:1746140883.841405:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.841419:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.841425:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135699180 00000100:00100000:0.0:1746140883.845001:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.845055:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573619200 00000100:00100000:1.0:1746140883.845065:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573619200 00010000:00010000:1.0:1746140883.845101:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.845154:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8629 00000100:00100000:1.0:1746140883.845162:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573619200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.845175:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.845199:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.845211:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.845344:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e427600/0x8156357b7fdb9843 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4804607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a113f expref: 21 pid: 20960 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.845371:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.845373:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.845380:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.845388:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.845397:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.845398:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.845401:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 20 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.845407:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 20 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.845438:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 20 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.845449:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576007296:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140883.845545:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.845553:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576007424:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.845571:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140883.849136:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576007296:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.849151:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576007424:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140883.849174:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.849216:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573619200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4053us (4225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.849227:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8629 00000100:00100000:0.0:1746140883.851685:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.851743:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573619584 00000100:00100000:3.0:1746140883.851754:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573619584 00002000:00100000:3.0:1746140883.851801:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4804608->4886527) req@ffff880092ba5880 x1830960573619584/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.851811:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5880 with x1830960573619584 ext(4804608->4886527) 00002000:00010000:3.0:1746140883.851816:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba5880 00000100:00100000:3.0:1746140883.851845:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8551 00000100:00100000:3.0:1746140883.851853:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573619584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140883.854474:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.854545:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573619840 00000100:00100000:2.0:1746140883.854555:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573619840 00002000:00100000:2.0:1746140883.854595:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880092ba7480 x1830960573619840/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.854606:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7480 with x1830960573619840 ext(3145728->4194303) 00002000:00010000:2.0:1746140883.854611:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba7480 00000100:00100000:2.0:1746140883.854640:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8552 00000100:00100000:2.0:1746140883.854647:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573619840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140883.855787:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573619584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3930us (4106us total) trans 0 rc 81920/81920 00000100:00100000:3.0:1746140883.855796:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8551 00002000:00100000:3.0:1746140883.855802:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4804608->4886527) req@ffff880092ba5880 x1830960573619584/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 81920/81920 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.855811:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5880 with x1830960573619584 ext(4804608->4886527) 00002000:00010000:3.0:1746140883.855815:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba5880 00000100:00100000:0.0:1746140883.861184:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.861755:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573619968 00000100:00100000:1.0:1746140883.861765:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573619968 00000100:00100000:1.0:1746140883.862137:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16660 00000100:00100000:1.0:1746140883.862146:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573619968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.862163:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.862180:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e427a00/0x8156357b7fdb9866 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1162 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.862234:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576007552:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140883.862341:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140883.863545:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573619840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8893us (9077us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.863554:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8552 00002000:00100000:3.0:1746140883.863565:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880092ba7480 x1830960573619840/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.863574:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7480 with x1830960573619840 ext(3145728->4194303) 00002000:00010000:3.0:1746140883.863578:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba7480 00000100:00100000:1.0:1746140883.864230:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576007552:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140883.864261:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e427a00/0x8156357b7fdb9866 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1162 expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.864278:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e427a00/0x8156357b7fdb9866 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1162 expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.864324:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427a00, rc 0) 00000100:00100000:1.0:1746140883.864353:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573619968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2208us (3179us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140883.864359:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16660 00000100:00100000:0.0:1746140883.867345:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.867391:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.867415:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573620224 00000100:00100000:0.0:1746140883.867415:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573620096 00000100:00100000:1.0:1746140883.867423:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573620224 00000100:00100000:0.0:1746140883.867423:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573620096 00000100:00100000:0.0:1746140883.867478:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16661 00000100:00100000:0.0:1746140883.867486:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573620096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140883.867503:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140883.867519:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a815c00/0x8156357b7fdb986d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1169 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.867544:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16662 00000100:00100000:1.0:1746140883.867550:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:32556:x1830960573620224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140883.867557:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.867564:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1170 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.867582:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.867589:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.867590:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140883.867593:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 31 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140883.867602:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576007680:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140883.867611:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.867625:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 12 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.867633:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576007808:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140883.867680:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140883.867685:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140883.868744:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576007680:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140883.868770:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a815c00/0x8156357b7fdb986d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1169 expref: 12 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.868782:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a815c00/0x8156357b7fdb986d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1169 expref: 12 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140883.868812:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a815c00, rc 0) 00000100:00100000:2.0:1746140883.868843:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573620096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1358us (1544us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140883.868850:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16661 00000100:00100000:1.0:1746140883.868927:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576007808:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.868942:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 31 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.868951:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427400, rc 0) 00000100:00100000:1.0:1746140883.868966:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:32556:x1830960573620224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1417us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.868970:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16662 00000100:00100000:0.0:1746140883.869210:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.869327:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573620352 00000100:00100000:3.0:1746140883.869332:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573620352 00002000:00100000:3.0:1746140883.869362:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3952640->4194303) req@ffff880092ba5180 x1830960573620352/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.869371:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5180 with x1830960573620352 ext(3952640->4194303) 00010000:00010000:3.0:1746140883.869377:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 11 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.869388:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 11 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.869395:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ba5180 00000100:00100000:3.0:1746140883.869409:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1773 00000100:00100000:3.0:1746140883.869415:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573620352:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140883.873981:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573620352:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4555us (4830us total) trans 17179874043 rc 0/0 00000100:00100000:3.0:1746140883.873992:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1773 00002000:00100000:3.0:1746140883.874004:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3952640->4194303) req@ffff880092ba5180 x1830960573620352/t17179874043(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:299/0 lens 488/448 e 0 to 0 dl 1746140894 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.874013:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5180 with x1830960573620352 ext(3952640->4194303) 00010000:00010000:3.0:1746140883.874023:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:3.0:1746140883.874039:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00002000:00010000:3.0:1746140883.874045:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ba5180 00000100:00100000:0.0:1746140883.876204:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.876407:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573620608 00000100:00100000:3.0:1746140883.876416:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573620608 00000100:00100000:3.0:1746140883.876467:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4666 00000100:00100000:3.0:1746140883.876473:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:32549:x1830960573620608:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140883.876676:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32549:x1830960573620608:12345-192.168.204.16@tcp:35:cat.0 Request processed in 203us (480us total) trans 8589944953 rc 0/0 00000100:00100000:3.0:1746140883.876683:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4666 00000100:00100000:0.0:1746140883.880160:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.880241:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573620736 00000100:00100000:1.0:1746140883.880249:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573620736 00010000:00010000:1.0:1746140883.880282:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00000100:00100000:1.0:1746140883.880328:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8630 00000100:00100000:1.0:1746140883.880332:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573620736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140883.880343:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140883.880362:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.880375:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.880394:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdb9819 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3952640->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a111c expref: 13 pid: 8458 timeout: 962 lvb_type: 0 00010000:00010000:1.0:1746140883.880418:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.880420:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.880426:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.880432:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.880457:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140883.880465:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576007936:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140883.880534:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.887900:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.888094:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576007936:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140883.888114:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140883.888173:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573620736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7839us (8021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.888185:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8630 00000100:00100000:3.0:1746140883.888271:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573620992 00000100:00100000:3.0:1746140883.888278:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573620992 00002000:00100000:3.0:1746140883.888339:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880092ba5f80 x1830960573620992/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.888348:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5f80 with x1830960573620992 ext(3145728->4194303) 00002000:00010000:3.0:1746140883.888353:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba5f80 00000100:00100000:3.0:1746140883.888369:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8553 00000100:00100000:3.0:1746140883.888375:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573620992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140883.901959:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573620992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13575us (14058us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140883.901972:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8553 00002000:00100000:3.0:1746140883.901984:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880092ba5f80 x1830960573620992/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.901992:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5f80 with x1830960573620992 ext(3145728->4194303) 00002000:00010000:3.0:1746140883.901999:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba5f80 00000100:00100000:0.0:1746140883.908147:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.910268:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573621248 00000100:00100000:3.0:1746140883.910280:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573621248 00002000:00100000:3.0:1746140883.910366:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880092ba7800 x1830960573621248/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140883.910376:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7800 with x1830960573621248 ext(4194304->4886527) 00002000:00010000:3.0:1746140883.910381:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba7800 00000100:00100000:2.0:1746140883.910466:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8554 00000100:00100000:2.0:1746140883.910479:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573621248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140883.913964:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140883.914034:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573621504 00000100:00100000:3.0:1746140883.914042:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573621504 00000100:00100000:3.0:1746140883.914085:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10664 00000100:00100000:3.0:1746140883.914093:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+291:32561:x1830960573621504:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140883.914127:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140883.914145:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea000/0x8156357b7fdb987b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1177 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.914236:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914249:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914259:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914271:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914277:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914283:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914412:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914420:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914426:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:3.0:1746140883.914434:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140883.914506:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914516:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914522:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914527:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bebe00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140883.914530:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914536:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914545:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140883.914548:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140883.914552:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914555:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bebe00/0x8156357b7fdb9882 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914574:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914579:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914582:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914586:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093beb400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140883.914588:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914594:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914599:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871300) 00010000:00010000:3.0:1746140883.914601:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140883.914602:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914606:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb400/0x8156357b7fdb9889 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140883.914635:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea000/0x8156357b7fdb987b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 294 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.914643:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 293 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.914649:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140883.914650:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140883.914652:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bea200, rc 0) 00000100:00100000:3.0:1746140883.914690:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+293:32561:x1830960573621504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 597us (734us total) trans 8589944954 rc 0/0 00000100:00100000:3.0:1746140883.914696:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10664 00000100:00100000:2.0:1746140883.918768:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573621248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8285us (10623us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140883.918779:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8554 00002000:00100000:2.0:1746140883.918791:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880092ba7800 x1830960573621248/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/440 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.918799:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7800 with x1830960573621248 ext(4194304->4886527) 00002000:00010000:2.0:1746140883.918804:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba7800 00000100:00100000:0.0:1746140883.933657:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.933725:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573621760 00000100:00100000:1.0:1746140883.933733:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573621760 00000100:00100000:1.0:1746140883.933787:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4667 00000100:00100000:1.0:1746140883.933915:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+293:32556:x1830960573621760:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140883.934272:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+294:32556:x1830960573621760:12345-192.168.204.16@tcp:35:cat.0 Request processed in 477us (621us total) trans 8589944955 rc 0/0 00000100:00100000:1.0:1746140883.934278:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4667 00000100:00100000:0.0:1746140883.939041:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.939092:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573621888 00000100:00100000:1.0:1746140883.939100:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573621888 00000100:00100000:1.0:1746140883.939435:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16663 00000100:00100000:1.0:1746140883.939444:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:32561:x1830960573621888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140883.939462:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140883.939479:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a117e expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.939506:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 22 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.939514:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 6 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.939520:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.939525:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.939526:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140883.939530:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [376832->679935] (req 376832->679935) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 22 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.939561:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.939572:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 19 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140883.939586:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008064:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.941083:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 6 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140883.941094:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 6 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140883.941103:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.941178:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 22 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.941187:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 22 pid: 4784 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140883.941195:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008320:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140883.941213:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140883.946521:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140883.946573:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.946844:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573622016 00000100:00100000:2.0:1746140883.946853:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573622016 00000100:00100000:3.0:1746140883.946874:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573622144 00000100:00100000:3.0:1746140883.946879:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573622144 00010000:00010000:2.0:1746140883.946886:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 7 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140883.946895:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 23 pid: 4784 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140883.946914:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8631 00000100:00100000:2.0:1746140883.946920:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573622016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140883.946926:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8632 00010000:00010000:2.0:1746140883.946932:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140883.946933:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573622144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140883.946940:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140883.946951:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 23 pid: 4784 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140883.946951:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 7 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140883.946961:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 23 pid: 4784 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140883.947519:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 7 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140883.947544:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.947584:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573622016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 663us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.947590:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8631 00000100:00100000:0.0:1746140883.947597:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.947606:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573622272 00000100:00100000:2.0:1746140883.947609:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573622272 00010000:00010000:2.0:1746140883.947618:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 20 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:2.0:1746140883.947639:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8633 00000100:00100000:2.0:1746140883.947643:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573622272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140883.947650:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140883.947659:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 20 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140883.947667:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 20 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140883.947678:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140883.947708:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573622272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 64us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140883.947713:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8633 00010000:00010000:3.0:1746140883.947740:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.947743:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140883.947749:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.947765:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140883.947802:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140883.947814:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576008448:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140883.947874:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746140883.949344:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8bf000/0x8156357b7fdb9739 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1097 expref: 19 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140883.949381:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008064:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.949394:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009299b800/0x8156357b7fdb97e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f2 expref: 6 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140883.949402:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.949410:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4182000/0x8156357b7fdb96ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1082 expref: 23 pid: 4784 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140883.949416:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008320:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140883.949441:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 22 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140883.949450:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427800, rc 0) 00000100:00100000:1.0:1746140883.949485:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:32561:x1830960573621888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10042us (10451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140883.949492:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16663 00000100:00100000:3.0:1746140883.950489:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576008448:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140883.950501:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140883.950523:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573622144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3590us (3949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140883.950532:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8632 00000100:00100000:0.0:1746140883.951458:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.951776:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573622528 00000100:00100000:2.0:1746140883.951783:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573622528 00002000:00100000:2.0:1746140883.951822:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (376832->380927) req@ffff880099494700 x1830960573622528/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.951830:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494700 with x1830960573622528 ext(376832->380927) 00002000:00010000:2.0:1746140883.951835:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099494700 00000100:00100000:2.0:1746140883.951863:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8555 00000100:00100000:2.0:1746140883.951869:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573622528:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140883.952000:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573622528:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 131us (544us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140883.952006:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8555 00002000:00100000:2.0:1746140883.952010:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (376832->380927) req@ffff880099494700 x1830960573622528/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.952017:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494700 with x1830960573622528 ext(376832->380927) 00002000:00010000:2.0:1746140883.952019:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099494700 00000100:00100000:0.0:1746140883.959051:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.959178:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573622784 00000100:00100000:2.0:1746140883.959188:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573622784 00002000:00100000:2.0:1746140883.959228:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (675840->679935) req@ffff880099495880 x1830960573622784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/0 e 0 to 0 dl 1746140894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.959239:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495880 with x1830960573622784 ext(675840->679935) 00002000:00010000:2.0:1746140883.959245:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099495880 00000100:00100000:2.0:1746140883.960603:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8556 00000100:00100000:2.0:1746140883.960614:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573622784:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140883.960798:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573622784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 187us (1760us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140883.960805:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8556 00002000:00100000:2.0:1746140883.960811:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (675840->679935) req@ffff880099495880 x1830960573622784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746140894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140883.960820:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495880 with x1830960573622784 ext(675840->679935) 00002000:00010000:2.0:1746140883.960824:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099495880 00000100:00100000:0.0:1746140883.963097:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140883.963827:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573623040 00000100:00100000:1.0:1746140883.963836:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573623040 00000100:00100000:1.0:1746140883.963884:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4668 00000100:00100000:1.0:1746140883.963890:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+294:32561:x1830960573623040:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140883.964553:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+295:32561:x1830960573623040:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 661us (1462us total) trans 8589944956 rc 0/0 00000100:00100000:1.0:1746140883.964560:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4668 00000100:00100000:0.0:1746140883.997129:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140883.997778:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573623296 00000100:00100000:2.0:1746140883.997790:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573623296 00000100:00100000:2.0:1746140883.997851:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10665 00000100:00100000:2.0:1746140883.997859:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32566:x1830960573623296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140883.997883:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140883.997900:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb98a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1185 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.998012:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998025:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998035:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998047:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998052:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998057:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998172:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998180:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998185:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140883.998193:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140883.998278:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998284:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998289:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998294:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c438000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.998298:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998346:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998358:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140883.998361:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.998364:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998369:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998390:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998395:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998399:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998402:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c438c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140883.998405:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998408:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998413:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293900) 00010000:00010000:2.0:1746140883.998415:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140883.998417:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998421:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb98b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140883.998457:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb98a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 29 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.998467:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 28 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140883.998473:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140883.998476:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140883.998478:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c438a00, rc 0) 00000100:00100000:2.0:1746140883.999867:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32566:x1830960573623296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2001us (2753us total) trans 8589944957 rc 0/0 00000100:00100000:2.0:1746140883.999877:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10665 00000100:00100000:0.0:1746140884.003789:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.003850:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.004037:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573623424 00000100:00100000:1.0:1746140884.004047:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573623424 00000100:00100000:1.0:1746140884.004126:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573623552 00000100:00100000:1.0:1746140884.004129:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573623552 00000100:00100000:1.0:1746140884.004152:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16664 00000100:00100000:1.0:1746140884.004160:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573623424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.004176:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.004192:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e426600/0x8156357b7fdb98c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a118c expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.004259:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008576:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140884.004362:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.004500:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16665 00000100:00100000:2.0:1746140884.004508:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573623552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.004517:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.004532:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1193 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.004546:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.004548:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.004557:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 13 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.004579:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 13 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.004589:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c439200, rc 0) 00000100:00100000:2.0:1746140884.004623:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573623552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 116us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.004629:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16665 00000100:00080000:0.0:1746140884.005928:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746140884.006178:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008576:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140884.006213:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e426600/0x8156357b7fdb98c8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a118c expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.006225:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e426600/0x8156357b7fdb98c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a118c expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.006250:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e426600, rc 0) 00000100:00100000:1.0:1746140884.006333:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573623424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2147us (2531us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140884.006340:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16664 00000100:00100000:0.0:1746140884.009014:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.009185:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573623680 00000100:00100000:1.0:1746140884.009194:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573623680 00000100:00100000:1.0:1746140884.009249:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16666 00000100:00100000:1.0:1746140884.009257:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+19:32566:x1830960573623680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.009275:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.009289:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a119a expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.009338:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 20 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.009345:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.009347:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.009350:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 20 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.009376:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 20 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.009386:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 20 pid: 9872 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.009398:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008704:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.010112:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c538300 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.012011:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576008704:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.012037:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 20 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.012052:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427200, rc 0) 00000100:00100000:1.0:1746140884.012084:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32566:x1830960573623680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2828us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.012095:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16666 00000100:00100000:0.0:1746140884.013083:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.013295:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573623808 00000100:00100000:2.0:1746140884.013328:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573623808 00002000:00100000:2.0:1746140884.013364:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (376832->679935) req@ffff880099496a00 x1830960573623808/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.013379:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496a00 with x1830960573623808 ext(376832->679935) 00010000:00010000:2.0:1746140884.013386:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 21 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.013399:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 21 pid: 9872 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.013405:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099496a00 00000100:00100000:2.0:1746140884.013431:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1774 00000100:00100000:2.0:1746140884.013437:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573623808:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140884.019487:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573623808:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6041us (6397us total) trans 21474841322 rc 0/0 00000100:00100000:2.0:1746140884.019500:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1774 00002000:00100000:2.0:1746140884.019511:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (376832->679935) req@ffff880099496a00 x1830960573623808/t21474841322(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.019520:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496a00 with x1830960573623808 ext(376832->679935) 00010000:00010000:2.0:1746140884.019529:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.019543:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.019551:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099496a00 00000100:00100000:0.0:1746140884.023147:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.023274:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573623936 00000100:00100000:3.0:1746140884.023283:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573623936 00010000:00010000:3.0:1746140884.023473:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.023585:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8634 00000100:00100000:3.0:1746140884.023593:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573623936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.023606:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.023626:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.023636:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.023656:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e427800/0x8156357b7fdb989e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 376832->679935) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a117e expref: 23 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.023836:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.023839:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.023846:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.023854:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.023886:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.023903:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576008832:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140884.024330:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.026938:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576008832:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140884.026961:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.027077:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573623936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3482us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.027088:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8634 00000100:00100000:0.0:1746140884.030852:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.031520:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573624192 00000100:00100000:2.0:1746140884.031531:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573624192 00002000:00100000:2.0:1746140884.031575:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880099494380 x1830960573624192/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.031586:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494380 with x1830960573624192 ext(0->1048575) 00002000:00010000:2.0:1746140884.031591:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099494380 00000100:00100000:2.0:1746140884.031624:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8557 00000100:00100000:2.0:1746140884.031631:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573624192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.041581:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573624192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9939us (10725us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.041594:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8557 00002000:00100000:2.0:1746140884.041606:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880099494380 x1830960573624192/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.041615:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494380 with x1830960573624192 ext(0->1048575) 00002000:00010000:2.0:1746140884.041621:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099494380 00000100:00100000:0.0:1746140884.060248:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.060777:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573624448 00000100:00100000:2.0:1746140884.060787:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573624448 00000100:00100000:2.0:1746140884.061017:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10666 00000100:00100000:2.0:1746140884.061027:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32568:x1830960573624448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140884.061050:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.061068:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11a1 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.061180:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140884.061194:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 294 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.061202:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 29 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.061208:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140884.061239:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 29 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.061251:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 29 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.061263:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576008960:192.168.204.16@tcp:104: 00000100:00080000:0.0:1746140884.061465:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746140884.061674:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 294 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.061683:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 294 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.061690:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576009088:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.061709:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.061749:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.062224:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573624704 00000100:00100000:3.0:1746140884.062229:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573624704 00000100:00100000:3.0:1746140884.062277:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10667 00000100:00100000:3.0:1746140884.062282:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+295:32571:x1830960573624704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.062292:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.062300:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb800/0x8156357b7fdb98eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11a8 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.062363:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.062373:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.062383:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:3.0:1746140884.062391:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140884.062497:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093beb800/0x8156357b7fdb98eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 298 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.062518:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 297 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.062525:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.062528:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746140884.062530:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140884.062536:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140884.062540:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bea800, rc 0) 00000100:00100000:3.0:1746140884.062581:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:32571:x1830960573624704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 298us (831us total) trans 8589944958 rc 0/0 00000100:00100000:3.0:1746140884.062587:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10667 00000100:00080000:0.0:1746140884.062669:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140884.063829:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.063865:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.064299:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573624960 00000100:00100000:2.0:1746140884.064332:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573624960 00000100:00100000:0.0:1746140884.064344:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.064363:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573625088 00000100:00100000:0.0:1746140884.064366:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573625088 00002000:00100000:2.0:1746140884.064373:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099497480 x1830960573624960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.064382:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497480 with x1830960573624960 ext(2097152->3145727) 00002000:00100000:0.0:1746140884.064384:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880099494e00 x1830960573625088/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746140884.064387:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497480 00002000:00100000:0.0:1746140884.064392:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494e00 with x1830960573625088 ext(3145728->4194303) 00002000:00010000:0.0:1746140884.064395:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099494e00 00000100:00100000:2.0:1746140884.064416:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573625472 00000100:00100000:2.0:1746140884.064419:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573625472 00002000:00100000:2.0:1746140884.064432:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880099495c00 x1830960573625472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.064444:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495c00 with x1830960573625472 ext(3145728->4194303) 00002000:00010000:2.0:1746140884.064449:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099495c00 00000100:00100000:1.0:1746140884.064606:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8558 00000100:00100000:1.0:1746140884.064620:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8559 00000100:00100000:1.0:1746140884.064627:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573625088:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.064660:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8560 00000100:00100000:0.0:1746140884.064665:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573625472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140884.065110:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573624960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.066619:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.066653:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.066659:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573625728 00000100:00100000:3.0:1746140884.066667:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573625728 00000100:00100000:1.0:1746140884.066800:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576008960:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.066811:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576009088:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.066835:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:1.0:1746140884.066855:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573625600 00000100:00100000:1.0:1746140884.066858:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573625600 00010000:00010000:1.0:1746140884.066880:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 30 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.066904:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8635 00000100:00100000:1.0:1746140884.066911:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573625600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.066924:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.066930:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 30 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.066939:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 30 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.066962:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb98ba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1185 expref: 30 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.066980:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.066985:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.066993:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.066998:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.067024:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573625600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.067030:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8635 00010000:00010000:3.0:1746140884.067175:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.067204:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8636 00000100:00100000:3.0:1746140884.067209:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:1984:x1830960573625728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.067217:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.067221:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.067229:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.067241:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea200/0x8156357b7fdb9890 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1177 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.067263:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.067266:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140884.067273:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140884.067279:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140884.067295:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.067334:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:1984:x1830960573625728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 125us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.067340:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8636 00010000:00010000:1.0:1746140884.067343:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.067349:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:1.0:1746140884.067368:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140884.067510:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb98dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 30 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.067522:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 29 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.067528:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.067531:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746140884.067533:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c439800, rc 0) 00000100:00100000:1.0:1746140884.067551:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:32568:x1830960573624448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6528us (7316us total) trans 8589944959 rc 0/0 00000100:00100000:1.0:1746140884.067560:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10666 00000100:00100000:0.0:1746140884.067827:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.067915:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573625856 00000100:00100000:1.0:1746140884.067919:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573625856 00000100:00100000:1.0:1746140884.067943:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16667 00000100:00100000:1.0:1746140884.067948:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573625856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.067961:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.067974:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11af expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.067992:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.067994:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.068002:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 23 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.068014:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 23 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.068022:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e426800, rc 0) 00000100:00100000:1.0:1746140884.068041:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573625856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 93us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.068046:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16667 00000100:00100000:0.0:1746140884.076867:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.076934:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573626112 00000100:00100000:3.0:1746140884.076943:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573626112 00002000:00100000:3.0:1746140884.076985:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880099496300 x1830960573626112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.076995:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496300 with x1830960573626112 ext(0->1048575) 00002000:00010000:3.0:1746140884.077001:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099496300 00000100:00100000:3.0:1746140884.077035:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8561 00000100:00100000:3.0:1746140884.077042:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573626112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140884.083886:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573625472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19206us (19528us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.083900:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8560 00002000:00100000:1.0:1746140884.083912:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880099495c00 x1830960573625472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.083929:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495c00 with x1830960573625472 ext(3145728->4194303) 00002000:00010000:1.0:1746140884.083935:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099495c00 00000100:00100000:2.0:1746140884.084588:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573625088:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19960us (20720us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.084595:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8559 00002000:00100000:2.0:1746140884.084601:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880099494e00 x1830960573625088/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.084608:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494e00 with x1830960573625088 ext(3145728->4194303) 00002000:00010000:2.0:1746140884.084612:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099494e00 00000100:00100000:1.0:1746140884.092429:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573624960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27803us (28594us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.092441:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8558 00002000:00100000:1.0:1746140884.092452:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099497480 x1830960573624960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.092463:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497480 with x1830960573624960 ext(2097152->3145727) 00002000:00010000:1.0:1746140884.092468:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497480 00000100:00100000:3.0:1746140884.092742:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573626112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15698us (15885us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.092753:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8561 00002000:00100000:3.0:1746140884.092759:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880099496300 x1830960573626112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.092767:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496300 with x1830960573626112 ext(0->1048575) 00002000:00010000:3.0:1746140884.092771:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099496300 00000100:00100000:0.0:1746140884.105991:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.106297:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573626240 00000100:00100000:2.0:1746140884.106468:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573626240 00000100:00100000:0.0:1746140884.106624:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.106766:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16668 00000100:00100000:2.0:1746140884.106774:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32568:x1830960573626240:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140884.106793:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.106813:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11b6 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.106843:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 14 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.106851:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 6 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.106858:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 30 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.106865:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.106867:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.106870:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1314816->1564671] (req 1314816->1564671) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.106903:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 30 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.106916:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 30 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:2.0:1746140884.106928:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009216:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.108364:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573626496 00000100:00100000:3.0:1746140884.108376:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573626496 00002000:00100000:3.0:1746140884.108425:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4804607) req@ffff88009ab6df80 x1830960573626496/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.108438:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6df80 with x1830960573626496 ext(4194304->4804607) 00002000:00010000:3.0:1746140884.108443:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab6df80 00000100:00100000:3.0:1746140884.108473:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8562 00000100:00100000:3.0:1746140884.108479:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573626496:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140884.109794:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 6 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.109811:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 6 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:2.0:1746140884.109824:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009344:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.111884:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 14 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.111906:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 14 pid: 32376 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.111921:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009472:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.111971:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.112296:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.112355:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573626752 00000100:00100000:1.0:1746140884.112363:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573626752 00002000:00100000:1.0:1746140884.112403:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88012b180000 x1830960573626752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.112412:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180000 with x1830960573626752 ext(2097152->3145727) 00002000:00010000:1.0:1746140884.112417:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b180000 00000100:00100000:1.0:1746140884.112722:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8563 00000100:00100000:1.0:1746140884.112855:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573626752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.115821:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009216:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.115837:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009344:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.115847:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009472:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.115881:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1314816->1564671] (req 1314816->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.115901:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c439400, rc 0) 00000100:00100000:2.0:1746140884.115950:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32568:x1830960573626240:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9176us (9971us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.115958:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16668 00000100:00100000:2.0:1746140884.117249:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.117289:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.117329:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573626880 00000100:00100000:3.0:1746140884.117337:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573626880 00000100:00100000:2.0:1746140884.117341:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.117358:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573627136 00000100:00100000:2.0:1746140884.117362:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573627136 00010000:00010000:3.0:1746140884.117374:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 31 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.117377:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 14 pid: 32376 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.117398:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573627008 00000100:00100000:2.0:1746140884.117401:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573627008 00010000:00010000:2.0:1746140884.117410:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 7 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.117416:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8637 00000100:00100000:3.0:1746140884.117423:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573627136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140884.117428:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8638 00000100:00100000:2.0:1746140884.117432:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573626880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140884.117434:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8639 00010000:00010000:3.0:1746140884.117436:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.117439:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140884.117443:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573627008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.117451:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.117459:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 14 pid: 32376 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.117461:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 7 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.117471:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 7 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.117480:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 14 pid: 32376 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.117504:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009299aa00/0x8156357b7fdb97e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10f9 expref: 7 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.117509:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9778 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10ba expref: 14 pid: 32376 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.117527:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140884.117528:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.117558:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573627136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.117564:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8637 00010000:00010000:2.0:1746140884.117570:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 31 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.117580:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 31 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.117593:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093877e00/0x8156357b7fdb97d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a10e4 expref: 31 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.117607:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.117609:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.117616:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 12 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.117624:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 12 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.117652:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 12 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.117666:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576009600:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140884.117724:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.118150:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573627008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 708us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.118158:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8639 00000100:00100000:3.0:1746140884.120530:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573626496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12038us (13894us total) trans 0 rc 610304/610304 00000100:00100000:3.0:1746140884.120543:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8562 00002000:00100000:3.0:1746140884.120555:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4804607) req@ffff88009ab6df80 x1830960573626496/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 610304/610304 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.120565:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6df80 with x1830960573626496 ext(4194304->4804607) 00002000:00010000:3.0:1746140884.120572:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab6df80 00000100:00100000:3.0:1746140884.125053:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576009600:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140884.125180:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.125919:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573626880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8482us (8675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.125932:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8638 00000100:00100000:1.0:1746140884.126980:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.127631:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573626752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14777us (15334us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.127641:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8563 00002000:00100000:2.0:1746140884.127652:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88012b180000 x1830960573626752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.127662:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180000 with x1830960573626752 ext(2097152->3145727) 00002000:00010000:2.0:1746140884.127668:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b180000 00000100:00100000:1.0:1746140884.128016:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.128103:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573627648 00000100:00100000:0.0:1746140884.128120:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573627648 00000100:00100000:0.0:1746140884.129136:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4669 00000100:00100000:0.0:1746140884.129146:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+29:32566:x1830960573627648:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746140884.129365:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+30:32566:x1830960573627648:12345-192.168.204.16@tcp:35:cat.0 Request processed in 221us (1350us total) trans 8589944960 rc 0/0 00000100:00100000:0.0:1746140884.129371:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4669 00000100:00100000:2.0:1746140884.131976:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573627392 00000100:00100000:2.0:1746140884.131989:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573627392 00002000:00100000:2.0:1746140884.132048:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1314816->1318911) req@ffff8800a6bafb80 x1830960573627392/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.132058:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bafb80 with x1830960573627392 ext(1314816->1318911) 00002000:00010000:2.0:1746140884.132063:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6bafb80 00000100:00100000:2.0:1746140884.132091:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8564 00000100:00100000:2.0:1746140884.132099:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573627392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.132296:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573627392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 198us (5319us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140884.132302:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8564 00002000:00100000:2.0:1746140884.132325:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1314816->1318911) req@ffff8800a6bafb80 x1830960573627392/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.132331:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bafb80 with x1830960573627392 ext(1314816->1318911) 00002000:00010000:2.0:1746140884.132333:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6bafb80 00000100:00100000:0.0:1746140884.132849:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.132910:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573627776 00000100:00100000:2.0:1746140884.132915:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573627776 00000100:00100000:2.0:1746140884.132935:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16669 00000100:00100000:2.0:1746140884.132940:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573627776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.132949:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.132969:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb9915 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11bd expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.133012:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140884.133071:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.137384:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009728:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140884.137418:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb9915 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11bd expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.137432:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb9915 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11bd expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.137446:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b465a00, rc 0) 00000100:00100000:2.0:1746140884.140492:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573627776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7535us (7628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140884.140504:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16669 00000100:00100000:1.0:1746140884.141844:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.141915:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573628032 00000100:00100000:3.0:1746140884.141923:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573628032 00002000:00100000:3.0:1746140884.141968:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1560576->1564671) req@ffff8800a55e1500 x1830960573628032/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.141978:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e1500 with x1830960573628032 ext(1560576->1564671) 00002000:00010000:3.0:1746140884.141984:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55e1500 00000100:00100000:3.0:1746140884.142196:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8565 00000100:00100000:3.0:1746140884.142204:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960573628032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.142393:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960573628032:12345-192.168.204.16@tcp:3:cat.0 Request processed in 190us (555us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140884.142399:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8565 00002000:00100000:3.0:1746140884.142404:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1560576->1564671) req@ffff8800a55e1500 x1830960573628032/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.142411:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e1500 with x1830960573628032 ext(1560576->1564671) 00002000:00010000:3.0:1746140884.142414:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55e1500 00000100:00100000:0.0:1746140884.146622:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.146950:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573628160 00000100:00100000:2.0:1746140884.146960:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573628160 00000100:00100000:2.0:1746140884.147229:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16670 00000100:00100000:2.0:1746140884.147237:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573628160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.147256:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.147274:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb991c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11c4 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.147491:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009856:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140884.147905:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.149457:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009856:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140884.149484:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb991c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11c4 expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.149497:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb991c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11c4 expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.149523:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b465800, rc 0) 00000100:00100000:2.0:1746140884.149559:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573628160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2322us (2950us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140884.149568:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16670 00000100:00100000:0.0:1746140884.152637:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.152943:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573628288 00000100:00100000:2.0:1746140884.152953:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573628288 00000100:00100000:2.0:1746140884.153009:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16671 00000100:00100000:2.0:1746140884.153016:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573628288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.154126:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.154146:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b464600/0x8156357b7fdb9923 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11cb expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.154203:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009984:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140884.154704:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.155417:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576010112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746140884.155454:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.155520:0:8462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576010112 00000100:00100000:3.0:1746140884.155525:0:8462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576010112 00000100:00080000:0.0:1746140884.155933:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746140884.155987:0:8462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1746140884.155994:0:8462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3311:x1830960576010112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746140884.156012:0:8462:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 688193536 pending 11927552 free 3849322496 avail 3847225344 00000100:00100000:0.0:1746140884.156865:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576009984:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140884.156891:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b464600/0x8156357b7fdb9923 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11cb expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.156913:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b464600/0x8156357b7fdb9923 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11cb expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140884.156945:0:8462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3311:x1830960576010112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 951us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.156952:0:8462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00010000:0.0:1746140884.157003:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b464600, rc 0) 00000100:00100000:0.0:1746140884.157044:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573628288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4028us (4417us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140884.157051:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16671 00000100:00100000:2.0:1746140884.157295:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576010112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746140884.182942:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.184020:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573628544 00000100:00100000:1.0:1746140884.184031:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573628544 00000100:00100000:1.0:1746140884.184100:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10668 00000100:00100000:1.0:1746140884.184110:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:32577:x1830960573628544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140884.184145:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.184167:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42200/0x8156357b7fdb992a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11d2 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.184289:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184320:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184332:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184346:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184352:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184356:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184469:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009299b800/0x8156357b7fdb993f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184477:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009299b800/0x8156357b7fdb993f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184483:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009299b800/0x8156357b7fdb993f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:1.0:1746140884.184491:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140884.184581:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184588:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184593:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184598:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed43200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.184602:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184609:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184620:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140884.184622:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140884.184627:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184631:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43200/0x8156357b7fdb9931 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184647:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184652:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184657:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184661:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009299aa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.184663:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184672:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184678:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130d2fd00) 00010000:00010000:1.0:1746140884.184679:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140884.184681:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184685:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009299aa00/0x8156357b7fdb9938 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140884.184725:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42200/0x8156357b7fdb992a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d2 expref: 299 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.184737:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009299b800/0x8156357b7fdb993f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d2 expref: 298 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.184743:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.184745:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746140884.184747:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299b800, rc 0) 00000100:00100000:1.0:1746140884.184802:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+298:32577:x1830960573628544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 694us (1871us total) trans 8589944961 rc 0/0 00000100:00100000:1.0:1746140884.184808:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10668 00000100:00100000:0.0:1746140884.190189:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.191027:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573628672 00000100:00100000:3.0:1746140884.191037:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573628672 00000100:00100000:3.0:1746140884.191103:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 768 00000100:00100000:3.0:1746140884.191121:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+298:1982:x1830960573628672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.191139:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.191166:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009299b800/0x8156357b7fdb993f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d2 expref: 298 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.191199:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.191203:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.191252:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:1982:x1830960573628672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.191258:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 768 00000100:00100000:1.0:1746140884.203632:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55f02bfa-093a-4e1f-9a53-4ed2824b373e:3312:1830960576010240:0@lo:400:kworker.0 00000100:00100000:0.0:1746140884.203632:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1830960576010496:0@lo:400:kworker.0 00000100:00100000:2.0:1746140884.203702:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1830960576010368:0@lo:400:kworker.0 00000100:00100000:1.0:1746140884.203794:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.203809:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.203843:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576010624:0@lo:400:kworker.0 00000100:00100000:1.0:1746140884.203845:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1830960576010752:0@lo:400:kworker.0 00000100:00100000:1.0:1746140884.203868:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.203869:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.203906:0:14739:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576010240 00000100:00100000:2.0:1746140884.203912:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576010624 00000100:00100000:1.0:1746140884.203913:0:14739:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576010240 00000100:00100000:2.0:1746140884.203915:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576010624 00000100:00100000:1.0:1746140884.203958:0:14739:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1746140884.203965:0:14739:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009953a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3312:x1830960576010240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746140884.204007:0:14739:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009953a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3312:x1830960576010240:12345-0@lo:400:kworker.0 Request processed in 42us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.204013:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576010368 00000100:00100000:3.0:1746140884.204018:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576010368 00000100:00100000:3.0:1746140884.204043:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576010752 00000100:00100000:3.0:1746140884.204045:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576010752 00000100:00100000:3.0:1746140884.204057:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1746140884.204063:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1830960576010368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746140884.204105:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1830960576010368:12345-0@lo:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.204110:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1746140884.204135:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1746140884.204139:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1830960576010752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746140884.204159:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1830960576010752:12345-0@lo:400:kworker.0 Request processed in 21us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.204163:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1746140884.204207:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746140884.204235:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746140884.204240:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140884.204249:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576010496 00000100:00100000:0.0:1746140884.204252:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576010496 00000100:00100000:0.0:1746140884.204273:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1746140884.204277:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1830960576010496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140884.204333:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1830960576010496:12345-0@lo:400:kworker.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.204339:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1746140884.204352:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140884.204372:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1830960576010496:0@lo:400:kworker.0 00000100:00100000:0.0:1746140884.204405:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1746140884.204454:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3311:x1830960576010624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140884.204483:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3311:x1830960576010624:12345-0@lo:400:kworker.0 Request processed in 32us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.204488:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1746140884.204510:0:3311:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841290 gen 2 00000004:00080000:0.0:1746140884.204515:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b069180, transno 21474841213 00000004:00080000:0.0:1746140884.204521:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b068a80, transno 21474841214 00000004:00080000:0.0:1746140884.204523:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b068380, transno 21474841215 00000004:00080000:0.0:1746140884.204526:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06b480, transno 21474841216 00000004:00080000:0.0:1746140884.204528:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06b800, transno 21474841217 00000100:00100000:1.0:1746140884.204566:0:14739:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1746140884.204577:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1830960576010368:0@lo:400:kworker.0 00000100:00100000:1.0:1746140884.204601:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55f02bfa-093a-4e1f-9a53-4ed2824b373e:3312:1830960576010240:0@lo:400:kworker.0 00000100:00100000:1.0:1746140884.204611:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1830960576010752:0@lo:400:kworker.0 00000004:00080000:0.0:1746140884.205255:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519f80, transno 21474841218 00000004:00080000:0.0:1746140884.205260:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b069f80, transno 21474841219 00000004:00080000:0.0:1746140884.205262:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06ad80, transno 21474841220 00000004:00080000:0.0:1746140884.205265:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc08e00, transno 21474841221 00000004:00080000:0.0:1746140884.205267:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181f80, transno 21474841222 00000004:00080000:0.0:1746140884.205270:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180380, transno 21474841223 00000004:00080000:0.0:1746140884.205272:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180e00, transno 21474841224 00000004:00080000:0.0:1746140884.205274:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180a80, transno 21474841225 00000004:00080000:0.0:1746140884.205276:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b182d80, transno 21474841226 00000004:00080000:0.0:1746140884.205278:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181500, transno 21474841227 00000004:00080000:0.0:1746140884.205280:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181c00, transno 21474841228 00000004:00080000:0.0:1746140884.205281:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ca80, transno 21474841229 00000004:00080000:0.0:1746140884.205283:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180700, transno 21474841230 00000004:00080000:0.0:1746140884.205285:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0dc00, transno 21474841241 00000004:00080000:0.0:1746140884.205287:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0df80, transno 21474841242 00000004:00080000:0.0:1746140884.205289:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0f480, transno 21474841243 00000004:00080000:0.0:1746140884.205290:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ed80, transno 21474841244 00000004:00080000:0.0:1746140884.205292:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0e300, transno 21474841245 00000004:00080000:0.0:1746140884.205293:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0d500, transno 21474841246 00000004:00080000:0.0:1746140884.205295:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ea00, transno 21474841247 00000004:00080000:0.0:1746140884.205296:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0d180, transno 21474841248 00000004:00080000:0.0:1746140884.205298:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ce00, transno 21474841249 00000004:00080000:0.0:1746140884.205299:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0d880, transno 21474841253 00000004:00080000:0.0:1746140884.205301:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0fb80, transno 21474841254 00000004:00080000:0.0:1746140884.205302:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0f800, transno 21474841255 00000004:00080000:0.0:1746140884.205331:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abdca80, transno 21474841256 00000004:00080000:0.0:1746140884.205333:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0c700, transno 21474841257 00000004:00080000:0.0:1746140884.205335:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abdd180, transno 21474841258 00000004:00080000:0.0:1746140884.205338:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0c000, transno 21474841259 00000004:00080000:0.0:1746140884.205341:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abdc000, transno 21474841260 00000004:00080000:0.0:1746140884.205343:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b892680, transno 21474841261 00000004:00080000:0.0:1746140884.205346:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bae680, transno 21474841262 00000004:00080000:0.0:1746140884.205349:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bae300, transno 21474841263 00000004:00080000:0.0:1746140884.205351:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bad500, transno 21474841264 00000004:00080000:0.0:1746140884.205354:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baea00, transno 21474841265 00000004:00080000:0.0:1746140884.205356:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baca80, transno 21474841266 00000004:00080000:0.0:1746140884.205359:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6badc00, transno 21474841267 00000004:00080000:0.0:1746140884.205362:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f170a80, transno 21474841268 00000004:00080000:0.0:1746140884.205364:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bac700, transno 21474841269 00000004:00080000:0.0:1746140884.205367:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baed80, transno 21474841270 00000004:00080000:0.0:1746140884.205369:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f171180, transno 21474841271 00000004:00080000:0.0:1746140884.205372:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f172a00, transno 21474841272 00000004:00080000:0.0:1746140884.205374:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece3b80, transno 21474841273 00000004:00080000:0.0:1746140884.205376:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece2680, transno 21474841274 00000004:00080000:0.0:1746140884.205379:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece0000, transno 21474841275 00000004:00080000:0.0:1746140884.205382:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece1500, transno 21474841276 00000004:00080000:0.0:1746140884.205385:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece2a00, transno 21474841277 00000004:00080000:0.0:1746140884.205387:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece0380, transno 21474841278 00000004:00080000:0.0:1746140884.205389:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece0a80, transno 21474841279 00000004:00080000:0.0:1746140884.205392:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eeab800, transno 21474841282 00000004:00080000:0.0:1746140884.205395:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea9180, transno 21474841283 00000004:00080000:0.0:1746140884.205397:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea9c00, transno 21474841284 00000004:00080000:0.0:1746140884.205399:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eeabb80, transno 21474841285 00000004:00080000:0.0:1746140884.205402:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea9880, transno 21474841286 00000004:00080000:0.0:1746140884.205405:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea9500, transno 21474841287 00000004:00080000:0.0:1746140884.205407:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea8e00, transno 21474841288 00000004:00080000:0.0:1746140884.205409:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea8a80, transno 21474841289 00000004:00080000:0.0:1746140884.205411:0:3311:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bac380, transno 21474841290 00000100:00100000:0.0:1746140884.205419:0:3311:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012bf10000 x1830960575986944/t21474841294(21474841294) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746140898 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:0.0:1746140884.205439:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576010624:0@lo:400:kworker.0 00000004:00080000:2.0:1746140884.205910:0:14783:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 76 in progress, 0 in flight, 5 done 00000004:00080000:2.0:1746140884.206158:0:14783:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 18 in progress, 0 in flight, 58 done 00000100:00100000:0.0:1746140884.220921:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576010880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746140884.220993:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.221167:0:8462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576010880 00000100:00100000:3.0:1746140884.221176:0:8462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576010880 00000100:00100000:3.0:1746140884.221240:0:8462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1746140884.221251:0:8462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3313:x1830960576010880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746140884.221273:0:8462:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 681508864 pending 18743296 free 3847225344 avail 3845128192 00000100:00100000:3.0:1746140884.221337:0:8462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3313:x1830960576010880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.221343:0:8462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1746140884.221367:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576010880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746140884.249936:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.250405:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573628800 00000100:00100000:2.0:1746140884.250415:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573628800 00000100:00100000:2.0:1746140884.250457:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16672 00000100:00100000:2.0:1746140884.250464:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:32577:x1830960573628800:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140884.250481:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.250499:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11d9 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.250529:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 12 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.250536:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140884.250538:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140884.250541:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1122304->1748991] (req 1122304->1748991) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.250575:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 12 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.250586:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 12 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.250597:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576011008:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.250709:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.254422:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.254577:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576011008:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.254605:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1122304->1748991] (req 1122304->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.254622:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b465800, rc 0) 00000100:00100000:2.0:1746140884.254680:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:32577:x1830960573628800:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4212us (4753us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.254690:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16672 00000100:00100000:3.0:1746140884.254854:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573628928 00000100:00100000:3.0:1746140884.254860:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573628928 00002000:00100000:3.0:1746140884.254894:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1314816->1564671) req@ffff88009ab6d180 x1830960573628928/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.254904:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6d180 with x1830960573628928 ext(1314816->1564671) 00010000:00010000:3.0:1746140884.254909:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 13 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.254922:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 13 pid: 20960 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.254928:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ab6d180 00000100:00100000:3.0:1746140884.254944:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1775 00000100:00100000:3.0:1746140884.254950:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573628928:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140884.255855:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.255920:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573629184 00000100:00100000:3.0:1746140884.255924:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573629184 00000100:00100000:3.0:1746140884.256268:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10669 00000100:00100000:3.0:1746140884.256275:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:32580:x1830960573629184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.256292:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.256334:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9954 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11e0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.256727:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.256739:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.256748:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.256758:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.256763:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.256768:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257491:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb9969 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257501:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb9969 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257509:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb9969 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140884.257518:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140884.257605:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257611:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257621:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257626:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cd5600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.257630:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257637:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257647:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140884.257649:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.257652:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257656:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb995b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257692:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257697:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257702:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257706:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cd5800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.257708:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257712:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257722:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871300) 00010000:00010000:3.0:1746140884.257724:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.257725:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257729:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9962 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.257767:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9954 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11e0 expref: 33 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.257778:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb9969 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11e0 expref: 32 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.257783:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.257785:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140884.257787:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cd5000, rc 0) 00000100:00100000:3.0:1746140884.258641:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+32:32580:x1830960573629184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2364us (2785us total) trans 8589944962 rc 0/0 00000100:00100000:3.0:1746140884.258649:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10669 00000100:00100000:3.0:1746140884.260262:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573628928:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5305us (5844us total) trans 17179874044 rc 0/0 00000100:00100000:3.0:1746140884.260272:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1775 00002000:00100000:3.0:1746140884.260282:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1314816->1564671) req@ffff88009ab6d180 x1830960573628928/t17179874044(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.260292:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6d180 with x1830960573628928 ext(1314816->1564671) 00010000:00010000:3.0:1746140884.260301:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 15 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.260339:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 15 pid: 20960 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.260345:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ab6d180 00000100:00100000:0.0:1746140884.261438:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.261503:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573629312 00000100:00100000:2.0:1746140884.261511:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573629312 00000100:00100000:2.0:1746140884.261560:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 769 00000100:00100000:2.0:1746140884.261567:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573629312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.261582:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.261605:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb9969 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11e0 expref: 32 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.261637:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.261641:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.261676:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573629312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.261682:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 769 00000100:00100000:2.0:1746140884.262441:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.262962:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.263016:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573629568 00000100:00100000:3.0:1746140884.263021:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573629568 00010000:00010000:3.0:1746140884.263039:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 15 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.263088:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8640 00000100:00100000:0.0:1746140884.263093:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573629440 00000100:00100000:3.0:1746140884.263094:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573629568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140884.263097:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573629440 00010000:00010000:3.0:1746140884.263102:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.263134:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 16 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.263139:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16673 00010000:00010000:3.0:1746140884.263144:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 16 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.263146:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573629440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140884.263158:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.263159:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c439400/0x8156357b7fdb990e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1564671) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11b6 expref: 16 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.263168:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6800/0x8156357b7fdb9977 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11e7 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.263171:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.263172:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.263178:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.263190:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.263366:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f728000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576011136:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140884.263462:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.263471:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576011264:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140884.263536:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.263537:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b49d4300 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.265767:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576011264:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140884.265790:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.265838:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573629568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2743us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.265848:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8640 00000100:00100000:1.0:1746140884.265955:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f728000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576011136:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140884.265980:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6800/0x8156357b7fdb9977 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11e7 expref: 15 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.265991:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6800/0x8156357b7fdb9977 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11e7 expref: 15 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.266015:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb6800, rc 0) 00000100:00100000:1.0:1746140884.266035:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573629440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2890us (3594us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140884.266041:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16673 00000100:00100000:0.0:1746140884.268203:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.268299:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573629824 00000100:00100000:3.0:1746140884.268504:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573629824 00002000:00100000:2.0:1746140884.269061:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1122304->1126399) req@ffff88009f728380 x1830960573629824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.269072:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728380 with x1830960573629824 ext(1122304->1126399) 00002000:00010000:2.0:1746140884.269076:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f728380 00000100:00100000:2.0:1746140884.269143:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8566 00000100:00100000:2.0:1746140884.269151:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573629824:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140884.270201:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573629824:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1039us (1992us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140884.270213:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8566 00002000:00100000:2.0:1746140884.270226:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1122304->1126399) req@ffff88009f728380 x1830960573629824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.270234:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728380 with x1830960573629824 ext(1122304->1126399) 00002000:00010000:2.0:1746140884.270240:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f728380 00000100:00100000:0.0:1746140884.275498:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.275688:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573629952 00000100:00100000:1.0:1746140884.275698:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573629952 00000100:00100000:1.0:1746140884.275755:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16674 00000100:00100000:1.0:1746140884.275763:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32580:x1830960573629952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.275781:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.275801:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11ee expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.275834:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.275841:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.275842:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.275846:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.275875:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.275887:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 30 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.275899:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576011392:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.277748:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.279913:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576011392:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.279945:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.279961:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299a000, rc 0) 00000100:00100000:1.0:1746140884.280642:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32580:x1830960573629952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4879us (5154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.280652:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16674 00000100:00100000:0.0:1746140884.281410:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.282628:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573630208 00000100:00100000:3.0:1746140884.282639:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573630208 00002000:00100000:3.0:1746140884.282684:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1744896->1748991) req@ffff88009f728a80 x1830960573630208/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.282695:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728a80 with x1830960573630208 ext(1744896->1748991) 00010000:00010000:3.0:1746140884.282704:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.282719:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.282732:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f728a80 00000100:00100000:3.0:1746140884.282764:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1776 00000100:00100000:3.0:1746140884.282771:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573630208:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140884.282944:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573630208:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 174us (1535us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140884.282949:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1776 00002000:00100000:3.0:1746140884.282954:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1744896->1748991) req@ffff88009f728a80 x1830960573630208/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.282960:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728a80 with x1830960573630208 ext(1744896->1748991) 00010000:00010000:3.0:1746140884.282964:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.282972:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.282977:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f728a80 00000100:00100000:0.0:1746140884.286342:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.286395:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.286407:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573630464 00000100:00100000:2.0:1746140884.286416:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573630464 00002000:00100000:2.0:1746140884.286460:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1122304->1748991) req@ffff88009f728e00 x1830960573630464/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.286471:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728e00 with x1830960573630464 ext(1122304->1748991) 00010000:00010000:2.0:1746140884.286480:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.286494:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.286500:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f728e00 00000100:00100000:2.0:1746140884.286535:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1777 00000100:00100000:2.0:1746140884.286542:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573630464:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140884.288850:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573630720 00000100:00100000:3.0:1746140884.288863:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573630720 00000100:00100000:3.0:1746140884.288938:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4670 00000100:00100000:3.0:1746140884.288945:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:32577:x1830960573630720:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140884.289183:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+298:32577:x1830960573630720:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 237us (2787us total) trans 8589944963 rc 0/0 00000100:00100000:3.0:1746140884.289189:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4670 00000100:00100000:0.0:1746140884.293847:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.294183:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573630848 00000100:00100000:3.0:1746140884.294193:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573630848 00000100:00100000:3.0:1746140884.294632:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10670 00000100:00100000:3.0:1746140884.294640:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:32581:x1830960573630848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140884.294664:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.294679:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11f5 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.294734:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.294745:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.294754:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.294765:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.294770:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.294775:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.294877:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.294891:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 30 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.294897:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.294929:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 30 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.294940:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 30 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.294951:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576011520:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.295027:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746140884.295966:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140884.299704:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.299945:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573631104 00000100:00100000:1.0:1746140884.299955:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573631104 00000100:00100000:1.0:1746140884.299989:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4671 00000100:00100000:1.0:1746140884.299996:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009323b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+31:27321:x1830960573631104:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746140884.300367:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009323b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+32:27321:x1830960573631104:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 370us (672us total) trans 8589944964 rc 0/0 00000100:00100000:1.0:1746140884.300374:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4671 00000100:00100000:3.0:1746140884.300692:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576011520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.300823:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140884.301557:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.301635:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573631232 00000100:00100000:3.0:1746140884.301641:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573631232 00010000:00010000:3.0:1746140884.301664:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 32 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.301697:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8641 00000100:00100000:3.0:1746140884.301703:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1985:x1830960573631232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.301713:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.301718:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 32 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.301727:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 32 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.301746:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439800/0x8156357b7fdb98e4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a1 expref: 32 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.301772:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.301776:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301785:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301791:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301807:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.301832:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573631232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 130us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.301837:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8641 00010000:00010000:3.0:1746140884.301854:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301860:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140884.301892:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140884.301896:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140884.301908:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301916:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301924:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301930:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301936:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301941:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cd5600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.301945:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301951:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301959:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140884.301961:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.301964:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301968:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5600/0x8156357b7fdb998c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301975:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301980:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301985:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301988:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092cd4e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.301990:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.301994:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.302002:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871600) 00010000:00010000:3.0:1746140884.302004:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.302006:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.302009:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd4e00/0x8156357b7fdb9993 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.302036:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5800/0x8156357b7fdb9985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.302046:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 15 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.302051:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.302053:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140884.302055:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cd5000, rc 0) 00000100:00100000:3.0:1746140884.302077:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+15:32581:x1830960573630848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7438us (8242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.302080:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573630464:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 15539us (15782us total) trans 17179874045 rc 0/0 00000100:00100000:3.0:1746140884.302083:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10670 00000100:00100000:2.0:1746140884.302088:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1777 00002000:00100000:2.0:1746140884.302096:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1122304->1748991) req@ffff88009f728e00 x1830960573630464/t17179874045(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.302105:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728e00 with x1830960573630464 ext(1122304->1748991) 00010000:00010000:2.0:1746140884.302129:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 33 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.302140:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 33 pid: 20960 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.302146:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f728e00 00000100:00100000:0.0:1746140884.305002:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.305054:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573631488 00000100:00100000:1.0:1746140884.305062:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573631488 00000100:00100000:0.0:1746140884.305080:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.305107:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16675 00000100:00100000:0.0:1746140884.305117:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573631360 00000100:00100000:0.0:1746140884.305120:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573631360 00000100:00100000:1.0:1746140884.305124:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+6:1985:x1830960573631488:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140884.305138:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.305141:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 33 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.305166:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a11fc expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.305166:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8642 00000100:00100000:0.0:1746140884.305171:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573631360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.305182:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.305184:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.305186:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.305193:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 7 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.305200:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 33 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.305205:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 7 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.305210:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 33 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.305213:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299a400, rc 0) 00010000:00010000:0.0:1746140884.305224:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b465800/0x8156357b7fdb994d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1748991) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11d9 expref: 33 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.305238:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.305239:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.305244:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.305248:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573631488:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 126us (428us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140884.305251:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.305254:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16675 00010000:00010000:0.0:1746140884.305280:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.305292:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576011648:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140884.305368:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.305413:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.305442:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573631744 00000100:00100000:1.0:1746140884.305445:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573631744 00000100:00100000:0.0:1746140884.305449:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.305479:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.306040:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573631616 00000100:00100000:3.0:1746140884.306041:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573631872 00000100:00100000:2.0:1746140884.306045:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573631616 00000100:00100000:3.0:1746140884.306046:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573631872 00000100:00100000:3.0:1746140884.306069:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16676 00000100:00100000:3.0:1746140884.306075:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573631744:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140884.306082:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.306091:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a120a expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.306094:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16677 00000100:00100000:2.0:1746140884.306099:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573631872:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140884.306107:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.306122:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.306124:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.306127:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1211 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.306130:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 8 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.306139:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.306140:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.306141:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 8 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.306145:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 8 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.306148:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d12ba00, rc 0) 00010000:00010000:2.0:1746140884.306154:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 8 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.306162:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b465a00, rc 0) 00000100:00100000:3.0:1746140884.306186:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573631744:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 111us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.306192:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16676 00000100:00100000:1.0:1746140884.306200:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16678 00000100:00100000:1.0:1746140884.306205:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573631616:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140884.306211:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.306221:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1203 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.306239:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.306241:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.306246:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 9 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.306255:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 9 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.306261:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009299b600, rc 0) 00000100:00100000:2.0:1746140884.306484:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573631872:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 384us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.306489:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16677 00000100:00100000:1.0:1746140884.306759:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573631616:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 553us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.306765:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16678 00000100:00100000:2.0:1746140884.308666:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576011648:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140884.308690:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.308810:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573631360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3637us (3728us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.308820:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8642 00000100:00100000:2.0:1746140884.311201:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.311230:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.311257:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573632256 00000100:00100000:2.0:1746140884.311264:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573632256 00000100:00100000:2.0:1746140884.311341:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10671 00000100:00100000:2.0:1746140884.311348:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+15:32581:x1830960573632256:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140884.311365:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.311382:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3e00/0x8156357b7fdb99bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1218 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.311478:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.311498:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.311504:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140884.311507:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573632384 00000100:00100000:3.0:1746140884.311511:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573632384 00010000:00010000:2.0:1746140884.311532:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140884.311540:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b1b0380 x1830960573632384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746140884.311543:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 16 pid: 14785 timeout: 963 lvb_type: 0 00002000:00100000:3.0:1746140884.311551:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b0380 with x1830960573632384 ext(1048576->2097151) 00000100:00100000:2.0:1746140884.311553:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576011776:192.168.204.16@tcp:104: 00002000:00010000:3.0:1746140884.311557:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b1b0380 00000100:00100000:3.0:1746140884.311585:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8567 00000100:00100000:3.0:1746140884.311591:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573632384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.311619:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.312497:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576011776:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.312511:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140884.312982:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.313023:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573632512 00000100:00100000:2.0:1746140884.313028:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573632512 00010000:00010000:2.0:1746140884.313049:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 17 pid: 14785 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.313082:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8643 00000100:00100000:2.0:1746140884.313088:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573632512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.313097:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.313102:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 17 pid: 14785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.313122:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 17 pid: 14785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.313140:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092cd5000/0x8156357b7fdb999a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11f5 expref: 17 pid: 14785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.313156:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.313160:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.313168:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.313175:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.313203:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.313229:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573632512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 141us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.313235:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8643 00010000:00010000:3.0:1746140884.313366:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.313373:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140884.313392:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140884.313515:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3e00/0x8156357b7fdb99bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 17 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.313531:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.313537:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.313539:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746140884.313541:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fcd3600, rc 0) 00000100:00100000:3.0:1746140884.313560:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+16:32581:x1830960573632256:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2213us (2330us total) trans 8589944965 rc 0/0 00000100:00100000:3.0:1746140884.313566:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10671 00000100:00100000:0.0:1746140884.321265:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.321641:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573632384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10047us (10445us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.321651:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8567 00002000:00100000:3.0:1746140884.321663:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b1b0380 x1830960573632384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.321672:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b0380 with x1830960573632384 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.321677:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b1b0380 00000100:00100000:2.0:1746140884.323175:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573632640 00000100:00100000:2.0:1746140884.323183:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573632640 00000100:00100000:2.0:1746140884.323225:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10672 00000100:00100000:2.0:1746140884.323231:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+16:32581:x1830960573632640:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140884.323249:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.323265:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb99d2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a121f expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.323351:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.323364:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 17 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.323370:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.323504:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 17 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.323515:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 17 pid: 14785 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.323524:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576011904:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.323631:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.326175:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576011904:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.326198:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140884.326605:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.326652:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573632768 00000100:00100000:2.0:1746140884.326658:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573632768 00010000:00010000:2.0:1746140884.326685:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 18 pid: 14785 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.326715:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8644 00000100:00100000:2.0:1746140884.326721:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+18:1984:x1830960573632768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.326732:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.326737:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 18 pid: 14785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.326747:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 18 pid: 14785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.326767:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fcd3600/0x8156357b7fdb99c4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1218 expref: 18 pid: 14785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.326788:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.326793:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.326806:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.326813:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.326829:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140884.326840:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140884.326847:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140884.326874:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573632768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 153us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.326880:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8644 00000004:00200000:0.0:1746140884.326886:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140884.326889:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140884.326903:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140884.326931:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb99d2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a121f expref: 17 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.326989:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a121f expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.327001:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.327004:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140884.327007:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac0000, rc 0) 00000100:00100000:0.0:1746140884.327029:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+16:32581:x1830960573632640:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3798us (5775us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.327035:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10672 00000100:00100000:0.0:1746140884.328984:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.329044:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573633024 00000100:00100000:2.0:1746140884.329050:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573633024 00000100:00100000:2.0:1746140884.329093:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10673 00000100:00100000:2.0:1746140884.329100:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+16:32581:x1830960573633024:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140884.329129:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.329143:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1600/0x8156357b7fdb99e0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1226 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.329222:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.329234:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.329244:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140884.329254:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140884.329395:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1600/0x8156357b7fdb99e0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 19 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.329409:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 18 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.329415:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.329418:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140884.329420:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac1e00, rc 0) 00000100:00100000:2.0:1746140884.329451:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+18:32581:x1830960573633024:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 353us (479us total) trans 8589944966 rc 0/0 00000100:00100000:2.0:1746140884.329456:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10673 00000100:00100000:0.0:1746140884.331713:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.332035:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573633152 00000100:00100000:1.0:1746140884.332045:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573633152 00000100:00100000:1.0:1746140884.332090:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16679 00000100:00100000:1.0:1746140884.332096:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573633152:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746140884.332142:0:20960:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.332159:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.332167:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.332173:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 22 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.332178:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.332179:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.332182:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.332204:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140884.332209:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 22 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.332219:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 22 pid: 9872 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.332230:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576012032:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.332340:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.332347:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 8 pid: 20960 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.332352:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.332355:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576012160:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140884.332368:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.332379:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140884.332390:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.332397:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 19 pid: 9872 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.332403:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b892680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576012288:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.332416:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.332527:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.332666:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573633280 00000100:00100000:3.0:1746140884.332670:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573633280 00000100:00100000:3.0:1746140884.332689:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573633408 00000100:00100000:3.0:1746140884.332691:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573633408 00000100:00100000:3.0:1746140884.332699:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573633536 00000100:00100000:3.0:1746140884.332701:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573633536 00000100:00100000:3.0:1746140884.332710:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573633664 00000100:00100000:3.0:1746140884.332711:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573633664 00000100:00100000:3.0:1746140884.332730:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573633792 00000100:00100000:3.0:1746140884.332731:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573633792 00000100:00100000:3.0:1746140884.332744:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16680 00000100:00100000:3.0:1746140884.332749:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573633280:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140884.332769:0:8459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.332780:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 14 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.332786:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 10 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.332792:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 31 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.332797:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.332798:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.332800:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.332815:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 31 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.332823:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 31 pid: 9872 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.332834:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576012416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.332864:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 10 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.332870:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 10 pid: 8460 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.332876:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576012544:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.332894:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 14 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.332902:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 14 pid: 4782 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.332909:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576012672:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.332922:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d38d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.332936:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16681 00000100:00100000:3.0:1746140884.332940:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573633408:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140884.332953:0:4782:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.332961:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.332971:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.332976:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.332977:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.332979:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.332991:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.332997:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.333004:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576012800:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.333022:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.333028:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 14 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.333034:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576012928:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.333045:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801372d7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.333058:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16682 00000100:00100000:3.0:1746140884.333062:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573633536:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140884.333076:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.333085:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 22 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.333093:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 10 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.333100:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 19 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.333104:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.333105:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.333118:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.333129:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16683 00010000:00010000:3.0:1746140884.333133:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 19 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140884.333136:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573633664:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140884.333140:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 19 pid: 4784 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.333147:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576013056:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.333154:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.333164:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 22 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.333166:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16684 00010000:00010000:3.0:1746140884.333170:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 10 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.333171:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 10 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140884.333174:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573633792:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746140884.333178:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.333180:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 10 pid: 32376 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.333184:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.333186:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140884.333187:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576013184:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.333188:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.333192:0:32376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.333204:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 31 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.333206:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 22 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.333209:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.333210:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.333213:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 22 pid: 32376 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.333218:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 14 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.333218:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 19 pid: 9872 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.333219:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576013312:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.333224:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.333226:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576013440:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.333231:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.333232:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801372d73c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746140884.333236:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140884.333237:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140884.333239:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 8/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.333249:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 10 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.333255:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.333257:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 10 pid: 4784 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.333264:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576013568:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.333267:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.333275:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576013696:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.333284:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 22 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.333291:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 22 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.333297:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.333299:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094450a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576013824:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.333323:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 14 pid: 8458 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.333330:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576013952:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.333351:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b6c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746140884.333374:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 14 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.333387:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 14 pid: 20960 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.333395:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576014080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.333417:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.333424:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 10 pid: 9872 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.333431:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576014208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.333448:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 31 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.333455:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 31 pid: 9872 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.333462:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576014336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.333473:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.336635:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576012032:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.336651:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576012160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.336659:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b892680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576012288:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.336691:0:20960:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.341915:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.342047:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.342070:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.342366:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576012416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.342378:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576012544:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.342386:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576012672:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.342412:0:8459:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.342499:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573633920 00000100:00100000:1.0:1746140884.342500:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573634176 00000100:00100000:1.0:1746140884.342506:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573634176 00000100:00100000:0.0:1746140884.342506:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573633920 00010000:00010000:1.0:1746140884.342536:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 23 pid: 9872 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.342536:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 11 pid: 20960 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.342557:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573634304 00000100:00100000:0.0:1746140884.342559:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573634304 00000100:00100000:1.0:1746140884.342561:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8645 00000100:00100000:1.0:1746140884.342567:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573633920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.342567:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 20 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.342579:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140884.342589:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8646 00000100:00100000:0.0:1746140884.342594:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573634176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.342600:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 11 pid: 20960 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.342603:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.342610:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 11 pid: 20960 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.342741:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8647 00000100:00100000:3.0:1746140884.342747:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573634304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.342755:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.342955:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 23 pid: 9872 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.342962:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009299a400/0x8156357b7fdb99a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11fc expref: 11 pid: 20960 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.342964:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 23 pid: 9872 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.342975:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdb9907 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11af expref: 23 pid: 9872 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.342990:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140884.342995:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140884.343055:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 20 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.343064:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 20 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.343075:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e427200/0x8156357b7fdb98d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a119a expref: 20 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.343086:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.343088:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.343091:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.343099:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.343125:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.343216:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573633920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 648us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.343216:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573634176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 620us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.343222:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8645 00000100:00100000:0.0:1746140884.343226:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8646 00000100:00100000:0.0:1746140884.343263:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.343279:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573634048 00000100:00100000:1.0:1746140884.343282:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573634048 00010000:00010000:1.0:1746140884.343294:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 11 pid: 8460 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.343323:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8648 00000100:00100000:1.0:1746140884.343328:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573634048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.343334:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.343346:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 11 pid: 8460 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.343354:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 11 pid: 8460 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.343365:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ac875800/0x8156357b7fdb9509 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0f71 expref: 11 pid: 8460 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.343374:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.343386:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573634048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.343392:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8648 00000100:00100000:2.0:1746140884.343395:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576012800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140884.343396:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.343401:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573634432 00000100:00100000:1.0:1746140884.343403:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573634432 00010000:00010000:2.0:1746140884.343408:0:20960:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.343410:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 32 pid: 9872 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.343416:0:20960:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.343427:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8649 00000100:00100000:1.0:1746140884.343431:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573634432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.343435:0:20960:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.343436:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.343442:0:20960:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.343442:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 32 pid: 9872 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.343444:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140884.343454:0:20960:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.343460:0:20960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009299aa00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140884.343460:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 32 pid: 9872 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.343464:0:20960:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.343471:0:20960:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.343471:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdb9429 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ede expref: 32 pid: 9872 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.343478:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140884.343481:0:20960:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.343487:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009299aa00/0x8156357b7fdb99f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.343493:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573634432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.343498:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8649 00000100:00100000:1.0:1746140884.343504:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573634688 00000100:00100000:1.0:1746140884.343507:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573634688 00010000:00010000:1.0:1746140884.343514:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.343527:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.343531:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573634560 00000100:00100000:2.0:1746140884.343533:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573633152:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11438us (11830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.343533:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573634560 00000100:00100000:0.0:1746140884.343539:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8650 00000100:00100000:2.0:1746140884.343541:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16679 00010000:00010000:1.0:1746140884.343541:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 15 pid: 4782 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.343545:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573634688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.343551:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140884.343556:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8651 00000100:00100000:1.0:1746140884.343560:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573634560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.343562:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.343565:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.343570:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.343571:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 15 pid: 4782 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.343581:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009299b600/0x8156357b7fdb99b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1203 expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.343584:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 15 pid: 4782 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.343590:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140884.343594:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfd4200/0x8156357b7fdb93e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ec2 expref: 15 pid: 4782 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.343601:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.343602:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140884.343603:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573634688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140884.343605:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.343608:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8650 00010000:00010000:1.0:1746140884.343611:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.343623:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.343635:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573634560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.343640:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8651 00000100:00100000:0.0:1746140884.343643:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.343740:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573634304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 992us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.343746:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8647 00000100:00100000:0.0:1746140884.343750:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.343758:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573635200 00000100:00100000:3.0:1746140884.343760:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573635200 00000100:00100000:0.0:1746140884.343764:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140884.343772:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 9 pid: 32376 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.343776:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.343786:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573635456 00000100:00100000:0.0:1746140884.343787:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573635968 00000100:00100000:3.0:1746140884.343788:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573635456 00000100:00100000:0.0:1746140884.343790:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573635968 00010000:00010000:3.0:1746140884.343798:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 15 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.343802:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 15 pid: 20960 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.343816:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8652 00000100:00100000:0.0:1746140884.343821:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573635200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140884.343824:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8653 00010000:00010000:0.0:1746140884.343827:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140884.343829:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573635456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.343835:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140884.343835:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576012928:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140884.343836:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 9 pid: 32376 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.343843:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 15 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.343844:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 9 pid: 32376 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.343848:0:4782:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.343851:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 15 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.343859:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.343877:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573635200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.343882:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8652 00000100:00100000:1.0:1746140884.343897:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8654 00000100:00100000:1.0:1746140884.343903:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573635968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.343910:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140884.343917:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140884.343918:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 15 pid: 20960 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.343926:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 15 pid: 20960 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.343926:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573635072 00000100:00100000:0.0:1746140884.343928:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573635072 00010000:00010000:1.0:1746140884.343937:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140884.343938:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 19 pid: 4784 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.343950:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573635968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.343950:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8655 00000100:00100000:0.0:1746140884.343954:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573635072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140884.343955:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8654 00010000:00010000:0.0:1746140884.343959:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.343966:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 19 pid: 4784 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.343974:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009299a000/0x8156357b7fdb997e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11ee expref: 14 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.343974:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 19 pid: 4784 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.343976:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576013440:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.343979:0:8459:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.343983:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140884.343984:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140884.343984:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b891500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576013568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.343985:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.343987:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.343990:0:8459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.343992:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094450a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576013824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.343994:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.343996:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573635072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 42us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.344002:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8655 00010000:00010000:2.0:1746140884.344003:0:8459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.344005:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140884.344008:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.344009:0:8459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.344015:0:8459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.344017:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573635456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 187us (252us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140884.344020:0:8459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fcd2c00 already unused, calling callback (ffffffffa086ad70) 00000100:00100000:3.0:1746140884.344021:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8653 00010000:00010000:2.0:1746140884.344023:0:8459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.344025:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.344029:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573635328 00010000:00010000:2.0:1746140884.344029:0:8459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.344031:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573635328 00010000:00010000:2.0:1746140884.344038:0:8459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.344038:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140884.344039:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 9 pid: 4784 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.344044:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fcd2c00/0x8156357b7fdb99fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.344045:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573635584 00000100:00100000:0.0:1746140884.344048:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573635584 00000100:00100000:3.0:1746140884.344050:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8656 00000100:00100000:3.0:1746140884.344054:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573635328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.344056:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 13 pid: 8458 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.344059:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.344067:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 9 pid: 4784 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.344068:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8657 00000100:00100000:0.0:1746140884.344072:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573635584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140884.344073:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573633280:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11325us (11870us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140884.344074:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 9 pid: 4784 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.344078:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140884.344079:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16680 00010000:00010000:3.0:1746140884.344084:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb99a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a120a expref: 9 pid: 4784 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.344084:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 13 pid: 8458 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.344091:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140884.344091:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 13 pid: 8458 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.344094:0:4782:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.344099:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573635328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 45us (74us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140884.344100:0:4782:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.344100:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.344103:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8656 00000100:00100000:0.0:1746140884.344121:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573635584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 36us (70us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140884.344122:0:4782:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.344126:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8657 00010000:00010000:2.0:1746140884.344128:0:4782:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.344134:0:4782:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.344137:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eac1a00/0x8156357b7fdb9667 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a103c expref: 18 pid: 4784 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.344139:0:4782:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b48a0c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140884.344142:0:4782:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.344144:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576013056:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.344147:0:4782:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.344149:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140884.344152:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42800/0x8156357b7fdb97ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1100 expref: 7 pid: 32376 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.344156:0:4782:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.344157:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573635840 00000100:00100000:0.0:1746140884.344160:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573635840 00000100:00100000:3.0:1746140884.344162:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576013184:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.344162:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9a03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.344167:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 8 pid: 9872 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.344168:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576013312:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140884.344179:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8658 00010000:00010000:3.0:1746140884.344180:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.344183:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573635840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140884.344185:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573633408:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11245us (11834us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140884.344189:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140884.344190:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16681 00010000:00010000:0.0:1746140884.344195:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 7 pid: 9872 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.344196:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573634944 00000100:00100000:3.0:1746140884.344199:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573634944 00010000:00010000:0.0:1746140884.344202:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 7 pid: 9872 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.344210:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.344217:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4672 00000100:00100000:0.0:1746140884.344219:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:1982:x1830960573635840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 36us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.344221:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+31:32580:x1830960573634944:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746140884.344224:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8658 00000100:00100000:0.0:1746140884.344245:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.344252:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573635712 00000100:00100000:0.0:1746140884.344254:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573635712 00010000:00010000:0.0:1746140884.344261:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 22 pid: 32376 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.344271:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8659 00000100:00100000:0.0:1746140884.344274:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573635712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.344279:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.344285:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 22 pid: 32376 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344293:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 22 pid: 32376 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344302:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009963fc00/0x8156357b7fdb9636 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a102e expref: 22 pid: 32376 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344330:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.344332:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.344334:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.344339:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.344362:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.344374:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+32:32580:x1830960573634944:12345-192.168.204.16@tcp:35:cat.0 Request processed in 152us (730us total) trans 8589944967 rc 0/0 00000100:00100000:0.0:1746140884.344376:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573635712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.344379:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4672 00000100:00100000:0.0:1746140884.344381:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8659 00000100:00100000:0.0:1746140884.344411:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.344420:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573636096 00000100:00100000:0.0:1746140884.344422:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573636096 00010000:00010000:0.0:1746140884.344430:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 31 pid: 9872 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.344442:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8660 00000100:00100000:0.0:1746140884.344445:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573636096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.344451:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.344457:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 31 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344464:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 31 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344477:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.344486:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573636096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 40us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.344491:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8660 00000100:00100000:0.0:1746140884.344516:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.344525:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573636224 00000100:00100000:0.0:1746140884.344528:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573636224 00010000:00010000:0.0:1746140884.344536:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 21 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.344548:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8661 00000100:00100000:0.0:1746140884.344552:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573636224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.344558:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.344564:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 21 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344571:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 21 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344579:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e426200/0x8156357b7fdb984a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1146 expref: 21 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344587:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.344594:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1983:x1830960573636224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 42us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.344601:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8661 00000100:00100000:0.0:1746140884.344769:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.344778:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573636352 00000100:00100000:0.0:1746140884.344779:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573636352 00010000:00010000:0.0:1746140884.344788:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 18 pid: 9872 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.344798:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8662 00000100:00100000:0.0:1746140884.344802:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573636352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.344859:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.344865:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 18 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344873:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 18 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344882:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e427e00/0x8156357b7fdb985f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4804608->4886527) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a115b expref: 18 pid: 9872 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.344889:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.344891:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.344893:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.344898:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.344912:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.344920:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573636352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.344924:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8662 00000100:00100000:0.0:1746140884.344966:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.344974:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573636480 00000100:00100000:0.0:1746140884.344976:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573636480 00010000:00010000:0.0:1746140884.344984:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.344994:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8663 00000100:00100000:0.0:1746140884.344997:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573636480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.345002:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.345008:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.345015:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 31 pid: 20960 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.345023:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.345024:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.345026:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.345032:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.345045:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.345055:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573636480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.345060:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8663 00010000:00010000:2.0:1746140884.345072:0:4784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.345079:0:4784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.345091:0:4784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.345097:0:4784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.345104:0:4784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.345119:0:4784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800930e9000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140884.345122:0:4784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.345128:0:4784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.345137:0:4784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.345143:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9a0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345158:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345165:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.345171:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573633536:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12109us (12802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.345177:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16682 00010000:00010000:1.0:1746140884.345178:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345204:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345211:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345222:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f195800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140884.345225:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345230:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345239:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345244:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f195800/0x8156357b7fdb9a11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.345271:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+5:1983:x1830960573633664:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12136us (12890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.345277:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16683 00010000:00010000:1.0:1746140884.345324:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e426e00/0x8156357b7fdb983c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1138 expref: 30 pid: 20960 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.345333:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576013696:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.345343:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c993c00/0x8156357b7fdb982e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a112a expref: 12 pid: 8458 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.345350:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576013952:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.345358:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c439200/0x8156357b7fdb98cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1193 expref: 11 pid: 20960 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.345366:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576014080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.345375:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b465a00/0x8156357b7fdb99af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1211 expref: 6 pid: 9872 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.345381:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576014208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.345388:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e427400/0x8156357b7fdb9874 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1170 expref: 29 pid: 9872 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.345394:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576014336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.345412:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345419:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345424:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345436:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345442:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345452:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345457:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eac1800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140884.345459:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345465:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345474:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.345479:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac1800/0x8156357b7fdb9a18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.345522:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+5:1983:x1830960573633792:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12349us (12995us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.345528:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16684 00000100:00100000:0.0:1746140884.348573:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.348899:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573636736 00000100:00100000:1.0:1746140884.348908:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573636736 00000100:00100000:1.0:1746140884.348961:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10674 00000100:00100000:1.0:1746140884.348968:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+18:32581:x1830960573636736:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746140884.349021:0:14743:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.349047:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac0000/0x8156357b7fdb99d9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a121f expref: 18 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.349064:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.349068:0:14743:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140884.349099:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.349122:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 297 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.349129:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 31 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.349135:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 297 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.349141:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 31 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.349147:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 297 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.349153:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 8/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.349182:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 297 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.349435:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 297 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.349454:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014464:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.350211:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 31 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.350224:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 31 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.350232:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014592:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.350259:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 297 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.350266:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.350273:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014720:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.350295:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 31 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.350301:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 31 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.350326:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014848:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.350357:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 297 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.350368:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.350374:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014976:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.350390:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.353921:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.353935:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014592:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.353942:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014720:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.353947:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014848:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.354239:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576014976:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.354267:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:0.0:1746140884.354597:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.354631:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.354653:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573637248 00000100:00100000:0.0:1746140884.354654:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.354660:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573637248 00000100:00100000:0.0:1746140884.354668:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.354683:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573636992 00000100:00100000:0.0:1746140884.354686:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573636992 00010000:00010000:0.0:1746140884.354705:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 32 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.354710:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4673 00000100:00100000:3.0:1746140884.354716:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+298:24364:x1830960573637248:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746140884.354719:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573636864 00000100:00100000:0.0:1746140884.354721:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573636864 00010000:00010000:0.0:1746140884.354727:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 299 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.354737:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573637376 00000100:00100000:0.0:1746140884.354738:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573637376 00010000:00010000:0.0:1746140884.354745:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 33 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.354755:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8664 00000100:00100000:0.0:1746140884.354759:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1982:x1830960573636992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.354767:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.354773:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 33 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.354780:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 33 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.354799:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1c00/0x8156357b7fdb933b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0e91 expref: 33 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.354809:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.354813:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140884.354819:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.354851:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1982:x1830960573636992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.354856:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8664 00000100:00100000:0.0:1746140884.354872:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8665 00000100:00100000:0.0:1746140884.354876:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+300:1982:x1830960573636864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.354881:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140884.354882:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+300:24364:x1830960573637248:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 166us (287us total) trans 8589944968 rc 0/0 00010000:00010000:0.0:1746140884.354885:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 300 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.354887:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4673 00010000:00010000:0.0:1746140884.354892:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 300 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.354903:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff15200/0x8156357b7fdb9580 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0fa9 expref: 299 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.354904:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8666 00000100:00100000:3.0:1746140884.354909:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573637376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.354915:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.354916:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.354919:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 31 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.354919:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140884.354923:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140884.354926:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 31 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.354933:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+298:1982:x1830960573636864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (279us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140884.354936:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43000/0x8156357b7fdb9231 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0ddb expref: 31 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.354938:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8665 00010000:00010000:3.0:1746140884.354943:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.354946:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.354950:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.354961:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573637376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.354965:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8666 00000100:00100000:0.0:1746140884.354970:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.354983:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573637504 00000100:00100000:0.0:1746140884.354985:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573637504 00010000:00010000:0.0:1746140884.354994:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 298 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.355012:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8667 00000100:00100000:0.0:1746140884.355017:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+298:1984:x1830960573637504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.355295:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.355300:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 298 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.355528:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 298 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.355539:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdb9215 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a0dcd expref: 298 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.355547:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.355551:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140884.355556:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.355572:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:1984:x1830960573637504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 555us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.355577:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8667 00000100:00100000:0.0:1746140884.358607:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.358916:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573637632 00000100:00100000:2.0:1746140884.358924:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573637632 00010000:00010000:2.0:1746140884.358958:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.358995:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8668 00000100:00100000:2.0:1746140884.359004:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:1984:x1830960573637632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.359015:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.359020:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.359031:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.359049:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bea800/0x8156357b7fdb98f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a11a8 expref: 297 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.359062:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.359067:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140884.359079:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140884.359085:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140884.359675:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.359724:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:1984:x1830960573637632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 720us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.359730:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8668 00010000:00010000:1.0:1746140884.360044:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.360052:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000040:00080000:0.0:1746140884.361574:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3375, 88 off285656 00000004:00080000:0.0:1746140884.361584:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863437279097ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.361637:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3410, 88 off288920 00000004:00080000:0.0:1746140884.361642:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863437337592ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140884.364523:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3411, 88 off289008 00000004:00080000:0.0:1746140884.364536:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863440230901ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140884.364576:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3376, 88 off285744 00000004:00080000:0.0:1746140884.364579:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863440274692ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.364603:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3377, 88 off285832 00000004:00080000:0.0:1746140884.364606:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863440301127ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.364614:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3412, 88 off289096 00000004:00080000:0.0:1746140884.364616:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863440311573ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140884.364623:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3413, 88 off289184 00000004:00080000:0.0:1746140884.364625:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863440320583ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140884.364632:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3414, 88 off289272 00000004:00080000:0.0:1746140884.364634:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863440329751ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140884.364641:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3378, 88 off285920 00000004:00080000:0.0:1746140884.364644:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863440338943ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.364651:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3415, 88 off289360 00000004:00080000:0.0:1746140884.364653:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863440348672ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140884.364674:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3379, 88 off286008 00000004:00080000:0.0:1746140884.364677:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863440371867ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.364684:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3416, 88 off289448 00000004:00080000:0.0:1746140884.364687:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863440382100ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140884.364694:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3380, 88 off286096 00000004:00080000:0.0:1746140884.364696:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863440390997ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.364703:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3381, 88 off286184 00000004:00080000:0.0:1746140884.364711:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863440406173ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.364719:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3382, 88 off286272 00000004:00080000:0.0:1746140884.364721:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863440416707ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.364729:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3383, 88 off286360 00000004:00080000:0.0:1746140884.364731:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863440426335ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140884.364738:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3417, 88 off289536 00000004:00080000:0.0:1746140884.364741:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863440436177ns, next at 809142599738ns, rc = 0 00000100:00100000:1.0:1746140884.368968:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.369070:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573637888 00000100:00100000:2.0:1746140884.369080:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573637888 00000100:00100000:2.0:1746140884.369132:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10675 00000100:00100000:2.0:1746140884.369139:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:32585:x1830960573637888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140884.369160:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.369178:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1600/0x8156357b7fdb9a26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a122d expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.369281:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.369294:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.369322:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.369335:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.369342:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.369348:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140884.383708:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.383743:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573638144 00000100:00100000:0.0:1746140884.383751:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573638144 00000100:00100000:0.0:1746140884.383793:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10676 00000100:00100000:0.0:1746140884.383800:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:32588:x1830960573638144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140884.383821:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.383840:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427400/0x8156357b7fdb9a3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1234 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.383939:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.383953:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.383967:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.383976:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.383982:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.383987:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00010000:3.0:1746140884.394270:0:14743:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f121880 reply state ffff88013635ac00 transno 8589944969 ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:3.0:1746140884.394285:0:14743:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746140884.394418:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+19:32581:x1830960573636736:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 45445us (45849us total) trans 8589944969 rc 0/0 00000100:00100000:3.0:1746140884.394427:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10674 00010000:00010000:0.0:1746140884.394504:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394519:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394529:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:0.0:1746140884.394540:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140884.394666:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394672:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394678:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394683:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e427000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140884.394687:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394695:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394705:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.394707:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140884.394711:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394716:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdb9a50 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394731:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394736:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394740:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394744:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e426e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140884.394746:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394750:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394755:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140884.394757:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140884.394759:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394763:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426e00/0x8156357b7fdb9a42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394772:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394775:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394780:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394783:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e426c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140884.394785:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394788:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394793:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293600) 00010000:00010000:0.0:1746140884.394794:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140884.394796:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394800:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426c00/0x8156357b7fdb9a49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140884.394833:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427400/0x8156357b7fdb9a3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1234 expref: 298 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.394840:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427400/0x8156357b7fdb9a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1234 expref: 298 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.394846:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427400, rc 0) 00010000:00010000:2.0:1746140884.394903:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.394913:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 18 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.394919:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.394952:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 18 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.394964:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 18 pid: 14785 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.394976:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576015104:192.168.204.16@tcp:104: 00000001:00080000:1.0:1746140884.395146:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944969 is committed 00000004:00080000:1.0:1746140884.395152:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2660 committed 00000004:00080000:1.0:1746140884.395171:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2630 committed 00000004:00080000:1.0:1746140884.395176:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2629 committed 00000004:00080000:1.0:1746140884.395178:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2628 committed 00000004:00080000:1.0:1746140884.395180:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2627 committed 00000004:00080000:1.0:1746140884.395181:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2659 committed 00000004:00080000:1.0:1746140884.395183:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2626 committed 00000004:00080000:1.0:1746140884.395184:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2658 committed 00000004:00080000:1.0:1746140884.395186:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2625 committed 00000004:00080000:1.0:1746140884.395187:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2657 committed 00000004:00080000:1.0:1746140884.395189:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2656 committed 00000004:00080000:1.0:1746140884.395190:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2655 committed 00000004:00080000:1.0:1746140884.395191:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2624 committed 00000004:00080000:1.0:1746140884.395193:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2623 committed 00000004:00080000:1.0:1746140884.395194:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2654 committed 00000004:00080000:1.0:1746140884.395196:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2653 committed 00000004:00080000:1.0:1746140884.395198:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2622 committed 00000001:00080000:1.0:1746140884.395204:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944960 is committed 00000001:00080000:1.0:1746140884.395209:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944932 is committed 00000001:00080000:1.0:1746140884.395224:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944964 is committed 00000001:00080000:1.0:1746140884.395229:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944961 is committed 00000001:00080000:1.0:1746140884.395328:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944968 is committed 00000001:00080000:1.0:1746140884.395333:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944967 is committed 00010000:00010000:1.0:1746140884.395389:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.395395:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.395400:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.395403:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013547d400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.395405:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.395409:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.395417:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.395419:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140884.395422:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.395425:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d400/0x8156357b7fdb9a1f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00000100:00100000:0.0:1746140884.395629:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32588:x1830960573638144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 11828us (11927us total) trans 8589944970 rc 301/301 00000100:00100000:0.0:1746140884.395635:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10676 00000100:00100000:2.0:1746140884.395693:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.396333:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576015488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.396374:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.396401:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576016000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.396412:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.396421:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576016512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.396434:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.396443:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576017024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.396454:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.396456:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576015488 00000100:00100000:2.0:1746140884.396463:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576015488 00000100:00100000:1.0:1746140884.396465:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746140884.396469:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576015616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.396480:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.396488:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576016128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.396492:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576016000 00000100:00100000:2.0:1746140884.396495:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576016000 00000100:00100000:1.0:1746140884.396499:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.396509:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576016512 00000100:00100000:1.0:1746140884.396509:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576016640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.396510:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576016512 00000100:00100000:2.0:1746140884.396520:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576017024 00000100:00100000:2.0:1746140884.396521:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576017024 00000100:00100000:1.0:1746140884.396521:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.396529:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576015616 00000100:00100000:2.0:1746140884.396531:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576015616 00000100:00100000:1.0:1746140884.396531:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576017152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.396538:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576016128 00000100:00100000:2.0:1746140884.396540:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576016128 00000100:00100000:1.0:1746140884.396545:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.396548:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576016640 00000100:00100000:2.0:1746140884.396549:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576016640 00000100:00100000:2.0:1746140884.396554:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576017152 00000100:00100000:2.0:1746140884.396556:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576017152 00000100:00100000:1.0:1746140884.396563:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16685 00000100:00100000:1.0:1746140884.396571:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3312:x1830960576015488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.396591:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576015232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.396615:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.396624:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576015744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.396638:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.396644:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576016256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.396657:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.396663:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576016768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.396673:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.396681:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746140884.396684:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576015360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.396696:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.396702:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576015872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.396714:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.396720:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576016384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.396731:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.396737:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576016896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.396751:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.396756:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3312:x1830960576015488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (381us total) trans 17179874046 rc 0/0 00000100:00100000:2.0:1746140884.396900:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16686 00000100:00100000:1.0:1746140884.396905:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16685 00000100:00100000:2.0:1746140884.396907:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3312:x1830960576016000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.396923:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576015232 00000100:00100000:1.0:1746140884.396926:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576015232 00000100:00100000:1.0:1746140884.396936:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576015744 00000100:00100000:1.0:1746140884.396938:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576015744 00000100:00100000:1.0:1746140884.396944:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576016256 00000100:00100000:1.0:1746140884.396945:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576016256 00000100:00100000:1.0:1746140884.396951:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576016768 00000100:00100000:1.0:1746140884.396953:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576016768 00000100:00100000:1.0:1746140884.396958:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576015360 00000100:00100000:1.0:1746140884.396959:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576015360 00000100:00100000:1.0:1746140884.396964:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576015872 00000100:00100000:1.0:1746140884.396966:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576015872 00000100:00100000:1.0:1746140884.396971:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576016384 00000100:00100000:1.0:1746140884.396973:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576016384 00000100:00100000:1.0:1746140884.396979:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576016896 00000100:00100000:1.0:1746140884.396980:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576016896 00000100:00100000:1.0:1746140884.396988:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16687 00000100:00100000:1.0:1746140884.396992:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3312:x1830960576016512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.396995:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3312:x1830960576016000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (581us total) trans 17179874047 rc 0/0 00000100:00100000:2.0:1746140884.397001:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16686 00000100:00100000:2.0:1746140884.397011:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16688 00000100:00100000:2.0:1746140884.397015:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3312:x1830960576017024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.397078:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16689 00000100:00100000:2.0:1746140884.397082:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3312:x1830960576015616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.397106:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3312:x1830960576016512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (669us total) trans 21474841323 rc 0/0 00000100:00100000:1.0:1746140884.397125:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16687 00000100:00100000:1.0:1746140884.397136:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16690 00000100:00100000:1.0:1746140884.397140:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3312:x1830960576016128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.397153:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16691 00000100:00100000:1.0:1746140884.397157:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3312:x1830960576016640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.397245:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3312:x1830960576016640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (722us total) trans 21474841325 rc 0/0 00000100:00100000:1.0:1746140884.397250:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16691 00000100:00100000:1.0:1746140884.397259:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16692 00000100:00100000:1.0:1746140884.397264:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3312:x1830960576017152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140884.397448:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16693 00000100:00100000:3.0:1746140884.397457:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3310:x1830960576015232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.397865:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16694 00000100:00100000:0.0:1746140884.397873:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3310:x1830960576015744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.398610:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3312:x1830960576017152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1343us (2060us total) trans 21474841326 rc 0/0 00000100:00100000:1.0:1746140884.398616:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16692 00000100:00100000:1.0:1746140884.398632:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16695 00000100:00100000:1.0:1746140884.398638:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3310:x1830960576016256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.398744:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3310:x1830960576016256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (2085us total) trans 21474841327 rc 0/0 00000100:00100000:1.0:1746140884.398749:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16695 00000100:00100000:1.0:1746140884.398759:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16696 00000100:00100000:1.0:1746140884.398763:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3310:x1830960576016768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.398833:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3310:x1830960576016768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (2158us total) trans 21474841328 rc 0/0 00000100:00100000:1.0:1746140884.398837:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16696 00000100:00100000:1.0:1746140884.398846:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16697 00000100:00100000:3.0:1746140884.398849:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960576015232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1394us (2233us total) trans 17179874049 rc 0/0 00000100:00100000:1.0:1746140884.398850:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960576015360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.398856:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16693 00000100:00100000:3.0:1746140884.398868:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16698 00000100:00100000:3.0:1746140884.398873:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3310:x1830960576015872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.398919:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16699 00000100:00100000:1.0:1746140884.398925:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3310:x1830960576016384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.399011:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3310:x1830960576016384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (2278us total) trans 21474841329 rc 0/0 00000100:00100000:1.0:1746140884.399017:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16699 00000100:00100000:1.0:1746140884.399026:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16700 00000100:00100000:1.0:1746140884.399031:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3310:x1830960576016896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.399096:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3310:x1830960576016896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (2343us total) trans 21474841330 rc 0/0 00000100:00100000:1.0:1746140884.399100:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16700 00000100:00100000:0.0:1746140884.399353:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.399370:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00080000:1.0:1746140884.399411:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bf100/2, rc 0, transno 21474841325 00000100:00100000:3.0:1746140884.399412:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573638272 00000100:00100000:1.0:1746140884.399418:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576016640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140884.399419:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573638272 00000004:00080000:1.0:1746140884.399425:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099495500/2, rc 0, transno 21474841326 00000100:00100000:1.0:1746140884.399427:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576017152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140884.399434:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354be300/2, rc 0, transno 17179874046 00000100:00100000:1.0:1746140884.399437:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576015488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140884.399442:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bfb80/2, rc 0, transno 17179874047 00000100:00100000:3.0:1746140884.399444:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573638400 00000100:00100000:1.0:1746140884.399444:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576016000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.399446:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573638400 00000100:00100000:0.0:1746140884.399446:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00080000:1.0:1746140884.399449:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bdc00/2, rc 0, transno 21474841323 00000100:00100000:1.0:1746140884.399451:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576016512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140884.399461:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10677 00000100:00100000:3.0:1746140884.399466:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32588:x1830960573638272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.399478:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.399495:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b631800/0x8156357b7fdb9a65 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a123b expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.399559:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10678 00010000:00010000:3.0:1746140884.399562:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb9a6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.399574:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb9a6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.399585:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb9a6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000100:00100000:0.0:1746140884.399590:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:32581:x1830960573638400:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140884.399601:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1746140884.399608:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140884.399609:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1242 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746140884.399612:0:14743:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140884.399625:0:14743:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb9a6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:0.0:1746140884.399636:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.399697:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3312:x1830960576015616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2613us (3215us total) trans 17179874048 rc 0/0 00000100:00100000:2.0:1746140884.399703:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16689 00000100:00100000:2.0:1746140884.399747:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573638528 00000100:00100000:2.0:1746140884.399749:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573638528 00010000:00010000:2.0:1746140884.399763:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 9 pid: 14785 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.399780:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8669 00000100:00100000:2.0:1746140884.399784:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573638528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.399792:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.399797:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 9 pid: 14785 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.400188:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b631800/0x8156357b7fdb9a65 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a123b expref: 269 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.400190:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.400201:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb9a6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a123b expref: 268 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.400210:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.400213:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140884.400215:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e426a00, rc 0) 00010000:00010000:2.0:1746140884.400229:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 9 pid: 14785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.400242:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.400245:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400252:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400257:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140884.400260:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:32581:x1830960573638400:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 694us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.400266:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10678 00010000:00010000:2.0:1746140884.400270:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.400290:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573638528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 504us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.400295:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8669 00000004:00080000:0.0:1746140884.400298:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bd180/2, rc 0, transno 21474841329 00000100:00100000:0.0:1746140884.400318:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576016384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140884.400332:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bce00/2, rc 0, transno 17179874048 00000004:00080000:0.0:1746140884.400332:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bed80/2, rc 0, transno 21474841330 00000100:00100000:0.0:1746140884.400335:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576016896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.400337:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576015616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140884.400342:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bca80/2, rc 0, transno 17179874049 00000100:00100000:0.0:1746140884.400345:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576015232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140884.400353:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bc380/2, rc 0, transno 21474841327 00000100:00100000:0.0:1746140884.400357:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576016256:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746140884.400359:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1e00/0x8156357b7fdb99e7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1226 expref: 7 pid: 14785 timeout: 963 lvb_type: 0 00000004:00080000:0.0:1746140884.400363:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bc000/2, rc 0, transno 21474841328 00000100:00100000:0.0:1746140884.400366:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576016768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.400369:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576015104:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.400382:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400389:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400396:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140884.400408:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140884.400471:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400477:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400485:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400490:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eac1800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140884.400493:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400498:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400505:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.400507:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140884.400510:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400514:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1800/0x8156357b7fdb9a5e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400525:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400530:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400539:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400543:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eac1200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140884.400545:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400551:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400557:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140884.400559:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140884.400561:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400565:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1200/0x8156357b7fdb9a2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400572:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400577:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400582:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400585:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eac1400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140884.400587:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.400591:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140884.400625:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.400627:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140884.400629:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b630c00, rc 0) 00000100:00100000:3.0:1746140884.400655:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32588:x1830960573638272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1188us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.400661:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10677 00000100:00100000:0.0:1746140884.400725:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576017280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.400756:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.400767:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960576015360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1916us (4069us total) trans 17179874050 rc 0/0 00000100:00100000:3.0:1746140884.400773:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16697 00000100:00100000:3.0:1746140884.400783:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576017280 00000004:00080000:0.0:1746140884.400784:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bd500/2, rc 0, transno 17179874050 00000100:00100000:3.0:1746140884.400785:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576017280 00000100:00100000:0.0:1746140884.400788:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576015360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.400800:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16701 00000100:00100000:3.0:1746140884.400804:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3310:x1830960576017280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.400878:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960576015744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3007us (4239us total) trans 17179874052 rc 0/0 00000100:00100000:0.0:1746140884.400884:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16694 00000100:00100000:3.0:1746140884.400897:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3310:x1830960576017280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (140us total) trans 21474841331 rc 0/0 00000004:00080000:0.0:1746140884.400901:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099495f80/2, rc 0, transno 21474841331 00000100:00100000:3.0:1746140884.400902:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16701 00000100:00100000:0.0:1746140884.400904:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576017280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140884.400909:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bc700/2, rc 0, transno 17179874052 00000100:00100000:0.0:1746140884.400911:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576015744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140884.400952:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bdf80/2, rc 0, transno 17179874051 00000100:00100000:0.0:1746140884.400955:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576015872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.401171:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960576015872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2296us (4454us total) trans 17179874051 rc 0/0 00000100:00100000:3.0:1746140884.401177:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16698 00000100:00100000:1.0:1746140884.401254:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3312:x1830960576016128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4112us (4752us total) trans 17179874053 rc 0/0 00000100:00100000:1.0:1746140884.401260:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16690 00000004:00080000:0.0:1746140884.401328:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bd880/2, rc 0, transno 17179874053 00000100:00100000:0.0:1746140884.401332:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576016128:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746140884.401334:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293600) 00010000:00010000:2.0:1746140884.401336:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140884.401339:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.401344:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1400/0x8156357b7fdb9a34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.401856:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1600/0x8156357b7fdb9a26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a122d expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.401865:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac1600/0x8156357b7fdb9a26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a122d expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.401873:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac1600, rc 0) 00000100:00100000:2.0:1746140884.403129:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32585:x1830960573637888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 33983us (34161us total) trans 8589944971 rc 301/301 00000100:00100000:2.0:1746140884.403138:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10675 00000100:00100000:3.0:1746140884.403341:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3312:x1830960576017024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6325us (6884us total) trans 21474841324 rc 0/0 00000100:00100000:3.0:1746140884.403348:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16688 00000004:00080000:0.0:1746140884.403571:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bea00/2, rc 0, transno 21474841324 00000100:00100000:0.0:1746140884.403576:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576017024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.404286:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.407153:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.407169:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.407195:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.407207:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.407217:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.407283:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.407341:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573638912 00000100:00100000:3.0:1746140884.407349:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573638912 00000100:00100000:3.0:1746140884.407384:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573639040 00000100:00100000:3.0:1746140884.407386:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573639040 00000100:00100000:3.0:1746140884.407402:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573639168 00000100:00100000:3.0:1746140884.407404:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573639168 00000100:00100000:3.0:1746140884.407414:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573639296 00000100:00100000:3.0:1746140884.407416:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573639296 00000100:00100000:3.0:1746140884.407425:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573639424 00000100:00100000:3.0:1746140884.407426:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573639424 00000100:00100000:3.0:1746140884.407435:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573639552 00000100:00100000:3.0:1746140884.407436:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573639552 00000100:00100000:3.0:1746140884.407452:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16702 00000100:00100000:3.0:1746140884.407459:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573638912:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.407478:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.407496:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1249 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140884.407521:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fed4, atime: 0x6813fed4, ctime: 0x6813fed4, blocks: 0x821 00010000:00010000:3.0:1746140884.407539:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.407541:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.407549:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.407564:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.407574:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db8ba00, rc 0) 00000100:00100000:3.0:1746140884.407616:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573638912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 158us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.407622:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16702 00000100:00100000:3.0:1746140884.407637:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16703 00000100:00100000:3.0:1746140884.407641:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573639040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.407648:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.407658:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1250 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140884.407672:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed3, atime: 0x6813fed2, ctime: 0x6813fed3, blocks: 0x821 00010000:00010000:3.0:1746140884.407680:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.407681:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.407685:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.407695:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.407701:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db8ac00, rc 0) 00000100:00100000:3.0:1746140884.407715:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573639040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 74us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.407720:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16703 00000100:00100000:3.0:1746140884.407730:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16704 00000100:00100000:3.0:1746140884.407733:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573639168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.407737:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.407745:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1257 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140884.407755:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fed4, atime: 0x6813fed4, ctime: 0x6813fed4, blocks: 0x821 00010000:00010000:3.0:1746140884.407761:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.407762:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.407766:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.407774:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.407780:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b630800, rc 0) 00000100:00100000:3.0:1746140884.407792:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573639168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 58us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.407796:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16704 00000100:00100000:3.0:1746140884.407928:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16705 00000100:00100000:3.0:1746140884.407933:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573639296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.407938:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.407946:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a125e expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140884.407957:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed3, atime: 0x6813fed3, ctime: 0x6813fed3, blocks: 0x821 00010000:00010000:3.0:1746140884.407963:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.407965:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.407968:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.407975:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.407981:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b630e00, rc 0) 00000100:00100000:3.0:1746140884.407995:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573639296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.408000:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16705 00000100:00100000:3.0:1746140884.408009:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16706 00000100:00100000:3.0:1746140884.408013:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573639424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.408018:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.408026:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1265 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140884.408035:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fed4, atime: 0x6813fed4, ctime: 0x6813fed4, blocks: 0x1589 00010000:00010000:3.0:1746140884.408041:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.408042:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.408045:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.408052:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.408058:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c85400, rc 0) 00000100:00100000:3.0:1746140884.408070:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573639424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.408074:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16706 00000100:00100000:3.0:1746140884.408082:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16707 00000100:00100000:3.0:1746140884.408086:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573639552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.408091:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.408097:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a126c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140884.408126:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fed4, atime: 0x6813fed4, ctime: 0x6813fed4, blocks: 0x1029 00010000:00010000:3.0:1746140884.408133:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.408134:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.408137:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.408145:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.408152:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c84e00, rc 0) 00000100:00100000:3.0:1746140884.408166:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573639552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 80us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.408171:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16707 00000100:00100000:2.0:1746140884.408422:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573638784 00000100:00100000:2.0:1746140884.408427:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573638784 00000100:00100000:2.0:1746140884.408457:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4674 00000100:00100000:2.0:1746140884.408461:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32581:x1830960573638784:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746140884.408619:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32581:x1830960573638784:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 156us (4334us total) trans 8589944972 rc 0/0 00000100:00100000:2.0:1746140884.408625:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4674 00000100:00100000:1.0:1746140884.413188:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.413493:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573639808 00000100:00100000:3.0:1746140884.413504:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573639808 00000100:00100000:3.0:1746140884.416390:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4675 00000100:00100000:3.0:1746140884.416409:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:32581:x1830960573639808:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746140884.416663:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:32581:x1830960573639808:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 261us (3485us total) trans 8589944973 rc 0/0 00000100:00100000:3.0:1746140884.416670:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4675 00000100:00100000:0.0:1746140884.427082:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.427662:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573640064 00000100:00100000:2.0:1746140884.427672:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573640064 00000100:00100000:2.0:1746140884.427738:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10679 00000100:00100000:2.0:1746140884.427746:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32590:x1830960573640064:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140884.427767:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.427787:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b400/0x8156357b7fdb9aab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1273 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.427901:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.427913:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.427922:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.427936:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.427941:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.427946:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.428065:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9c00/0x8156357b7fdb9ac0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.428073:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9c00/0x8156357b7fdb9ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.428079:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9c00/0x8156357b7fdb9ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140884.428088:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140884.429280:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.429292:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.429299:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430052:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d12b600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140884.430057:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430063:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430078:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140884.430080:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140884.430083:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430088:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b600/0x8156357b7fdb9ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430105:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430120:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430125:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430129:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d12ba00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140884.430131:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430137:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430142:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e4b5e00) 00010000:00010000:2.0:1746140884.430144:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140884.430145:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.430149:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9ab9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140884.432013:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12b400/0x8156357b7fdb9aab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1273 expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.432036:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9c00/0x8156357b7fdb9ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1273 expref: 270 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.432045:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.432048:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140884.432051:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fb9c00, rc 0) 00000100:00100000:2.0:1746140884.432147:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32590:x1830960573640064:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4400us (5074us total) trans 8589944974 rc 0/0 00000100:00100000:2.0:1746140884.432156:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10679 00000100:00100000:1.0:1746140884.432425:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.432860:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573640320 00000100:00100000:3.0:1746140884.432869:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573640320 00002000:00100000:3.0:1746140884.432906:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009ab6ed80 x1830960573640320/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.432916:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6ed80 with x1830960573640320 ext(0->1048575) 00002000:00010000:3.0:1746140884.432922:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab6ed80 00000100:00100000:3.0:1746140884.432951:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8568 00000100:00100000:3.0:1746140884.432958:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573640320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.433843:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.433896:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.433976:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573640704 00000100:00100000:2.0:1746140884.433982:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573640704 00002000:00100000:2.0:1746140884.434005:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f7aa680 x1830960573640704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.434013:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aa680 with x1830960573640704 ext(1048576->2097151) 00002000:00010000:2.0:1746140884.434019:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7aa680 00000100:00100000:2.0:1746140884.434031:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573640832 00000100:00100000:2.0:1746140884.434033:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573640832 00002000:00100000:2.0:1746140884.434044:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f7aaa00 x1830960573640832/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.434051:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aaa00 with x1830960573640832 ext(1048576->2097151) 00002000:00010000:2.0:1746140884.434053:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7aaa00 00000100:00100000:2.0:1746140884.434063:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8569 00000100:00100000:2.0:1746140884.434067:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573640704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140884.434262:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8570 00000100:00100000:1.0:1746140884.434272:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573640832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.435920:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.438070:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573640960 00000100:00100000:3.0:1746140884.438085:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573640960 00002000:00100000:3.0:1746140884.438145:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f7aad80 x1830960573640960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.438157:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aad80 with x1830960573640960 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.438163:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7aad80 00000100:00100000:3.0:1746140884.438190:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8571 00000100:00100000:3.0:1746140884.438197:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573640960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.441829:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.443090:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573641216 00000100:00100000:2.0:1746140884.443104:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573641216 00000100:00100000:2.0:1746140884.443195:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 770 00000100:00100000:2.0:1746140884.443203:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1985:x1830960573641216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.443218:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.443246:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9c00/0x8156357b7fdb9ac0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1273 expref: 270 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.443264:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.443268:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.443343:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960573641216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 141us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.443350:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 770 00000100:00100000:3.0:1746140884.450522:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573640320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17553us (18087us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.450536:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8568 00002000:00100000:3.0:1746140884.450549:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009ab6ed80 x1830960573640320/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.450558:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6ed80 with x1830960573640320 ext(0->1048575) 00002000:00010000:3.0:1746140884.450564:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab6ed80 00000100:00100000:1.0:1746140884.455534:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573640832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21250us (21623us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.455546:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8570 00002000:00100000:1.0:1746140884.455559:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f7aaa00 x1830960573640832/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.455569:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aaa00 with x1830960573640832 ext(1048576->2097151) 00002000:00010000:1.0:1746140884.455575:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7aaa00 00000100:00100000:2.0:1746140884.461148:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573640704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27064us (27293us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.461164:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8569 00002000:00100000:2.0:1746140884.461179:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f7aa680 x1830960573640704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.461191:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aa680 with x1830960573640704 ext(1048576->2097151) 00002000:00010000:2.0:1746140884.461197:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7aa680 00000100:00100000:3.0:1746140884.466624:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573640960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 28418us (30702us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.466637:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8571 00002000:00100000:3.0:1746140884.466649:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f7aad80 x1830960573640960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.466659:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aad80 with x1830960573640960 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.466666:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7aad80 00000100:00100000:1.0:1746140884.488210:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.489392:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.489423:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.489460:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.489467:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573641600 00000100:00100000:2.0:1746140884.489476:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573641600 00000100:00100000:1.0:1746140884.489487:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573641856 00000100:00100000:1.0:1746140884.489490:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573641856 00002000:00100000:2.0:1746140884.489519:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009ab6d500 x1830960573641600/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.489519:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009ab6f100 x1830960573641856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.489529:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6d500 with x1830960573641600 ext(2097152->3145727) 00002000:00100000:1.0:1746140884.489529:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6f100 with x1830960573641856 ext(3145728->4194303) 00002000:00010000:2.0:1746140884.489534:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab6d500 00002000:00010000:1.0:1746140884.489534:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab6f100 00000100:00100000:2.0:1746140884.489548:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573641984 00000100:00100000:2.0:1746140884.489550:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573641984 00002000:00100000:2.0:1746140884.489561:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009ab6ce00 x1830960573641984/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.489568:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6ce00 with x1830960573641984 ext(2097152->3145727) 00002000:00010000:2.0:1746140884.489570:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab6ce00 00000100:00100000:1.0:1746140884.489595:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573642112 00000100:00100000:1.0:1746140884.489600:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573642112 00002000:00100000:1.0:1746140884.489611:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009ab6f800 x1830960573642112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.489616:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6f800 with x1830960573642112 ext(3145728->4194303) 00002000:00010000:1.0:1746140884.489619:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab6f800 00000100:00100000:1.0:1746140884.489638:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8572 00000100:00100000:1.0:1746140884.489644:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573641600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.489884:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8573 00000100:00100000:2.0:1746140884.489889:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8574 00000100:00100000:0.0:1746140884.489892:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573641856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.489893:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573641984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.490088:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8575 00000100:00100000:3.0:1746140884.490097:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573642112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.506649:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573642112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16539us (17173us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.506662:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8575 00002000:00100000:3.0:1746140884.506677:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009ab6f800 x1830960573642112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.506688:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6f800 with x1830960573642112 ext(3145728->4194303) 00002000:00010000:3.0:1746140884.506695:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab6f800 00000100:00100000:2.0:1746140884.507796:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573641856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17899us (18400us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.507807:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8573 00002000:00100000:2.0:1746140884.507816:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009ab6f100 x1830960573641856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.507824:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6f100 with x1830960573641856 ext(3145728->4194303) 00002000:00010000:2.0:1746140884.507829:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab6f100 00000100:00100000:2.0:1746140884.514315:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573641984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24396us (24865us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.514328:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8574 00002000:00100000:2.0:1746140884.514340:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009ab6ce00 x1830960573641984/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.514350:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6ce00 with x1830960573641984 ext(2097152->3145727) 00002000:00010000:2.0:1746140884.514356:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab6ce00 00000100:00100000:1.0:1746140884.514564:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573641600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24920us (26364us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.514571:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8572 00002000:00100000:1.0:1746140884.514576:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009ab6d500 x1830960573641600/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.514583:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab6d500 with x1830960573641600 ext(2097152->3145727) 00002000:00010000:1.0:1746140884.514586:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab6d500 00000100:00100000:0.0:1746140884.527886:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.528269:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573642496 00000100:00100000:1.0:1746140884.528279:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573642496 00002000:00100000:1.0:1746140884.528354:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f7ab480 x1830960573642496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.528363:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ab480 with x1830960573642496 ext(4194304->4886527) 00002000:00010000:1.0:1746140884.528368:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7ab480 00000100:00100000:1.0:1746140884.528396:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8576 00000100:00100000:1.0:1746140884.528402:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1982:x1830960573642496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.530385:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.530446:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573642624 00000100:00100000:2.0:1746140884.530452:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573642624 00000100:00100000:2.0:1746140884.530502:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10680 00000100:00100000:2.0:1746140884.530508:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32585:x1830960573642624:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140884.530528:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.530548:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8000/0x8156357b7fdb9ace lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a127a expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.530609:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8000/0x8156357b7fdb9ace lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a127a expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.530621:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8000/0x8156357b7fdb9ace lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a127a expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.530638:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.530640:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140884.530643:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930e8000, rc 0) 00000100:00100000:2.0:1746140884.530689:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32585:x1830960573642624:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 181us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.530695:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10680 00000100:00100000:0.0:1746140884.535377:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.536220:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573642880 00000100:00100000:3.0:1746140884.536230:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573642880 00000100:00100000:0.0:1746140884.536394:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.536434:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573643136 00000100:00100000:3.0:1746140884.536437:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573643136 00000100:00100000:3.0:1746140884.536456:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10681 00000100:00100000:3.0:1746140884.536463:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32590:x1830960573642880:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140884.536481:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.536485:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746140884.536510:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b630c00/0x8156357b7fdb9a6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a123b expref: 269 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.536517:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1982:x1830960573642496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8114us (8639us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140884.536526:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8576 00010000:00010000:3.0:1746140884.536527:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.536532:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746140884.536535:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f7ab480 x1830960573642496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.536545:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ab480 with x1830960573642496 ext(4194304->4886527) 00002000:00010000:1.0:1746140884.536549:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7ab480 00000100:00100000:1.0:1746140884.536590:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10682 00000100:00100000:1.0:1746140884.536598:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32585:x1830960573643136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140884.536605:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.536607:0:14743:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746140884.536618:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8000/0x8156357b7fdb9ace lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a127a expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.536632:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.536635:0:14743:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140884.536642:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009272de00/0x8156357b7fdb9ad5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1288 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.536693:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.536703:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.536709:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.536796:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.536807:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 8 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.536818:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576017408:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.536881:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47196c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140884.536967:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9ae3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1281 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.536996:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.537002:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.537006:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.537017:0:27790:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.537025:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:1.0:1746140884.537907:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576017408:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.537922:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14743 initiator: MDT0 00000100:00100000:0.0:1746140884.538380:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.538458:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573643264 00000100:00100000:3.0:1746140884.538463:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573643264 00010000:00010000:3.0:1746140884.538486:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 9 pid: 14741 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.538524:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8670 00000100:00100000:3.0:1746140884.538531:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573643264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.538541:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.538545:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 9 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.538554:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 9 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.538571:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e426a00/0x8156357b7fdb9a73 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1242 expref: 9 pid: 14741 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.538583:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.538587:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.538595:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.538601:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.538607:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140884.538609:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140884.538612:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.538659:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.538698:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573643264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 168us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.538705:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8670 00000100:00100000:3.0:1746140884.538730:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573643392 00000100:00100000:3.0:1746140884.538733:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573643392 00000100:00100000:3.0:1746140884.538749:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10683 00000100:00100000:3.0:1746140884.538753:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32588:x1830960573643392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.538764:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.538777:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a128f expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.538795:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.538801:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140884.538815:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.538822:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.538830:0:14785:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.538838:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.538848:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.538850:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140884.538852:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.538856:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5217400, rc 0) 00000100:00100000:3.0:1746140884.538872:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32588:x1830960573643392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 119us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.538877:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10683 00000040:00080000:1.0:1746140884.539455:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3384, 88 off286448 00000004:00080000:1.0:1746140884.539462:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615156207ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539549:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3418, 88 off289624 00000004:00080000:1.0:1746140884.539554:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863615248837ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140884.539574:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3419, 88 off289712 00000004:00080000:1.0:1746140884.539576:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863615271595ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140884.539585:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3385, 88 off286536 00000004:00080000:1.0:1746140884.539588:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615282826ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539607:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3386, 88 off286624 00000004:00080000:1.0:1746140884.539610:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615305232ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539617:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3420, 88 off289800 00000004:00080000:1.0:1746140884.539620:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863615314981ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140884.539638:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3421, 88 off289888 00000004:00080000:1.0:1746140884.539641:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863615335826ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140884.539647:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3422, 88 off289976 00000004:00080000:1.0:1746140884.539650:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863615344907ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140884.539682:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3388, 88 off286808 00000004:00080000:1.0:1746140884.539685:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615380045ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539701:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3423, 88 off290064 00000004:00080000:1.0:1746140884.539704:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863615399450ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140884.539712:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3389, 88 off286896 00000004:00080000:1.0:1746140884.539714:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615409517ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539720:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3424, 88 off290152 00000004:00080000:1.0:1746140884.539723:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863615418113ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140884.539730:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3390, 88 off286984 00000004:00080000:1.0:1746140884.539732:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615427331ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539738:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3391, 88 off287072 00000004:00080000:1.0:1746140884.539740:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615435476ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539745:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3392, 88 off287160 00000004:00080000:1.0:1746140884.539748:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615443020ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539753:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3393, 88 off287248 00000004:00080000:1.0:1746140884.539755:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863615450025ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140884.539760:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3425, 88 off290240 00000004:00080000:1.0:1746140884.539761:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863615456741ns, next at 809142599738ns, rc = 0 00000001:00080000:0.0:1746140884.560012:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944970 is committed 00000001:00080000:0.0:1746140884.560027:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944975 is committed 00000004:00080000:0.0:1746140884.560031:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2668 committed 00000004:00080000:0.0:1746140884.560038:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2639 committed 00000004:00080000:0.0:1746140884.560044:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2638 committed 00000004:00080000:0.0:1746140884.560045:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2637 committed 00000004:00080000:0.0:1746140884.560047:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2636 committed 00000004:00080000:0.0:1746140884.560048:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2667 committed 00000004:00080000:0.0:1746140884.560050:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2635 committed 00000004:00080000:0.0:1746140884.560051:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2666 committed 00000004:00080000:0.0:1746140884.560053:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2634 committed 00010000:00010000:1.0:1746140884.560054:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746140884.560055:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2665 committed 00000004:00080000:0.0:1746140884.560056:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2664 committed 00000004:00080000:0.0:1746140884.560058:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2663 committed 00000004:00080000:0.0:1746140884.560059:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2633 committed 00000004:00080000:0.0:1746140884.560061:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2632 committed 00000004:00080000:0.0:1746140884.560063:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2662 committed 00000004:00080000:0.0:1746140884.560064:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2661 committed 00000004:00080000:0.0:1746140884.560065:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2631 committed 00010000:00010000:1.0:1746140884.560068:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.560070:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000001:00080000:0.0:1746140884.560070:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944974 is committed 00010000:00010000:1.0:1746140884.560073:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00000001:00080000:0.0:1746140884.560077:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944972 is committed 00010000:00010000:1.0:1746140884.560082:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746140884.560086:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944973 is committed 00010000:00010000:1.0:1746140884.560088:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.560133:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 8 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.560148:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 8 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.560160:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576017536:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.560711:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719840 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.560727:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576017664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.560767:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.560806:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576017664 00000100:00100000:1.0:1746140884.560812:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576017664 00000100:00100000:1.0:1746140884.560843:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16708 00000100:00100000:1.0:1746140884.560849:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3311:x1830960576017664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.560856:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576018048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.560888:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.560904:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576018560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.560918:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.560931:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576019072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.560937:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576017920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.560945:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.560960:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.560960:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576019584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.560974:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.560975:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576018432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.560986:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746140884.560991:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576018176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.561003:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746140884.561009:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140884.561012:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140883 -> 1746140883 00000100:00100000:0.0:1746140884.561013:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576018048 00002000:00010000:1.0:1746140884.561014:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:1.0:1746140884.561016:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140883 -> 1746140883 00000100:00100000:0.0:1746140884.561016:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576018048 00000100:00100000:2.0:1746140884.561017:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576018944:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140884.561018:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140884.561029:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.561034:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576018560 00000100:00100000:0.0:1746140884.561036:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576018560 00000100:00100000:2.0:1746140884.561039:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576019456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.561040:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3311:x1830960576017664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (273us total) trans 17179874054 rc 0/0 00000100:00100000:1.0:1746140884.561046:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16708 00000100:00100000:0.0:1746140884.561046:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576019072 00000100:00100000:0.0:1746140884.561048:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576019072 00000100:00100000:2.0:1746140884.561050:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.561058:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576017920 00000100:00100000:2.0:1746140884.561059:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746140884.561059:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576019584 00000100:00100000:1.0:1746140884.561061:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576017920 00000100:00100000:0.0:1746140884.561061:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576019584 00000100:00100000:2.0:1746140884.561063:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576017792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.561069:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576018432 00000100:00100000:0.0:1746140884.561069:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576018944 00000100:00100000:1.0:1746140884.561070:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576018432 00000100:00100000:0.0:1746140884.561071:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576018944 00000100:00100000:2.0:1746140884.561076:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.561077:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576019456 00000100:00100000:1.0:1746140884.561078:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576019456 00000100:00100000:0.0:1746140884.561079:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576017792 00000100:00100000:0.0:1746140884.561080:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576017792 00000100:00100000:2.0:1746140884.561082:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576018304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.561086:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16709 00000100:00100000:1.0:1746140884.561091:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3310:x1830960576018048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.561092:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16710 00000100:00100000:2.0:1746140884.561094:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.561098:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3310:x1830960576018560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.561100:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576018816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.561125:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.561132:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576019328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.561145:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.561159:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576018304 00000100:00100000:2.0:1746140884.561162:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576018304 00000100:00100000:2.0:1746140884.561173:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576018816 00000100:00100000:2.0:1746140884.561174:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576018816 00000100:00100000:1.0:1746140884.561179:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3310:x1830960576018048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (291us total) trans 17179874055 rc 0/0 00000100:00100000:2.0:1746140884.561180:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576019328 00000100:00100000:2.0:1746140884.561182:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576019328 00000100:00100000:1.0:1746140884.561185:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16709 00000100:00100000:2.0:1746140884.561189:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16711 00000100:00100000:2.0:1746140884.561194:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3310:x1830960576019072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.561195:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16712 00000100:00100000:1.0:1746140884.561199:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3313:x1830960576017920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.561204:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3310:x1830960576018560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (284us total) trans 17179874056 rc 0/0 00000100:00100000:0.0:1746140884.561210:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16710 00000100:00100000:0.0:1746140884.561220:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16713 00000100:00100000:0.0:1746140884.561224:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3310:x1830960576019584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140884.561257:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746140884.561260:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140884 -> 1746140884 00002000:00010000:1.0:1746140884.561261:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140884 -> 1746140884 00002000:00010000:1.0:1746140884.561263:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140884 -> 1746140884 00002000:00010000:1.0:1746140884.561265:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746140884.561285:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3313:x1830960576017920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (325us total) trans 17179874057 rc 0/0 00000100:00100000:1.0:1746140884.561291:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16712 00000100:00100000:2.0:1746140884.561292:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3310:x1830960576019072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (345us total) trans 21474841332 rc 0/0 00000100:00100000:2.0:1746140884.561297:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16711 00000100:00100000:1.0:1746140884.561299:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16714 00000100:00100000:0.0:1746140884.561302:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3310:x1830960576019584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (327us total) trans 21474841333 rc 0/0 00000100:00100000:1.0:1746140884.561320:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3313:x1830960576018432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.561324:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16713 00000100:00100000:1.0:1746140884.562058:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3313:x1830960576018432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 753us (1052us total) trans 17179874058 rc 0/0 00000100:00100000:2.0:1746140884.562098:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16715 00000100:00100000:2.0:1746140884.562119:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3313:x1830960576018944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.562130:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16716 00000100:00100000:0.0:1746140884.562145:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3313:x1830960576019456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140884.562154:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16717 00000100:00100000:1.0:1746140884.562179:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16714 00000100:00100000:1.0:1746140884.562191:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16718 00000100:00100000:1.0:1746140884.562196:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3313:x1830960576018304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.562238:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3313:x1830960576019456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1186us total) trans 21474841334 rc 0/0 00000100:00100000:0.0:1746140884.562243:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16716 00000100:00100000:0.0:1746140884.562253:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16719 00000100:00100000:0.0:1746140884.562257:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3313:x1830960576018816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.562272:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3313:x1830960576018304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (1176us total) trans 17179874059 rc 0/0 00000100:00100000:1.0:1746140884.562277:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16718 00000100:00100000:1.0:1746140884.562289:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16720 00000100:00100000:1.0:1746140884.562293:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3313:x1830960576019328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140884.562345:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140884.562348:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140883 -> 1746140883 00002000:00010000:0.0:1746140884.562350:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140883 -> 1746140883 00002000:00010000:0.0:1746140884.562352:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140883 -> 1746140883 00002000:00010000:0.0:1746140884.562353:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140884.562373:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3313:x1830960576018816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (1247us total) trans 21474841335 rc 0/0 00000100:00100000:0.0:1746140884.562378:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16719 00000100:00100000:1.0:1746140884.562388:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3313:x1830960576019328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1241us total) trans 21474841336 rc 0/0 00000100:00100000:1.0:1746140884.562393:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16720 00000100:00100000:0.0:1746140884.562404:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.562426:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576018688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.562446:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.562499:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3313:x1830960576017792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746140884.562588:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140884.562591:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140884 -> 1746140884 00002000:00010000:3.0:1746140884.562593:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140884 -> 1746140884 00002000:00010000:3.0:1746140884.562594:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140884 -> 1746140884 00002000:00010000:3.0:1746140884.562595:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140884.562618:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3313:x1830960576017792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (1541us total) trans 17179874060 rc 0/0 00000100:00100000:3.0:1746140884.562626:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16717 00002000:00010000:2.0:1746140884.563300:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00000100:00100000:0.0:1746140884.563302:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576019200:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746140884.563316:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140884 -> 1746140884 00002000:00010000:2.0:1746140884.563318:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140884 -> 1746140884 00002000:00010000:2.0:1746140884.563319:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140884 -> 1746140884 00002000:00010000:2.0:1746140884.563321:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00000100:00100000:0.0:1746140884.563337:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.563345:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3313:x1830960576018944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1228us (2314us total) trans 21474841337 rc 0/0 00000100:00100000:2.0:1746140884.563350:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16715 00000100:00100000:3.0:1746140884.563476:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576018176 00000100:00100000:3.0:1746140884.563484:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576018176 00000100:00100000:1.0:1746140884.563513:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576018688 00000100:00100000:1.0:1746140884.563516:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576018688 00000004:00080000:0.0:1746140884.563544:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baed80/2, rc 0, transno 21474841333 00000100:00100000:0.0:1746140884.563553:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576019584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140884.563561:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baea00/2, rc 0, transno 21474841332 00000100:00100000:0.0:1746140884.563564:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576019072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140884.563573:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b181500/2, rc 0, transno 17179874055 00000100:00100000:0.0:1746140884.563577:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576018048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140884.563584:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b181f80/2, rc 0, transno 17179874056 00000100:00100000:0.0:1746140884.563587:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576018560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.563654:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576019200 00000100:00100000:0.0:1746140884.563657:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576019200 00000100:00100000:3.0:1746140884.563872:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16721 00000100:00100000:3.0:1746140884.563877:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3310:x1830960576018176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.563975:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3310:x1830960576018176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (1571us total) trans 17179874061 rc 0/0 00000100:00100000:3.0:1746140884.563981:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16721 00000004:00080000:2.0:1746140884.564080:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b180a80/2, rc 0, transno 17179874060 00000100:00100000:2.0:1746140884.564084:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576017792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140884.564093:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b180700/2, rc 0, transno 17179874059 00000100:00100000:2.0:1746140884.564096:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576018304:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140884.564114:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bae300/2, rc 0, transno 21474841335 00000100:00100000:2.0:1746140884.564117:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576018816:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140884.564124:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6badc00/2, rc 0, transno 21474841336 00000100:00100000:2.0:1746140884.564127:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576019328:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140884.564134:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b182d80/2, rc 0, transno 17179874057 00000100:00100000:2.0:1746140884.564136:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576017920:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140884.564143:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b180380/2, rc 0, transno 17179874058 00000100:00100000:2.0:1746140884.564145:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576018432:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140884.564151:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bad500/2, rc 0, transno 21474841337 00000100:00100000:2.0:1746140884.564153:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576018944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140884.564160:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bac700/2, rc 0, transno 21474841334 00000100:00100000:2.0:1746140884.564163:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576019456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.564536:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16722 00000004:00080000:3.0:1746140884.564620:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b181c00/2, rc 0, transno 17179874061 00000100:00100000:3.0:1746140884.564624:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576018176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.564628:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746140884.564635:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576019712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140884.564658:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.564677:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576019712 00000100:00100000:3.0:1746140884.564680:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576019712 00000100:00100000:3.0:1746140884.564695:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16723 00000100:00100000:3.0:1746140884.564700:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3310:x1830960576019712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140884.564797:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3310:x1830960576019712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (138us total) trans 21474841338 rc 0/0 00000100:00100000:3.0:1746140884.564802:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16723 00000004:00080000:3.0:1746140884.564823:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f518000/2, rc 0, transno 21474841338 00000100:00100000:3.0:1746140884.564826:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576019712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.564849:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3310:x1830960576018688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.564889:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16724 00000100:00100000:0.0:1746140884.564899:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3310:x1830960576019200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140884.564936:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746140884.564938:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140884 -> 1746140884 00002000:00010000:1.0:1746140884.564940:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140884 -> 1746140884 00002000:00010000:1.0:1746140884.564941:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140884 -> 1746140884 00002000:00010000:1.0:1746140884.564943:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140884.564965:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3310:x1830960576018688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 423us (2518us total) trans 21474841339 rc 0/0 00000100:00100000:1.0:1746140884.564970:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16722 00000004:00080000:1.0:1746140884.565002:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b180e00/2, rc 0, transno 17179874054 00000100:00100000:0.0:1746140884.565003:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3310:x1830960576019200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (1665us total) trans 21474841340 rc 0/0 00000100:00100000:1.0:1746140884.565005:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576017664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.565009:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16724 00000100:00100000:1.0:1746140884.565027:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576017536:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.565058:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272de00/0x8156357b7fdb9ad5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 8 pid: 14743 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746140884.565076:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 7 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.565085:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 7 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.565126:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009272ce00, rc 0) 00000100:00100000:1.0:1746140884.565161:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32585:x1830960573643136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 28565us (28769us total) trans 8589944975 rc 0/0 00000100:00100000:1.0:1746140884.565168:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10682 00000004:00080000:3.0:1746140884.565336:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bae680/2, rc 0, transno 21474841339 00000100:00100000:3.0:1746140884.565340:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576018688:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140884.565346:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6baca80/2, rc 0, transno 21474841340 00000100:00100000:3.0:1746140884.565349:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576019200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.565753:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.565793:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573643648 00000100:00100000:1.0:1746140884.565797:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573643648 00000100:00100000:1.0:1746140884.565826:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10684 00000100:00100000:1.0:1746140884.565872:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32594:x1830960573643648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.565884:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.565895:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438400/0x8156357b7fdb9af8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1296 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.566300:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566352:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566362:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566374:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566380:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566385:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566490:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566497:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566503:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000004:00200000:1.0:1746140884.566511:0:14743:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:0.0:1746140884.566589:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140884.566615:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566622:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566627:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566632:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c438000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.566634:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566640:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566649:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.566651:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746140884.566654:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566659:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b0d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566672:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566677:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566682:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566685:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c438c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.566687:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566691:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566696:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140884.566697:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140884.566700:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566704:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438c00/0x8156357b7fdb9aff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00000100:00100000:0.0:1746140884.566706:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140884.566709:0:14743:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566713:0:14743:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566717:0:14743:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566721:0:14743:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c438a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.566724:0:14743:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566728:0:14743:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566733:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130d2f400) 00010000:00010000:1.0:1746140884.566735:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140884.566737:0:14743:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140884.566741:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438a00/0x8156357b7fdb9b06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 00000100:00100000:3.0:1746140884.566757:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573643776 00000100:00100000:3.0:1746140884.566761:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573643776 00000100:00100000:3.0:1746140884.566783:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10685 00000100:00100000:3.0:1746140884.566789:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32585:x1830960573643776:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140884.566798:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.566805:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a129d expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.566812:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573643904 00000100:00100000:2.0:1746140884.566815:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573643904 00010000:00010000:3.0:1746140884.566831:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.566833:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 12 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.566841:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.566848:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.566850:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746140884.566850:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8671 00010000:00010000:3.0:1746140884.566852:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140884.566855:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573643904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.566857:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b48400, rc 0) 00010000:00010000:2.0:1746140884.566862:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.566867:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 12 pid: 14743 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.566875:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 12 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.566887:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32585:x1830960573643776:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 98us (298us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140884.566887:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9adc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1288 expref: 12 pid: 14743 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.566893:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10685 00010000:00010000:2.0:1746140884.566895:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.566898:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.566904:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.566913:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.566920:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.566962:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438400/0x8156357b7fdb9af8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1296 expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.566968:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438400/0x8156357b7fdb9af8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1296 expref: 10 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.566974:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c438400, rc 0) 00000100:00100000:1.0:1746140884.566993:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32594:x1830960573643648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1123us (1241us total) trans 8589944976 rc 301/301 00000100:00100000:1.0:1746140884.566998:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10684 00010000:00010000:2.0:1746140884.567041:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.567058:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573643904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 203us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.567063:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8671 00010000:00010000:3.0:1746140884.567079:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.567086:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00000040:00080000:3.0:1746140884.567640:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3394, 88 off287336 00000004:00080000:3.0:1746140884.567646:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643341127ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.567787:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3426, 88 off290328 00000004:00080000:3.0:1746140884.567792:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863643487581ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140884.567814:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3427, 88 off290416 00000004:00080000:3.0:1746140884.567817:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863643512192ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140884.567825:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3395, 88 off287424 00000004:00080000:3.0:1746140884.567831:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643525833ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.567838:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3396, 88 off287512 00000004:00080000:3.0:1746140884.567840:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643535311ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.567847:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3428, 88 off290504 00000004:00080000:3.0:1746140884.567849:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863643544007ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140884.567855:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3429, 88 off290592 00000004:00080000:3.0:1746140884.567857:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863643552257ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140884.567862:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3430, 88 off290680 00000004:00080000:3.0:1746140884.567865:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863643560455ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140884.567893:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3397, 88 off287600 00000004:00080000:3.0:1746140884.567896:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643591232ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.568098:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3431, 88 off290768 00000004:00080000:3.0:1746140884.568102:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863643797127ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140884.568123:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3398, 88 off287688 00000004:00080000:3.0:1746140884.568126:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643821790ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.568135:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3432, 88 off290856 00000004:00080000:3.0:1746140884.568137:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863643832736ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140884.568143:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3399, 88 off287776 00000004:00080000:3.0:1746140884.568146:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643841017ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.568153:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3400, 88 off287864 00000004:00080000:3.0:1746140884.568155:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643850456ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.568163:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3401, 88 off287952 00000004:00080000:3.0:1746140884.568166:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643861220ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.568173:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3402, 88 off288040 00000004:00080000:3.0:1746140884.568175:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 863643870476ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140884.568183:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3433, 88 off290944 00000004:00080000:3.0:1746140884.568185:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 863643880503ns, next at 809142599738ns, rc = 0 00000100:00100000:0.0:1746140884.570065:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.570141:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573644032 00000100:00100000:0.0:1746140884.570150:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573644032 00000100:00100000:0.0:1746140884.571270:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10686 00000100:00100000:0.0:1746140884.571279:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32594:x1830960573644032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140884.571300:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.571333:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9b22 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12a4 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.571438:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.571450:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.571458:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000001:00080000:1.0:1746140884.586760:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944976 is committed 00000001:00080000:1.0:1746140884.586780:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944977 is committed 00000004:00080000:1.0:1746140884.586786:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2676 committed 00000004:00080000:1.0:1746140884.586795:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2648 committed 00000004:00080000:1.0:1746140884.586801:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2647 committed 00000004:00080000:1.0:1746140884.586802:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2646 committed 00000004:00080000:1.0:1746140884.586803:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2645 committed 00000004:00080000:1.0:1746140884.586805:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2675 committed 00000004:00080000:1.0:1746140884.586807:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2644 committed 00000004:00080000:1.0:1746140884.586808:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2674 committed 00000004:00080000:1.0:1746140884.586811:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2643 committed 00000004:00080000:1.0:1746140884.586812:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2673 committed 00000004:00080000:1.0:1746140884.586814:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2672 committed 00000004:00080000:1.0:1746140884.586817:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2671 committed 00000004:00080000:1.0:1746140884.586818:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2642 committed 00000004:00080000:1.0:1746140884.586820:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2641 committed 00000004:00080000:1.0:1746140884.586821:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2670 committed 00000004:00080000:1.0:1746140884.586822:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2669 committed 00000004:00080000:1.0:1746140884.586823:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2640 committed 00010000:00010000:3.0:1746140884.586895:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 269 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.586908:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.586910:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746140884.586913:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140884.586922:0:27790:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140884.586927:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140884.586933:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.586940:0:27790:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.586945:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.586956:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.586962:0:27790:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.586967:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.587003:0:27790:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.587015:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099496680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576019840:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140884.587119:0:27790:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.587127:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099494a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576019968:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140884.587153:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.587324:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576020096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.587360:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.587382:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576020608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.587396:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.587408:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746140884.587412:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576020224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140884.587426:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.587439:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576020736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.587442:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576020096 00000100:00100000:0.0:1746140884.587450:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576020096 00000100:00100000:3.0:1746140884.587451:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140884.587467:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576020352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.587481:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576020608 00000100:00100000:3.0:1746140884.587482:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.587483:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576020608 00000100:00100000:0.0:1746140884.587492:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576020224 00000100:00100000:3.0:1746140884.587493:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576020864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.587494:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576020224 00000100:00100000:0.0:1746140884.587501:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576020736 00000100:00100000:0.0:1746140884.587503:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576020736 00000100:00100000:3.0:1746140884.587505:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.587520:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576020352 00000100:00100000:0.0:1746140884.587522:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576020352 00000100:00100000:0.0:1746140884.587530:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576020864 00000100:00100000:0.0:1746140884.587532:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576020864 00000100:00100000:0.0:1746140884.587542:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16725 00000100:00100000:0.0:1746140884.587548:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3312:x1830960576020096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140884.587702:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140884.587705:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140883 -> 1746140883 00002000:00010000:0.0:1746140884.587707:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140882 -> 1746140882 00002000:00010000:0.0:1746140884.587709:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140883 -> 1746140883 00002000:00010000:0.0:1746140884.587710:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140884.587736:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3312:x1830960576020096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (376us total) trans 17179874062 rc 0/0 00000100:00100000:0.0:1746140884.587741:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16725 00000100:00100000:0.0:1746140884.587755:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16726 00000100:00100000:2.0:1746140884.587756:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576021248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.587758:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3312:x1830960576020608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.587782:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746140884.587788:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140884.587796:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576021760:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746140884.587796:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140884.587809:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.587817:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746140884.587821:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576021120:0@lo:2:osp-syn-0-0.0 00000004:00200000:1.0:1746140884.587831:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:0.0:1746140884.587831:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3312:x1830960576020608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (433us total) trans 17179874063 rc 0/0 00000100:00100000:2.0:1746140884.587835:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.587835:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16726 00000004:00200000:1.0:1746140884.587836:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1746140884.587841:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576021632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.587842:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576021248 00000100:00100000:0.0:1746140884.587843:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576021248 00000004:00010000:1.0:1746140884.587850:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140884.587850:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576021760 00000100:00100000:0.0:1746140884.587851:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576021760 00000100:00100000:0.0:1746140884.587855:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576021120 00000100:00100000:0.0:1746140884.587856:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576021120 00000100:00100000:2.0:1746140884.587857:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.587861:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576021632 00000100:00100000:0.0:1746140884.587863:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576021632 00000100:00100000:0.0:1746140884.587868:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16727 00000100:00100000:0.0:1746140884.587871:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3312:x1830960576020224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.587873:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16728 00000100:00100000:2.0:1746140884.587879:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3312:x1830960576020736:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746140884.587880:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e9000/0x8156357b7fdb9b22 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.587894:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.587901:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.587903:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746140884.587905:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930e8200, rc 0) 00002000:00010000:0.0:1746140884.587924:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140884.587926:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140884 -> 1746140884 00002000:00010000:0.0:1746140884.587927:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140884 -> 1746140884 00002000:00010000:0.0:1746140884.587929:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140884 -> 1746140884 00000100:00100000:1.0:1746140884.587931:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32594:x1830960573644032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 16654us (17873us total) trans 0 rc 0/0 00002000:00010000:0.0:1746140884.587931:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140884.587938:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10686 00000100:00100000:0.0:1746140884.587947:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3312:x1830960576020224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (519us total) trans 17179874064 rc 0/0 00000100:00100000:0.0:1746140884.587951:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16727 00000100:00100000:1.0:1746140884.587957:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576020480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140884.587960:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16729 00000100:00100000:0.0:1746140884.587963:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3310:x1830960576020352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.587975:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3312:x1830960576020736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (522us total) trans 17179874065 rc 0/0 00000100:00100000:1.0:1746140884.587978:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.587981:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16728 00000100:00100000:2.0:1746140884.587990:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576020480 00000100:00100000:1.0:1746140884.587991:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576020992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.587993:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576020480 00000100:00100000:1.0:1746140884.588003:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140884.588004:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16730 00000100:00100000:2.0:1746140884.588008:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3310:x1830960576020864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.588009:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576021504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.588021:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.588026:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576022016:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140884.588028:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140884.588030:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140884 -> 1746140884 00002000:00010000:0.0:1746140884.588031:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140884 -> 1746140884 00002000:00010000:0.0:1746140884.588033:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140884 -> 1746140884 00002000:00010000:0.0:1746140884.588035:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746140884.588037:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.588045:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746140884.588049:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576021376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.588053:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3310:x1830960576020352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (570us total) trans 17179874066 rc 0/0 00000100:00100000:0.0:1746140884.588058:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16729 00000100:00100000:1.0:1746140884.588061:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140884.588067:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f51b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576021888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.588068:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576020992 00000100:00100000:0.0:1746140884.588071:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576020992 00000100:00100000:0.0:1746140884.588080:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576021504 00000100:00100000:1.0:1746140884.588082:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140884.588082:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576021504 00000100:00100000:2.0:1746140884.588087:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3310:x1830960576020864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (580us total) trans 17179874067 rc 0/0 00000100:00100000:0.0:1746140884.588089:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576022016 00000100:00100000:0.0:1746140884.588091:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576022016 00000100:00100000:2.0:1746140884.588092:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16730 00000100:00100000:1.0:1746140884.588098:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576021376 00000100:00100000:0.0:1746140884.588099:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576021888 00000100:00100000:2.0:1746140884.588101:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16731 00000100:00100000:0.0:1746140884.588101:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576021888 00000100:00100000:1.0:1746140884.588102:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576021376 00000100:00100000:2.0:1746140884.588120:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960576021248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.588123:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16732 00000100:00100000:0.0:1746140884.588126:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960576021760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.588130:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16733 00000100:00100000:1.0:1746140884.588135:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960576021120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.588172:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16734 00000100:00100000:0.0:1746140884.588178:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3313:x1830960576021632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.588187:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16735 00000100:00100000:1.0:1746140884.588192:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3311:x1830960576020480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140884.588237:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140884.588240:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140883 -> 1746140883 00002000:00010000:2.0:1746140884.588242:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140883 -> 1746140883 00002000:00010000:2.0:1746140884.588243:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140883 -> 1746140883 00002000:00010000:2.0:1746140884.588245:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140884.588286:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3313:x1830960576021632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (428us total) trans 21474841342 rc 0/0 00000100:00100000:2.0:1746140884.588290:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3313:x1830960576021248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (507us total) trans 21474841341 rc 0/0 00000100:00100000:0.0:1746140884.588290:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16734 00000100:00100000:2.0:1746140884.588295:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16731 00000100:00100000:1.0:1746140884.588299:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3311:x1830960576020480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (320us total) trans 17179874068 rc 0/0 00000100:00100000:0.0:1746140884.588299:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16736 00000100:00100000:0.0:1746140884.588320:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3311:x1830960576020992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140884.588321:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16735 00000100:00100000:2.0:1746140884.588325:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16737 00000100:00100000:2.0:1746140884.588330:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3311:x1830960576021504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.588335:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16738 00000100:00100000:1.0:1746140884.588339:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3311:x1830960576022016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.588394:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3311:x1830960576020992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (390us total) trans 17179874069 rc 0/0 00000100:00100000:1.0:1746140884.588397:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16739 00000100:00100000:0.0:1746140884.588400:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16736 00000100:00100000:1.0:1746140884.588402:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576021888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.588412:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16740 00000100:00100000:2.0:1746140884.588416:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576021504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (393us total) trans 21474841343 rc 0/0 00000100:00100000:0.0:1746140884.588417:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576021376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.588421:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16737 00000004:00080000:2.0:1746140884.588455:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f51ad80/2, rc 0, transno 21474841342 00000100:00100000:2.0:1746140884.588461:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576021632:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140884.588467:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f519880/2, rc 0, transno 21474841341 00000100:00100000:2.0:1746140884.588470:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576021248:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140884.588474:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fcd3100/2, rc 0, transno 17179874068 00000100:00100000:1.0:1746140884.588479:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576020480:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140884.588483:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fcd2a00/2, rc 0, transno 17179874064 00000100:00100000:2.0:1746140884.588486:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576020224:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140884.588486:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b754000/2, rc 0, transno 17179874069 00000100:00100000:1.0:1746140884.588489:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576020992:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140884.588493:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fcd3800/2, rc 0, transno 17179874065 00000100:00100000:2.0:1746140884.588496:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576020736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140884.588496:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f51b800/2, rc 0, transno 21474841343 00000100:00100000:1.0:1746140884.588499:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576021504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140884.588502:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fcd3480/2, rc 0, transno 17179874063 00000100:00100000:2.0:1746140884.588505:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576020608:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140884.588511:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fcd2680/2, rc 0, transno 17179874062 00000100:00100000:2.0:1746140884.588513:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576020096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.588541:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746140884.588550:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576022144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.588569:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746140884.588581:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fcd3b80/2, rc 0, transno 17179874067 00000100:00100000:3.0:1746140884.588585:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576020864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.588585:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576022144 00000100:00100000:2.0:1746140884.588588:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576022144 00000004:00080000:3.0:1746140884.588593:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fcd2d80/2, rc 0, transno 17179874066 00000100:00100000:3.0:1746140884.588596:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576020352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140884.588604:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16741 00000100:00100000:2.0:1746140884.588609:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3313:x1830960576022144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140884.588754:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:0.0:1746140884.588757:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140884 -> 1746140884 00002000:00010000:0.0:1746140884.588759:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140884 -> 1746140884 00002000:00010000:0.0:1746140884.588760:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140884 -> 1746140884 00002000:00010000:0.0:1746140884.588762:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00000100:00100000:0.0:1746140884.588781:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3311:x1830960576021376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 365us (719us total) trans 21474841346 rc 0/0 00000100:00100000:0.0:1746140884.588787:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16740 00000100:00100000:0.0:1746140884.588972:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960576021760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 844us (1161us total) trans 21474841347 rc 0/0 00000100:00100000:0.0:1746140884.588978:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16732 00000100:00100000:1.0:1746140884.589032:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3311:x1830960576021888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 629us (947us total) trans 21474841345 rc 0/0 00000100:00100000:1.0:1746140884.589038:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16739 00000004:00080000:1.0:1746140884.589058:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f519500/2, rc 0, transno 21474841346 00000100:00100000:1.0:1746140884.589061:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576021376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140884.589067:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f51b100/2, rc 0, transno 21474841345 00000100:00100000:1.0:1746140884.589070:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f51b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576021888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.589101:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576022016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 762us (1062us total) trans 21474841344 rc 0/0 00000004:00080000:3.0:1746140884.589288:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f519180/2, rc 0, transno 21474841347 00000100:00100000:3.0:1746140884.589291:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576021760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140884.589392:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960576022144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 782us (821us total) trans 21474841348 rc 0/0 00000100:00100000:0.0:1746140884.589397:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16741 00002000:00010000:2.0:1746140884.589403:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140884.589407:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140884 -> 1746140884 00002000:00010000:2.0:1746140884.589408:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140884 -> 1746140884 00002000:00010000:2.0:1746140884.589410:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140884 -> 1746140884 00002000:00010000:2.0:1746140884.589412:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140884.589434:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960576021120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1298us (1597us total) trans 21474841349 rc 0/0 00000004:00080000:3.0:1746140884.589485:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea9500/2, rc 0, transno 21474841348 00000100:00100000:3.0:1746140884.589489:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576022144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140884.589495:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f51aa00/2, rc 0, transno 21474841349 00000100:00100000:3.0:1746140884.589498:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576021120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140884.589563:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16733 00000100:00100000:1.0:1746140884.589568:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16738 00000004:00080000:1.0:1746140884.589699:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eeab800/2, rc 0, transno 21474841344 00000100:00100000:1.0:1746140884.589702:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576022016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140884.591090:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.591148:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573644160 00000100:00100000:2.0:1746140884.591156:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573644160 00000100:00100000:1.0:1746140884.591158:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.591200:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573644288 00000100:00100000:2.0:1746140884.591202:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573644288 00000100:00100000:2.0:1746140884.591222:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4676 00000100:00100000:2.0:1746140884.591228:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32585:x1830960573644160:12345-192.168.204.16@tcp:49:multiop.0 00000100:00100000:0.0:1746140884.591237:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4677 00000100:00100000:0.0:1746140884.591246:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093238850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32588:x1830960573644288:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:2.0:1746140884.591354:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32585:x1830960573644160:12345-192.168.204.16@tcp:49:multiop.0 Request processed in 126us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.591360:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4676 00000100:00100000:3.0:1746140884.591479:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099496680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576019840:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140884.591490:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099494a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576019968:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140884.591618:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093238850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32588:x1830960573644288:12345-192.168.204.16@tcp:49:cat.0 Request processed in 373us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.591623:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4677 00010000:00010000:3.0:1746140884.591742:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9ae3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 269 pid: 27790 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746140884.591762:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.591786:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5217800, rc 0) 00000100:00100000:3.0:1746140884.591807:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32590:x1830960573642880:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 55345us (56444us total) trans 8589944977 rc 0/0 00000100:00100000:3.0:1746140884.591814:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10681 00000100:00100000:1.0:1746140884.591894:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.592001:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573644416 00000100:00100000:2.0:1746140884.592004:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573644416 00000100:00100000:2.0:1746140884.592020:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4678 00000100:00100000:2.0:1746140884.592024:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32594:x1830960573644416:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:2.0:1746140884.592069:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32594:x1830960573644416:12345-192.168.204.16@tcp:49:cat.0 Request processed in 44us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.592073:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4678 00000100:00100000:0.0:1746140884.593112:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.593162:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573644544 00000100:00100000:1.0:1746140884.593166:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573644544 00000100:00100000:1.0:1746140884.594595:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16742 00000100:00100000:1.0:1746140884.594607:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32585:x1830960573644544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140884.594624:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.594646:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12ab expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.594674:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.594682:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.594683:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.594686:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1409024->2097151] (req 1409024->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 12 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.594713:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.594723:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 31 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.594734:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576022272:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.594818:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.596796:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.596835:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.596860:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.596881:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.596889:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573644800 00000100:00100000:2.0:1746140884.596889:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573644672 00000100:00100000:0.0:1746140884.596894:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.596898:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573644800 00000100:00100000:2.0:1746140884.596898:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573644672 00000100:00100000:0.0:1746140884.596907:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.596930:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.596945:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4679 00000100:00100000:2.0:1746140884.596946:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573644928 00000100:00100000:2.0:1746140884.596947:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573644928 00000100:00100000:3.0:1746140884.596952:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32590:x1830960573644800:12345-192.168.204.16@tcp:49:multiop.0 00000100:00100000:1.0:1746140884.596958:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573645184 00000100:00100000:2.0:1746140884.596959:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573645056 00000100:00100000:0.0:1746140884.596959:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573645440 00000100:00100000:2.0:1746140884.596960:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573645056 00000100:00100000:0.0:1746140884.596962:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573645440 00000100:00100000:2.0:1746140884.596969:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573645312 00000100:00100000:1.0:1746140884.596969:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573645184 00000100:00100000:2.0:1746140884.596971:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573645312 00000100:00100000:0.0:1746140884.596983:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16743 00000100:00100000:2.0:1746140884.596988:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16744 00000100:00100000:0.0:1746140884.596989:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573644672:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140884.596993:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573644928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140884.597000:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.597001:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.597015:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092cd5800/0x8156357b7fdb9b37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12b9 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.597015:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16745 00010000:00010000:0.0:1746140884.597015:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12b2 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.597023:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573645056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.597033:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.597033:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.597035:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.597036:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.597043:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092cd5800/0x8156357b7fdb9b37 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b9 expref: 16 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.597043:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 20 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.597050:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12c0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.597051:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092cd5800/0x8156357b7fdb9b37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b9 expref: 16 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.597056:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 20 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.597061:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cd5800, rc 0) 00000100:00100000:3.0:1746140884.597067:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32590:x1830960573644800:12345-192.168.204.16@tcp:49:multiop.0 Request processed in 115us (230us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140884.597067:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.597068:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.597070:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c438000, rc 0) 00000100:00100000:3.0:1746140884.597074:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4679 00010000:00010000:1.0:1746140884.597078:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 16 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140884.597082:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573644928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 88us (221us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140884.597086:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573644672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.597087:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16744 00000100:00100000:0.0:1746140884.597091:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16743 00010000:00010000:1.0:1746140884.597092:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 16 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140884.597098:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16746 00010000:00010000:1.0:1746140884.597101:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d12b600, rc 0) 00000100:00100000:2.0:1746140884.597102:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16747 00000100:00100000:3.0:1746140884.597113:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573645440:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140884.597117:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1983:x1830960573645312:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140884.597117:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16748 00010000:00010000:3.0:1746140884.597120:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.597123:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140884.597123:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1983:x1830960573645184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.597128:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12d5 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.597129:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12ce expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.597129:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.597135:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12c7 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.597137:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.597138:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.597140:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.597142:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.597143:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 21 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.597144:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.597145:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.597147:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.597150:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 21 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.597151:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 21 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140884.597152:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573645056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 129us (243us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140884.597157:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.597157:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092cd5200, rc 0) 00000100:00100000:1.0:1746140884.597158:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16745 00010000:00010000:0.0:1746140884.597159:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 21 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.597165:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c439a00, rc 0) 00010000:00010000:3.0:1746140884.597169:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f898e00, rc 0) 00000100:00100000:2.0:1746140884.597171:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573645312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 54us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.597177:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16747 00000100:00100000:0.0:1746140884.597180:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573645184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.597185:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16748 00000100:00100000:3.0:1746140884.597187:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573645440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.597192:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16746 00000100:00100000:0.0:1746140884.599269:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.599332:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573645568 00000100:00100000:2.0:1746140884.599339:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573645568 00010000:00010000:2.0:1746140884.599365:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 32 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:2.0:1746140884.599391:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8672 00000100:00100000:2.0:1746140884.599396:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573645568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.599405:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.599424:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 32 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.599433:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 32 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.599450:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.599451:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.599455:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 14 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.599461:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 14 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.599486:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 14 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.599498:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576022400:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140884.599551:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530780 going to sleep for 11 seconds 00010000:00010000:1.0:1746140884.599726:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db8ac00/0x8156357b7fdb9a88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1250 expref: 32 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.599742:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576022272:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.599761:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 14 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.599770:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092994800, rc 0) 00000100:00100000:1.0:1746140884.599807:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32585:x1830960573644544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5205us (6706us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.599815:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16742 00000100:00100000:2.0:1746140884.604213:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.604350:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573645824 00000100:00100000:1.0:1746140884.604360:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573645824 00002000:00100000:1.0:1746140884.604403:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009eea8380 x1830960573645824/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.604414:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eea8380 with x1830960573645824 ext(0->1048575) 00002000:00010000:1.0:1746140884.604420:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eea8380 00000100:00100000:1.0:1746140884.604438:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8577 00000100:00100000:1.0:1746140884.604444:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573645824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.606856:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.606986:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576022400:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140884.607013:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.607043:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573645568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7645us (7782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.607053:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8672 00000100:00100000:2.0:1746140884.607224:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573646080 00000100:00100000:2.0:1746140884.607231:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573646080 00002000:00100000:2.0:1746140884.607264:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1409024->1413119) req@ffff88009b755f80 x1830960573646080/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.607273:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755f80 with x1830960573646080 ext(1409024->1413119) 00002000:00010000:2.0:1746140884.607277:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b755f80 00000100:00100000:2.0:1746140884.607322:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8578 00000100:00100000:2.0:1746140884.607329:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573646080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.607468:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573646080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 139us (623us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140884.607474:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8578 00002000:00100000:2.0:1746140884.607479:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1409024->1413119) req@ffff88009b755f80 x1830960573646080/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.607485:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755f80 with x1830960573646080 ext(1409024->1413119) 00002000:00010000:2.0:1746140884.607487:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b755f80 00000100:00100000:1.0:1746140884.616748:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573645824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12293us (12534us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.616760:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8577 00002000:00100000:1.0:1746140884.616771:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009eea8380 x1830960573645824/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.616780:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eea8380 with x1830960573645824 ext(0->1048575) 00002000:00010000:1.0:1746140884.616786:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eea8380 00000100:00100000:0.0:1746140884.619363:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.619444:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573646208 00000100:00100000:1.0:1746140884.619453:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573646208 00000100:00100000:1.0:1746140884.619491:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16749 00000100:00100000:1.0:1746140884.619498:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573646208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.619515:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.619530:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12dc expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.619585:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576022528:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140884.619668:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.632360:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.632394:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.632417:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.632454:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573646720 00000100:00100000:3.0:1746140884.632462:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573646720 00002000:00100000:3.0:1746140884.632505:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b756680 x1830960573646720/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 504/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.632517:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756680 with x1830960573646720 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.632523:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756680 00000100:00100000:3.0:1746140884.632539:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573646592 00000100:00100000:3.0:1746140884.632542:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573646592 00002000:00100000:3.0:1746140884.632555:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009b756a00 x1830960573646592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.632562:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756a00 with x1830960573646592 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.632564:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b756a00 00000100:00100000:3.0:1746140884.632570:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573646848 00000100:00100000:3.0:1746140884.632572:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573646848 00002000:00100000:3.0:1746140884.632579:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b756d80 x1830960573646848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140884.632579:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8579 00002000:00100000:3.0:1746140884.632585:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756d80 with x1830960573646848 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.632588:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756d80 00000100:00100000:1.0:1746140884.632589:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573646720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.632597:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8580 00000100:00100000:3.0:1746140884.632602:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573646592:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:1.0:1746140884.632687:0:4785:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime: 1746140883 -> 1746140885 00002000:00010000:1.0:1746140884.632691:0:4785:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime: 1746140882 -> 1746140885 00002000:00010000:1.0:1746140884.632692:0:4785:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime: 1746140883 -> 1746140885 00000100:00100000:1.0:1746140884.632704:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576022528:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140884.632735:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b61 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12dc expref: 32 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.632749:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12dc expref: 32 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.632765:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d12b400, rc 0) 00000100:00100000:1.0:1746140884.632809:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573646208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 13311us (13455us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140884.632817:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16749 00000100:00100000:1.0:1746140884.632965:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8581 00000100:00100000:1.0:1746140884.632971:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573646848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.641504:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.641634:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573647232 00000100:00100000:2.0:1746140884.641644:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573647232 00002000:00100000:2.0:1746140884.641687:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff88009b757100 x1830960573647232/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.641697:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b757100 with x1830960573647232 ext(4882432->4886527) 00002000:00010000:2.0:1746140884.641704:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b757100 00000100:00100000:2.0:1746140884.641723:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8582 00000100:00100000:2.0:1746140884.641731:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573647232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.641904:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573647232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 173us (411us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140884.641911:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8582 00002000:00100000:2.0:1746140884.641916:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff88009b757100 x1830960573647232/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.641923:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b757100 with x1830960573647232 ext(4882432->4886527) 00002000:00010000:2.0:1746140884.641925:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b757100 00000100:00100000:3.0:1746140884.642675:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573646592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10060us (10268us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.642687:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8580 00002000:00100000:3.0:1746140884.642700:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009b756a00 x1830960573646592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.642710:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756a00 with x1830960573646592 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.642715:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b756a00 00000100:00100000:3.0:1746140884.648835:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573646720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16239us (16520us total) trans 0 rc 671744/671744 00000100:00100000:3.0:1746140884.648846:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8579 00002000:00100000:3.0:1746140884.648857:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b756680 x1830960573646720/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 504/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.648865:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756680 with x1830960573646720 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.648870:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756680 00000100:00100000:1.0:1746140884.649474:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573646848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16496us (17048us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.649483:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8581 00002000:00100000:1.0:1746140884.649493:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b756d80 x1830960573646848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.649502:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756d80 with x1830960573646848 ext(1048576->2097151) 00002000:00010000:1.0:1746140884.649506:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756d80 00000100:00100000:0.0:1746140884.649677:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.650010:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573647360 00000100:00100000:1.0:1746140884.650018:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573647360 00000100:00100000:1.0:1746140884.650068:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16750 00000100:00100000:1.0:1746140884.650075:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:32590:x1830960573647360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140884.650090:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.650114:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12e3 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.650139:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 24 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.650149:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 19 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.650155:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.650156:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.650159:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3833856->4194303] (req 3833856->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 24 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.650188:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 19 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.650199:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 19 pid: 32377 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.650211:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576022656:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.650287:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 24 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.650295:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 24 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.650319:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576022784:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.650346:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.654525:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.654561:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.654694:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573647616 00000100:00100000:2.0:1746140884.654705:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573647616 00000100:00100000:2.0:1746140884.654769:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4680 00000100:00100000:2.0:1746140884.654777:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32588:x1830960573647616:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140884.655055:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32588:x1830960573647616:12345-192.168.204.16@tcp:35:cat.0 Request processed in 278us (539us total) trans 8589944978 rc 0/0 00000100:00100000:2.0:1746140884.655062:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4680 00000100:00100000:1.0:1746140884.655195:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573647744 00000100:00100000:1.0:1746140884.655201:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573647744 00000100:00100000:1.0:1746140884.655519:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16751 00000100:00100000:1.0:1746140884.655528:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32585:x1830960573647744:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140884.655544:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.655565:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12ea expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.655592:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 30 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.655600:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 15 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.655607:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.655610:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.655613:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->1228799] (req 1048576->1228799) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 15 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.655714:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.655736:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573647872 00000100:00100000:2.0:1746140884.655741:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573647872 00000100:00100000:3.0:1746140884.655751:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140884.655761:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 20 pid: 32377 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.655770:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573648000 00000100:00100000:3.0:1746140884.655774:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573648000 00000100:00100000:2.0:1746140884.655781:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8673 00000100:00100000:2.0:1746140884.655786:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573647872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.655791:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 25 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.655794:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140884.655811:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8674 00010000:00010000:2.0:1746140884.655814:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 20 pid: 32377 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.655815:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573648000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.655823:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.655824:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 20 pid: 32377 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.655841:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140884.655842:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 25 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.655851:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 25 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.655868:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.655870:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140884.655870:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573647872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (158us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140884.655876:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.655876:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8673 00010000:00010000:3.0:1746140884.655884:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.655911:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.655922:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576022912:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140884.655964:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746140884.656046:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 15 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.656058:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 15 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.656068:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576023040:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.656120:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 30 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.656128:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 30 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.656136:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576023168:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.656154:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00010000:00010000:1.0:1746140884.656185:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092cd5200/0x8156357b7fdb9b53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ce expref: 19 pid: 32377 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.656567:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576022656:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.656582:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c85400/0x8156357b7fdb9a9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1265 expref: 25 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.656595:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576022784:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.656616:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 24 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.656624:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63e000, rc 0) 00000100:00100000:1.0:1746140884.656644:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:32590:x1830960573647360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6571us (6969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.656650:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16750 00000100:00100000:0.0:1746140884.660780:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.661045:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576023040:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.661070:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573648128 00000100:00100000:1.0:1746140884.661076:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573648128 00000100:00100000:1.0:1746140884.661140:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16752 00000100:00100000:1.0:1746140884.661147:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+19:32594:x1830960573648128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.661166:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.661183:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12f1 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.661214:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.661222:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.661223:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.661226:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 20 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.661260:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.661270:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.661282:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576023296:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.661376:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576022912:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140884.661385:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746140884.661397:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.661443:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573648000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5626us (5690us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.661453:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8674 00000100:00100000:2.0:1746140884.661702:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.661737:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.661763:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573648256 00000100:00100000:3.0:1746140884.661769:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573648256 00010000:00010000:3.0:1746140884.661793:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 16 pid: 4782 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.661808:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573648512 00000100:00100000:1.0:1746140884.661812:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573648512 00000100:00100000:3.0:1746140884.661829:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8675 00000100:00100000:3.0:1746140884.661836:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573648256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.661848:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.661869:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 16 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.661879:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 16 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.661899:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d12b600/0x8156357b7fdb9b45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c0 expref: 16 pid: 4782 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.661924:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.661955:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573648256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.661960:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8675 00000100:00100000:0.0:1746140884.662354:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.662419:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573648640 00000100:00100000:3.0:1746140884.662424:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573648640 00010000:00010000:3.0:1746140884.662436:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 31 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.662461:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8676 00000100:00100000:3.0:1746140884.662466:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573648640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.662472:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.662479:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 31 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.662487:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 31 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.662498:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.662500:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.662505:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 14 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.662512:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 14 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.662536:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 14 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.662545:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576023424:192.168.204.16@tcp:105: 00002000:00100000:1.0:1746140884.662656:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3833856->3837951) req@ffff88009eea9f80 x1830960573648512/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.662666:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eea9f80 with x1830960573648512 ext(3833856->3837951) 00010000:00010000:1.0:1746140884.662673:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.662685:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 963 lvb_type: 0 00002000:00010000:1.0:1746140884.662691:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009eea9f80 00000100:00100000:1.0:1746140884.662707:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1778 00000100:00100000:1.0:1746140884.662714:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573648512:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.662797:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746140884.662866:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9a8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1257 expref: 31 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:2.0:1746140884.662882:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576023168:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.662906:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 14 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.662916:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff15200, rc 0) 00000100:00100000:2.0:1746140884.663061:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32585:x1830960573647744:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7533us (8497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.663068:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16751 00000100:00100000:1.0:1746140884.663269:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573648512:12345-192.168.204.16@tcp:3:cat.0 Request processed in 555us (1530us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140884.663278:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1778 00002000:00100000:1.0:1746140884.663284:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3833856->3837951) req@ffff88009eea9f80 x1830960573648512/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.663290:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eea9f80 with x1830960573648512 ext(3833856->3837951) 00010000:00010000:1.0:1746140884.663296:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.663322:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 963 lvb_type: 0 00002000:00010000:1.0:1746140884.663327:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009eea9f80 00000100:00100000:1.0:1746140884.663701:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576023296:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.663717:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 20 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.663726:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36000, rc 0) 00000100:00100000:1.0:1746140884.663816:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32594:x1830960573648128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2670us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.663822:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16752 00000100:00100000:3.0:1746140884.664987:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576023424:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140884.665006:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.665052:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573648640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2584us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.665060:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8676 00000100:00100000:0.0:1746140884.667939:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.668034:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573648896 00000100:00100000:1.0:1746140884.668044:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573648896 00002000:00100000:1.0:1746140884.668084:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1224704->1228799) req@ffff880130d28380 x1830960573648896/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.668092:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d28380 with x1830960573648896 ext(1224704->1228799) 00002000:00010000:1.0:1746140884.668098:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d28380 00000100:00100000:1.0:1746140884.668141:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8583 00000100:00100000:1.0:1746140884.668149:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573648896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140884.668288:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573648896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 140us (356us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140884.668294:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8583 00002000:00100000:1.0:1746140884.668299:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1224704->1228799) req@ffff880130d28380 x1830960573648896/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.668325:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d28380 with x1830960573648896 ext(1224704->1228799) 00002000:00010000:1.0:1746140884.668328:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d28380 00000100:00100000:0.0:1746140884.670700:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.670791:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.670872:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573649152 00000100:00100000:1.0:1746140884.670881:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573649152 00000100:00100000:1.0:1746140884.670929:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16753 00000100:00100000:1.0:1746140884.670936:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:32590:x1830960573649152:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140884.670952:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140884.671008:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573649280 00000100:00100000:2.0:1746140884.671011:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573649280 00002000:00100000:2.0:1746140884.671033:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3833856->4194303) req@ffff880130d28a80 x1830960573649280/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.671046:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d28a80 with x1830960573649280 ext(3833856->4194303) 00010000:00010000:2.0:1746140884.671053:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.671065:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 23 pid: 4785 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.671071:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d28a80 00000100:00100000:2.0:1746140884.671093:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1779 00000100:00100000:2.0:1746140884.671098:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573649280:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746140884.671135:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12f8 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.671159:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.671167:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 13 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.671173:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.671176:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.671179:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->3522559] (req 3145728->3522559) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 31 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.671207:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 13 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.671216:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 13 pid: 4784 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.671226:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576023552:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.671329:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.671337:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 31 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.671536:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576023680:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.671568:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.672456:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.672531:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573649536 00000100:00100000:2.0:1746140884.672538:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573649536 00000100:00100000:2.0:1746140884.672579:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4681 00000100:00100000:2.0:1746140884.672586:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32585:x1830960573649536:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140884.673061:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576023552:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.673561:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32585:x1830960573649536:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 974us (1106us total) trans 8589944979 rc 0/0 00000100:00100000:2.0:1746140884.673568:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4681 00000100:00100000:2.0:1746140884.675541:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.675573:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576023680:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.675585:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.675601:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573649792 00000100:00100000:2.0:1746140884.675606:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573649792 00010000:00010000:2.0:1746140884.675631:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 32 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:2.0:1746140884.675650:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573649664 00000100:00100000:2.0:1746140884.675652:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573649664 00010000:00010000:2.0:1746140884.675660:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 14 pid: 4784 timeout: 963 lvb_type: 1 00000100:00100000:2.0:1746140884.675671:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8677 00000100:00100000:2.0:1746140884.675677:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573649792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.675686:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.675687:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->3522559] (req 3145728->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 32 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.675702:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37800, rc 0) 00010000:00010000:2.0:1746140884.675705:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 32 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.675713:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 32 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.675732:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c84e00/0x8156357b7fdb9aa4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a126c expref: 32 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.675734:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:32590:x1830960573649152:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4799us (5042us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140884.675741:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.675741:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16753 00000100:00100000:2.0:1746140884.675755:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573649792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.675760:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8677 00000100:00100000:2.0:1746140884.675770:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8678 00000100:00100000:2.0:1746140884.675774:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573649664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.675779:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.675786:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 14 pid: 4784 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.675796:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 14 pid: 4784 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.675807:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f898e00/0x8156357b7fdb9b4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12d5 expref: 14 pid: 4784 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.675814:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.675816:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.675821:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 29 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.675829:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 29 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.675852:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 29 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.675862:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576023808:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140884.675918:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746140884.677438:0:1273:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746140884.678181:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573649280:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7076us (7383us total) trans 21474841350 rc 0/0 00000100:00100000:3.0:1746140884.678192:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1779 00002000:00100000:3.0:1746140884.678201:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3833856->4194303) req@ffff880130d28a80 x1830960573649280/t21474841350(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.678209:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d28a80 with x1830960573649280 ext(3833856->4194303) 00010000:00010000:3.0:1746140884.678217:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.678230:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.678237:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d28a80 00000100:00100000:2.0:1746140884.679409:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576023808:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140884.679425:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.679454:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573649664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3678us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.679463:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8678 00000100:00100000:0.0:1746140884.683622:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.683666:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.683686:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573650176 00000100:00100000:3.0:1746140884.683699:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573650176 00002000:00100000:3.0:1746140884.683904:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3518464->3522559) req@ffff880130d29180 x1830960573650176/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.683913:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29180 with x1830960573650176 ext(3518464->3522559) 00002000:00010000:3.0:1746140884.683918:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d29180 00000100:00100000:3.0:1746140884.683947:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8584 00000100:00100000:3.0:1746140884.683955:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573650176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.684242:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573650048 00000100:00100000:2.0:1746140884.684247:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573650048 00010000:00010000:2.0:1746140884.684269:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.684400:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573650176:12345-192.168.204.16@tcp:3:cat.0 Request processed in 446us (783us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140884.684408:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8584 00002000:00100000:3.0:1746140884.684414:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (3518464->3522559) req@ffff880130d29180 x1830960573650176/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.684421:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29180 with x1830960573650176 ext(3518464->3522559) 00002000:00010000:3.0:1746140884.684423:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d29180 00000100:00100000:2.0:1746140884.684548:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8679 00000100:00100000:2.0:1746140884.684554:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573650048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.684563:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746140884.684576:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140884 -> 1746140885 00002000:00010000:2.0:1746140884.684578:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140884 -> 1746140885 00010000:00010000:2.0:1746140884.684582:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.684592:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.684612:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9b68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3833856->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12e3 expref: 25 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.684627:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.684629:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.684634:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.684643:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.684673:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.684685:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576023936:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140884.684728:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.686338:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576023936:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140884.686353:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.686389:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1982:x1830960573650048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1835us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.686395:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.686397:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8679 00000100:00100000:3.0:1746140884.686523:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573650432 00000100:00100000:3.0:1746140884.686528:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573650432 00000100:00100000:3.0:1746140884.686556:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4682 00000100:00100000:3.0:1746140884.686561:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092bdec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32590:x1830960573650432:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140884.686715:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092bdec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32590:x1830960573650432:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 153us (319us total) trans 8589944980 rc 0/0 00000100:00100000:3.0:1746140884.686722:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4682 00000100:00100000:0.0:1746140884.688724:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.688764:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573650688 00000100:00100000:3.0:1746140884.688771:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573650688 00002000:00100000:3.0:1746140884.688801:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880130d29500 x1830960573650688/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.688811:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29500 with x1830960573650688 ext(2097152->3145727) 00002000:00010000:3.0:1746140884.688814:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d29500 00000100:00100000:3.0:1746140884.688838:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8585 00000100:00100000:3.0:1746140884.688847:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573650688:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.696449:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573650688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7598us (7722us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.696458:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8585 00002000:00100000:3.0:1746140884.696467:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880130d29500 x1830960573650688/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.696474:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29500 with x1830960573650688 ext(2097152->3145727) 00002000:00010000:3.0:1746140884.696478:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d29500 00000100:00100000:0.0:1746140884.700810:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.701033:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573650816 00000100:00100000:1.0:1746140884.701042:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573650816 00000100:00100000:1.0:1746140884.701111:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16754 00000100:00100000:1.0:1746140884.701120:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32594:x1830960573650816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.701147:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.701166:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a12ff expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.701192:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 29 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.701199:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.701200:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.701203:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 14 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.701229:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 29 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.701240:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 29 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.701251:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576024064:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.701360:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719900 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.706058:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576024064:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.706094:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 14 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.706128:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d12b400, rc 0) 00000100:00100000:1.0:1746140884.706708:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32594:x1830960573650816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5587us (5902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.706717:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16754 00000100:00100000:0.0:1746140884.708334:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.708439:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573650944 00000100:00100000:3.0:1746140884.708447:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573650944 00002000:00100000:3.0:1746140884.708481:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->3522559) req@ffff880130d29c00 x1830960573650944/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.708488:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29c00 with x1830960573650944 ext(3145728->3522559) 00010000:00010000:3.0:1746140884.708495:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 30 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.708504:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 30 pid: 4785 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.708509:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130d29c00 00000100:00100000:3.0:1746140884.708530:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1780 00000100:00100000:3.0:1746140884.708536:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573650944:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140884.714088:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573650944:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5544us (5752us total) trans 17179874070 rc 0/0 00000100:00100000:3.0:1746140884.714100:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1780 00002000:00100000:3.0:1746140884.714120:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->3522559) req@ffff880130d29c00 x1830960573650944/t17179874070(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.714130:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29c00 with x1830960573650944 ext(3145728->3522559) 00010000:00010000:3.0:1746140884.714139:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 32 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.714154:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 32 pid: 4785 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.714161:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130d29c00 00000100:00100000:0.0:1746140884.716885:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.716947:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573651072 00000100:00100000:2.0:1746140884.716956:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573651072 00010000:00010000:2.0:1746140884.716989:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 32 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.717029:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8680 00000100:00100000:2.0:1746140884.717036:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573651072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.717049:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746140884.717064:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140884 -> 1746140885 00002000:00010000:2.0:1746140884.717067:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140884 -> 1746140885 00010000:00010000:2.0:1746140884.717071:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 32 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.717081:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 32 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.717112:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdb9b7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f8 expref: 32 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.717146:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.717148:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.717155:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.717162:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.717198:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.717211:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576024192:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140884.717451:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530900 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.719757:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576024192:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140884.719776:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.719823:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573651072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2786us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.719832:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8680 00000100:00100000:0.0:1746140884.724197:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.724227:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.724367:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573651328 00000100:00100000:3.0:1746140884.724380:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573651328 00000100:00100000:0.0:1746140884.724384:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.724446:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573651456 00000100:00100000:2.0:1746140884.724451:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573651456 00000100:00100000:1.0:1746140884.724474:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573651840 00000100:00100000:1.0:1746140884.724479:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573651840 00002000:00100000:2.0:1746140884.724492:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880130d2a680 x1830960573651456/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.724500:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880130d2aa00 x1830960573651840/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.724502:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2a680 with x1830960573651456 ext(3145728->4194303) 00002000:00010000:2.0:1746140884.724507:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d2a680 00002000:00100000:1.0:1746140884.724507:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2aa00 with x1830960573651840 ext(3145728->4194303) 00002000:00010000:1.0:1746140884.724511:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d2aa00 00000100:00100000:1.0:1746140884.724540:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8586 00000100:00100000:1.0:1746140884.724548:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573651456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.724637:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8587 00000100:00100000:0.0:1746140884.724708:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573651840:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140884.724752:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880130d2a300 x1830960573651328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.724759:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2a300 with x1830960573651328 ext(2097152->3145727) 00002000:00010000:3.0:1746140884.724761:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d2a300 00000100:00100000:3.0:1746140884.724780:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8588 00000100:00100000:3.0:1746140884.724787:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573651328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140884.737488:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573651840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12833us (13093us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.737500:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8587 00002000:00100000:1.0:1746140884.737513:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880130d2aa00 x1830960573651840/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.737523:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2aa00 with x1830960573651840 ext(3145728->4194303) 00002000:00010000:1.0:1746140884.737528:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d2aa00 00000100:00100000:0.0:1746140884.739080:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.740046:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573651968 00000100:00100000:3.0:1746140884.740056:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573651968 00000100:00100000:3.0:1746140884.740116:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10687 00000100:00100000:3.0:1746140884.740123:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+6:32598:x1830960573651968:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140884.740152:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.740169:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9b8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1306 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.740278:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740290:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740301:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740324:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740327:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740331:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740412:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740417:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740420:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140884.740443:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140884.740447:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140884.740460:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740468:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740474:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740478:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740486:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740492:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929fd200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.740495:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740501:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740509:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140884.740511:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.740515:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740519:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fd200/0x8156357b7fdb9b92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740550:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740555:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740559:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740563:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013615f400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.740565:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740569:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740578:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4ae6f00) 00010000:00010000:3.0:1746140884.740579:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.740581:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740585:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9b99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.740608:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b48a0c00/0x8156357b7fdb9b8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.740618:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 7 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.740623:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.740625:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140884.740627:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013615ee00, rc 0) 00000100:00100000:3.0:1746140884.740686:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:32598:x1830960573651968:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 563us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.740692:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10687 00000100:00100000:2.0:1746140884.741551:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573651456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17000us (17318us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.741560:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8586 00002000:00100000:2.0:1746140884.741568:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880130d2a680 x1830960573651456/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.741575:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2a680 with x1830960573651456 ext(3145728->4194303) 00002000:00010000:2.0:1746140884.741579:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d2a680 00000100:00100000:2.0:1746140884.743903:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573651328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19109us (19709us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.743915:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8588 00002000:00100000:2.0:1746140884.743925:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880130d2a300 x1830960573651328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.743933:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2a300 with x1830960573651328 ext(2097152->3145727) 00002000:00010000:2.0:1746140884.743940:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d2a300 00000100:00100000:0.0:1746140884.746669:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.746699:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.746726:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.746755:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.746776:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.746803:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.746827:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573652224 00000100:00100000:0.0:1746140884.746835:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573652224 00000100:00100000:0.0:1746140884.746869:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573652480 00000100:00100000:0.0:1746140884.746872:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573652480 00000100:00100000:0.0:1746140884.746887:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573652736 00000100:00100000:0.0:1746140884.746888:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573652736 00000100:00100000:0.0:1746140884.746896:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573652096 00000100:00100000:0.0:1746140884.746897:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573652096 00000100:00100000:0.0:1746140884.746905:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573652352 00000100:00100000:0.0:1746140884.746906:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573652352 00000100:00100000:0.0:1746140884.746913:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573652608 00000100:00100000:0.0:1746140884.746914:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573652608 00000100:00100000:0.0:1746140884.746925:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16755 00000100:00100000:0.0:1746140884.746932:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573652224:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140884.746950:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.746967:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b49e00/0x8156357b7fdb9ba7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1314 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.747030:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576024320:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140884.747099:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.747131:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16756 00000100:00100000:0.0:1746140884.747137:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573652480:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140884.747146:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.747155:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1322 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.747172:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.747174:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.747181:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.747195:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.747205:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8c8c00, rc 0) 00000100:00100000:1.0:1746140884.747206:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16757 00000100:00100000:1.0:1746140884.747215:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573652736:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140884.747223:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140884.747224:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573652480:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 87us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.747230:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16756 00010000:00010000:1.0:1746140884.747231:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1330 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.747242:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.747244:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.747248:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 9 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140884.747249:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16758 00000100:00100000:0.0:1746140884.747254:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573652096:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140884.747259:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 9 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.747259:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.747264:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a130d expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.747265:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993a00, rc 0) 00010000:00010000:0.0:1746140884.747273:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.747275:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.747278:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140884.747283:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573652736:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 70us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.747287:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16757 00010000:00010000:0.0:1746140884.747287:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140884.747298:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16759 00010000:00010000:0.0:1746140884.747298:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009272ce00, rc 0) 00000100:00100000:1.0:1746140884.747321:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573652352:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140884.747327:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140884.747329:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573652096:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 76us (573us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140884.747333:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9bc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a131b expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.747334:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16758 00000100:00100000:0.0:1746140884.747343:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16760 00000100:00100000:0.0:1746140884.747347:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573652608:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140884.747352:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140884.747354:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576024448:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140884.747357:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1329 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.747365:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.747366:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.747370:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.747378:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.747384:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009272c200, rc 0) 00000100:00100000:0.0:1746140884.747397:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573652608:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 50us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.747402:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16760 00000100:00100000:1.0:1746140884.747479:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719900 going to sleep for 11 seconds 00002000:00010000:1.0:1746140884.751294:0:8459:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime: 1746140884 -> 1746140885 00002000:00010000:1.0:1746140884.751333:0:8459:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140884 -> 1746140885 00002000:00010000:1.0:1746140884.751335:0:8459:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime: 1746140884 -> 1746140885 00000100:00100000:1.0:1746140884.751358:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576024448:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140884.751359:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576024320:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140884.751386:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b49e00/0x8156357b7fdb9ba7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1314 expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.751386:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9bc3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a131b expref: 9 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.751399:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b49e00/0x8156357b7fdb9ba7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1314 expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.751399:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9bc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a131b expref: 9 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.751422:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993800, rc 0) 00000100:00100000:1.0:1746140884.751468:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573652352:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4164us (4690us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140884.751476:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16759 00010000:00010000:2.0:1746140884.751936:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b49e00, rc 0) 00000100:00100000:2.0:1746140884.751969:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573652224:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5037us (5309us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140884.751974:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16755 00000100:00100000:0.0:1746140884.756028:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.756093:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.756120:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573653120 00000100:00100000:2.0:1746140884.756130:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573653120 00000100:00100000:3.0:1746140884.756152:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573653248 00000100:00100000:3.0:1746140884.756156:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573653248 00002000:00100000:2.0:1746140884.756171:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f780380 x1830960573653120/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.756181:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f780380 with x1830960573653120 ext(4194304->4886527) 00002000:00010000:2.0:1746140884.756187:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f780380 00000100:00100000:3.0:1746140884.756192:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10688 00000100:00100000:3.0:1746140884.756199:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:32598:x1830960573653248:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746140884.756201:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8589 00000100:00100000:2.0:1746140884.756206:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573653120:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746140884.756213:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.756231:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f600/0x8156357b7fdb9bd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1337 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.756301:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.756346:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.756353:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.756359:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.756386:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.756395:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 8 pid: 27790 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.756404:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576024576:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.756549:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.756557:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 8 pid: 14742 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.756564:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576024704:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.756585:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.760389:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.760416:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.760470:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573653504 00000100:00100000:0.0:1746140884.760478:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573653504 00010000:00010000:0.0:1746140884.760513:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 9 pid: 27790 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.760536:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573653376 00000100:00100000:0.0:1746140884.760538:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573653376 00010000:00010000:0.0:1746140884.760547:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 9 pid: 14742 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.760561:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8681 00000100:00100000:3.0:1746140884.760564:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576024576:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140884.760567:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573653504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140884.760576:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576024704:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140884.760579:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.760584:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 9 pid: 27790 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.760593:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 9 pid: 27790 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.760611:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9ba0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1306 expref: 9 pid: 27790 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.760635:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.760639:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.760646:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.760651:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.760684:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573653504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.760690:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8681 00000100:00100000:0.0:1746140884.760704:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8682 00000100:00100000:0.0:1746140884.760708:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573653376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.760713:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.760716:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 9 pid: 14742 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.760723:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 9 pid: 14742 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.760732:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930e8200/0x8156357b7fdb9b29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12a4 expref: 9 pid: 14742 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.760739:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.760741:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.760746:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.760752:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.760763:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.760764:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140884.760773:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140884.760776:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573653376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (359us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140884.760778:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140884.760780:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8682 00000004:00200000:3.0:1746140884.760795:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140884.760912:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f600/0x8156357b7fdb9bd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1337 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.761003:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1337 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.761010:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.761013:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746140884.761015:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013615f400, rc 0) 00000100:00100000:3.0:1746140884.761039:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:32598:x1830960573653248:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4840us (4945us total) trans 8589944981 rc 0/0 00000100:00100000:3.0:1746140884.761045:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10688 00000100:00100000:2.0:1746140884.762294:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573653120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6082us (6266us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140884.762327:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8589 00002000:00100000:2.0:1746140884.762337:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f780380 x1830960573653120/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.762345:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f780380 with x1830960573653120 ext(4194304->4886527) 00002000:00010000:2.0:1746140884.762349:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f780380 00000100:00100000:1.0:1746140884.763295:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.763358:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573653760 00000100:00100000:3.0:1746140884.763365:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573653760 00000100:00100000:3.0:1746140884.763399:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10689 00000100:00100000:3.0:1746140884.763405:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:32598:x1830960573653760:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140884.763427:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.763431:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746140884.763450:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f400/0x8156357b7fdb9bd8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1337 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.763462:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.763466:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140884.763476:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9be6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a133e expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.763549:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.763561:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.763570:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140884.763579:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140884.763664:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d12ba00/0x8156357b7fdb9be6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.763674:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.763679:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.763681:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140884.763683:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013615f800, rc 0) 00000100:00100000:3.0:1746140884.763722:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:32598:x1830960573653760:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 317us (429us total) trans 8589944982 rc 0/0 00000100:00100000:3.0:1746140884.763728:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10689 00000100:00100000:0.0:1746140884.767158:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.767256:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573653888 00000100:00100000:3.0:1746140884.767266:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573653888 00000100:00100000:3.0:1746140884.767330:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10690 00000100:00100000:3.0:1746140884.767338:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:32598:x1830960573653888:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140884.767362:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.767380:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9bfb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1345 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.767724:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9bfb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1345 expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.767737:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9bfb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1345 expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.767755:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.767757:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140884.767761:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013615ee00, rc 0) 00000100:00100000:3.0:1746140884.767814:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:32598:x1830960573653888:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 477us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.767820:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10690 00000100:00100000:0.0:1746140884.774352:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.774404:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.774429:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.774443:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.774453:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.774463:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.774481:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.774549:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573654144 00000100:00100000:2.0:1746140884.774558:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573654144 00000100:00100000:1.0:1746140884.774559:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573654272 00000100:00100000:1.0:1746140884.774563:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573654272 00000100:00100000:1.0:1746140884.774590:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573654528 00000100:00100000:2.0:1746140884.774592:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4683 00000100:00100000:1.0:1746140884.774592:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573654528 00000100:00100000:2.0:1746140884.774598:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32594:x1830960573654144:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140884.774603:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573654784 00000100:00100000:1.0:1746140884.774604:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573654784 00000100:00100000:1.0:1746140884.774613:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573654400 00000100:00100000:1.0:1746140884.774614:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573654400 00000100:00100000:1.0:1746140884.774622:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573654656 00000100:00100000:1.0:1746140884.774623:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573654656 00000100:00100000:1.0:1746140884.774631:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573654912 00000100:00100000:1.0:1746140884.774632:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573654912 00000100:00100000:1.0:1746140884.774644:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16761 00000100:00100000:1.0:1746140884.774648:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573654272:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140884.774678:0:8459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.774693:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.774700:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.774706:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.774712:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.774713:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.774716:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.774745:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.774756:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 19 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.774768:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576024832:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.774774:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32594:x1830960573654144:12345-192.168.204.16@tcp:35:cat.0 Request processed in 175us (430us total) trans 8589944983 rc 0/0 00000100:00100000:2.0:1746140884.774780:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4683 00000100:00100000:2.0:1746140884.774800:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16762 00000100:00100000:2.0:1746140884.774804:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573654528:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140884.774821:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.774823:0:4186:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.774832:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.774833:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 13 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.774839:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746140884.774839:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576024960:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.774840:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140884.774842:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.774856:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 13 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.774859:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.774862:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 13 pid: 8460 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.774866:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 23 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:2.0:1746140884.774870:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576025088:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.774873:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576025216:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.774887:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719900 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.774891:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530900 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.774906:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16763 00000100:00100000:1.0:1746140884.774911:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573654784:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140884.774926:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.774936:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.774942:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.774947:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.774949:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.774950:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.774962:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.774968:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.774974:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576025344:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.775002:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16764 00010000:00010000:1.0:1746140884.775003:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.775007:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573654400:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140884.775010:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.775016:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576025472:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.775020:0:8460:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.775029:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.775038:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140884.775040:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140884.775041:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.775042:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746140884.775053:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.775059:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 13 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.775065:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576025600:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.775080:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.775111:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16765 00000100:00100000:3.0:1746140884.775119:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573654656:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140884.775138:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.775152:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.775163:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140884.775167:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16766 00010000:00010000:3.0:1746140884.775169:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140884.775174:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573654912:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140884.775175:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.775176:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.775177:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.775188:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.775193:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.775197:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.775200:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 19 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.775203:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 8 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140884.775207:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576025728:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140884.775208:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.775208:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.775210:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.775223:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 8 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.775229:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 8 pid: 8459 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.775235:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 10 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140884.775240:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576025856:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.775248:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.775254:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576025984:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140884.775262:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.775268:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 13 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.775274:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576026112:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.775275:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.775281:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.775285:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.775288:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576026240:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.775301:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.786842:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.786870:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.786891:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.786953:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573655040 00000100:00100000:3.0:1746140884.786964:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573655040 00010000:00010000:3.0:1746140884.787002:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 20 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.787038:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573655296 00000100:00100000:3.0:1746140884.787041:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573655296 00010000:00010000:3.0:1746140884.787051:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 24 pid: 12255 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.787063:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573655168 00000100:00100000:3.0:1746140884.787065:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573655168 00010000:00010000:3.0:1746140884.787073:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 11 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.787086:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8683 00000100:00100000:3.0:1746140884.787093:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573655040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.787115:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.787134:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 20 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.787144:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 20 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.787168:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.787175:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8684 00000100:00100000:2.0:1746140884.787187:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1983:x1830960573655296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.787201:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140884.787204:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8685 00000100:00100000:3.0:1746140884.787212:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573655040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.787214:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573655168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140884.787219:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8683 00010000:00010000:2.0:1746140884.787222:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 24 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.787222:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.787232:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 11 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.787235:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 24 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.787252:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 11 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:3.0:1746140884.787263:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576025728:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.787275:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.787330:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573655168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.787336:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8685 00000100:00100000:3.0:1746140884.787346:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576025984:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.787375:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576025344:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.787384:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576025472:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.787405:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.787428:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c438000/0x8156357b7fdb9b3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12b2 expref: 19 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.787445:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576024832:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.787453:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009272ce00/0x8156357b7fdb9bbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a130d expref: 10 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.787460:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576024960:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140884.787469:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576026240:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.787470:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576025216:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.787484:0:8459:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.787492:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.787563:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576025600:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.787576:0:8460:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.787601:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576025088:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.787613:0:4186:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.787847:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576025856:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.787907:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576026112:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.787923:0:32377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.788180:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db8ba00/0x8156357b7fdb9a81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1249 expref: 24 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.788204:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.788205:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.788209:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.788217:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.788243:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.788277:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1983:x1830960573655296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1094us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.788284:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8684 00010000:00010000:1.0:1746140884.788510:0:8459:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.788518:0:8459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.788540:0:8459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.788547:0:8459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.788554:0:8459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.788560:0:8459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a37000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140884.788563:0:8459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.788571:0:8459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.788580:0:8459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.788585:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37000/0x8156357b7fdb9c02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.788625:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573654272:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13976us (14219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.788633:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16761 00000100:00100000:0.0:1746140884.791702:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.791752:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.791829:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573655424 00000100:00100000:1.0:1746140884.791838:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573655424 00010000:00010000:1.0:1746140884.791879:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 9 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:1.0:1746140884.791902:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573656320 00000100:00100000:1.0:1746140884.791904:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573656320 00010000:00010000:1.0:1746140884.791913:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.791927:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8686 00000100:00100000:1.0:1746140884.791933:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573655424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.791945:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.791968:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 9 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.791980:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 9 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.792000:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009272c200/0x8156357b7fdb9bca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1329 expref: 9 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:1.0:1746140884.792014:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.792054:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573655424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.792061:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8686 00000100:00100000:1.0:1746140884.792116:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8687 00000100:00100000:1.0:1746140884.792121:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573656320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.792126:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.792134:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.792142:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.792152:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x8156357b7fdb9b76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12f1 expref: 19 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.792159:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.792161:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.792165:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792173:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792193:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.792206:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573656320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.792211:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8687 00010000:00010000:1.0:1746140884.792228:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792235:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792254:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792261:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792268:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792275:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a37a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140884.792278:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792290:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792299:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.792326:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x8156357b7fdb9c10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.792366:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573654784:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 17455us (17920us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.792374:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16763 00000100:00100000:1.0:1746140884.792752:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.792773:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573655552 00000100:00100000:2.0:1746140884.792778:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573655552 00002000:00100000:2.0:1746140884.792807:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1228799) req@ffff88009f729c00 x1830960573655552/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.792816:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729c00 with x1830960573655552 ext(1048576->1228799) 00010000:00010000:2.0:1746140884.792824:0:21640:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 14 pid: 8460 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.792874:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.793040:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140884.793067:0:21640:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 14 pid: 8460 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.793073:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f729c00 00000100:00100000:2.0:1746140884.793089:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1781 00000100:00100000:2.0:1746140884.793095:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960573655552:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140884.795627:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.795798:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.795818:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.795858:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573656448 00000100:00100000:3.0:1746140884.795867:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573656448 00000100:00100000:2.0:1746140884.795880:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573656576 00000100:00100000:2.0:1746140884.795884:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573656576 00010000:00010000:3.0:1746140884.795898:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 963 lvb_type: 1 00002000:00100000:2.0:1746140884.795908:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a7:0x0] (1409024->2097151) req@ffff88009f729f80 x1830960573656576/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.795922:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729f80 with x1830960573656576 ext(1409024->2097151) 00000100:00100000:3.0:1746140884.795928:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573656064 00000100:00100000:3.0:1746140884.795930:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573656064 00010000:00010000:2.0:1746140884.795932:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 16 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.795939:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 9 pid: 8459 timeout: 963 lvb_type: 1 00010000:00010000:2.0:1746140884.795943:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 16 pid: 4785 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.795949:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f729f80 00000100:00100000:3.0:1746140884.795952:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8688 00000100:00100000:3.0:1746140884.795957:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1982:x1830960573656448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.795969:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140884.795979:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1782 00000100:00100000:2.0:1746140884.795983:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573656576:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746140884.795991:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.796000:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.796019:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9a96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a125e expref: 23 pid: 12255 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.796037:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.796070:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573656448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.796076:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8688 00000100:00100000:3.0:1746140884.796090:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8689 00000100:00100000:3.0:1746140884.796095:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573656064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.796112:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.796123:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 9 pid: 8459 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.796131:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 9 pid: 8459 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.796144:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9bb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1330 expref: 9 pid: 8459 timeout: 963 lvb_type: 1 00010000:00010000:3.0:1746140884.796159:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.796171:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573656064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.796176:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8689 00000100:00100000:3.0:1746140884.796192:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573655808 00000100:00100000:3.0:1746140884.796194:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573655808 00000100:00100000:3.0:1746140884.796214:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10691 00000100:00100000:3.0:1746140884.796218:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32601:x1830960573655808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.796231:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.796244:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb9c2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a134c expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.796360:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796372:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796381:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796391:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796397:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796402:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796500:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796507:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796513:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140884.796522:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140884.796596:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796602:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796607:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796612:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f63fa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.796616:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796622:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796630:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.796632:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140884.796637:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796641:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fa00/0x8156357b7fdb9c41 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796655:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796659:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796663:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796666:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f63e000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.796668:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796672:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796676:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140884.796677:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.796679:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796682:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63e000/0x8156357b7fdb9c33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796688:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796692:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796696:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796699:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f63fe00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.796701:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796706:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796710:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4ae6f00) 00010000:00010000:3.0:1746140884.796712:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.796713:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796717:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9c3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.796748:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb9c2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a134c expref: 272 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.796755:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f63fc00/0x8156357b7fdb9c2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a134c expref: 272 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.796761:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63fc00, rc 0) 00000100:00100000:3.0:1746140884.796783:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32601:x1830960573655808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 564us (3743us total) trans 8589944984 rc 301/301 00000100:00100000:3.0:1746140884.796788:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10691 00000100:00100000:0.0:1746140884.797450:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573655936 00000100:00100000:0.0:1746140884.797456:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573655936 00010000:00010000:0.0:1746140884.797479:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 18 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.797504:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8690 00000100:00100000:0.0:1746140884.797510:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573655936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.797519:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.797536:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 18 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.797545:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 18 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.797558:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c439a00/0x8156357b7fdb9b5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12c7 expref: 18 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.797571:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.797590:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573655936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.797595:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8690 00000100:00100000:1.0:1746140884.797701:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.797734:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573656192 00000100:00100000:0.0:1746140884.797738:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573656192 00000100:00100000:1.0:1746140884.797748:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140884.797749:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 7 pid: 8458 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.797762:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573656704 00000100:00100000:0.0:1746140884.797764:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573656704 00010000:00010000:0.0:1746140884.797772:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 18 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.797778:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8691 00000100:00100000:1.0:1746140884.797785:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960573656192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.797792:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140884.797794:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8692 00000100:00100000:0.0:1746140884.797798:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573656704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.797799:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 7 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.797804:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.797812:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 7 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.797812:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 18 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.797823:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c8c00/0x8156357b7fdb9bae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1322 expref: 7 pid: 8458 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.797824:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 18 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.797832:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.797834:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.797834:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d12b400/0x8156357b7fdb9b84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ff expref: 18 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:1.0:1746140884.797838:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.797841:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.797843:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.797845:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.797845:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.797851:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.797863:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140884.797863:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.797882:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573656704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.797887:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8692 00000100:00100000:1.0:1746140884.797958:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+6:1985:x1830960573656192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 173us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.797964:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8691 00010000:00010000:1.0:1746140884.797981:0:32377:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.797988:0:32377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798006:0:32377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798017:0:32377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798024:0:32377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798029:0:32377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009272de00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140884.798032:0:32377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798037:0:32377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798048:0:32377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798053:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009272de00/0x8156357b7fdb9c25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.798097:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573654912:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 22924us (23614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.798113:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16766 00010000:00010000:1.0:1746140884.798132:0:4784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798139:0:4784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798155:0:4784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798160:0:4784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798165:0:4784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798169:0:4784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013615f600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140884.798171:0:4784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798176:0:4784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798182:0:4784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.798187:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013615f600/0x8156357b7fdb9c1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.798228:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960573654656:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 23110us (23763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.798233:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16765 00000100:00100000:3.0:1746140884.799341:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573655552:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6210us (6552us total) trans 17179874071 rc 0/0 00000100:00100000:3.0:1746140884.799349:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1781 00002000:00100000:3.0:1746140884.799359:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1228799) req@ffff88009f729c00 x1830960573655552/t17179874071(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.799375:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729c00 with x1830960573655552 ext(1048576->1228799) 00010000:00010000:3.0:1746140884.799387:0:21640:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 17 pid: 8460 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.799400:0:21640:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 17 pid: 8460 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.799406:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f729c00 00000100:00100000:1.0:1746140884.800235:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.800603:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573656832 00000100:00100000:0.0:1746140884.800611:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573656832 00000100:00100000:0.0:1746140884.801096:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10692 00000100:00100000:0.0:1746140884.801115:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32601:x1830960573656832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140884.801133:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.801151:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992600/0x8156357b7fdb9c4f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1353 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.801280:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.801291:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.801300:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140884.802478:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140884.802483:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140884.802499:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.802528:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992600/0x8156357b7fdb9c4f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 273 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.802543:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 272 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.802551:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.802555:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140884.802558:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993200, rc 0) 00000100:00100000:0.0:1746140884.802613:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32601:x1830960573656832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1509us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.802621:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10692 00000100:00100000:3.0:1746140884.808634:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573656576:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12634us (12820us total) trans 17179874072 rc 0/0 00000100:00100000:3.0:1746140884.808648:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1782 00002000:00100000:3.0:1746140884.808665:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1409024->2097151) req@ffff88009f729f80 x1830960573656576/t17179874072(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.808676:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729f80 with x1830960573656576 ext(1409024->2097151) 00010000:00010000:3.0:1746140884.808742:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 17 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.808760:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 17 pid: 4785 timeout: 963 lvb_type: 0 00002000:00010000:3.0:1746140884.812409:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f729f80 00000100:00100000:0.0:1746140884.815189:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.815214:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573657216 00000100:00100000:0.0:1746140884.815222:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573657216 00000100:00100000:0.0:1746140884.815271:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10693 00000100:00100000:0.0:1746140884.815278:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32604:x1830960573657216:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140884.815299:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.815329:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993000/0x8156357b7fdb9c5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a135a expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.815435:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.815447:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.815456:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.815466:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.815471:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.815475:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:1.0:1746140884.816552:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.816935:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.816971:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573656960 00000100:00100000:3.0:1746140884.816978:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573656960 00010000:00010000:3.0:1746140884.817006:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 17 pid: 8460 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.817033:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8693 00000100:00100000:3.0:1746140884.817037:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573656960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.817047:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.817065:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 17 pid: 8460 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.817075:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 17 pid: 8460 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.817093:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff15200/0x8156357b7fdb9b6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ea expref: 17 pid: 8460 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.817114:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.817116:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.817120:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.817127:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.817149:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.817187:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1982:x1830960573656960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 147us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.817193:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8693 00000100:00100000:2.0:1746140884.817254:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140884.817269:0:4186:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.817273:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573657344 00000100:00100000:2.0:1746140884.817276:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573657344 00010000:00010000:1.0:1746140884.817276:0:4186:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.817295:0:4186:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.817299:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16767 00010000:00010000:1.0:1746140884.817301:0:4186:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.817320:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573657344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.817323:0:4186:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.817328:0:4186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a68ee00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140884.817332:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.817332:0:4186:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.817340:0:4186:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.817348:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1361 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.817350:0:4186:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.817356:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a68ee00/0x8156357b7fdb9c09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140884.817365:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fed4, atime: 0x6813fed4, ctime: 0x6813fed4, blocks: 0x821 00010000:00010000:2.0:1746140884.817377:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.817379:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.817384:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 23 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.817397:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 23 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140884.817397:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573654528:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 42591us (42966us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.817403:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16762 00010000:00010000:2.0:1746140884.817406:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42a00, rc 0) 00000100:00100000:2.0:1746140884.817424:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573657344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 120us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.817429:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16767 00000100:00100000:2.0:1746140884.817458:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.817468:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573657600 00000100:00100000:2.0:1746140884.817470:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573657600 00000100:00100000:2.0:1746140884.817492:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16768 00000100:00100000:2.0:1746140884.817496:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573657600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.817503:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.817510:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a136f expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140884.817519:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fed5, atime: 0x6813fed4, ctime: 0x6813fed5, blocks: 0x821 00000100:00100000:1.0:1746140884.817526:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140884.817527:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.817528:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.817532:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 32 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140884.817537:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573657856 00010000:00010000:2.0:1746140884.817540:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 32 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140884.817540:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573657856 00010000:00010000:2.0:1746140884.817551:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43a00, rc 0) 00000100:00100000:1.0:1746140884.817557:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16769 00000100:00100000:1.0:1746140884.817562:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573657856:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140884.817566:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573657600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 69us (106us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140884.817568:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140884.817571:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16768 00010000:00010000:1.0:1746140884.817577:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a137d expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140884.817590:0:32377:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fed5, atime: 0x6813fed4, ctime: 0x6813fed5, blocks: 0x1589 00000100:00100000:2.0:1746140884.817596:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140884.817598:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.817599:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.817603:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 24 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140884.817606:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573657472 00000100:00100000:2.0:1746140884.817609:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573657472 00010000:00010000:1.0:1746140884.817613:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 24 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.817619:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5216c00, rc 0) 00000100:00100000:2.0:1746140884.817622:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16770 00000100:00100000:2.0:1746140884.817626:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573657472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.817631:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140884.817636:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573657856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 74us (110us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140884.817638:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed43200/0x8156357b7fdb9c87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1368 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.817641:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16769 00000100:00100000:1.0:1746140884.817667:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.817669:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576026368:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140884.817677:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573657728 00000100:00100000:1.0:1746140884.817679:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573657728 00000100:00100000:1.0:1746140884.817692:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16771 00000100:00100000:1.0:1746140884.817696:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573657728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.817702:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.817709:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1376 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.817716:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530e40 going to sleep for 11 seconds 00002000:00010000:1.0:1746140884.817718:0:4186:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed3, atime: 0x6813fed3, ctime: 0x6813fed3, blocks: 0x821 00010000:00010000:1.0:1746140884.817726:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.817727:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.817730:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 25 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.817738:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 25 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.817744:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5217600, rc 0) 00000100:00100000:1.0:1746140884.817759:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573657728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 62us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.817763:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.817764:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16771 00000100:00100000:1.0:1746140884.817771:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573657984 00000100:00100000:1.0:1746140884.817773:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573657984 00000100:00100000:1.0:1746140884.817791:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16772 00000100:00100000:1.0:1746140884.817796:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573657984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.817801:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.817809:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1384 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140884.817820:0:4186:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fed5, atime: 0x6813fed4, ctime: 0x6813fed5, blocks: 0x1029 00010000:00010000:1.0:1746140884.817828:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.817829:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.817833:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.817841:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.817847:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c85400, rc 0) 00000100:00100000:1.0:1746140884.817865:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573657984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 69us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.817871:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16772 00000100:00100000:3.0:1746140884.817933:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573658240 00000100:00100000:3.0:1746140884.817936:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573658240 00000100:00100000:3.0:1746140884.817965:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10694 00000100:00100000:3.0:1746140884.817970:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32606:x1830960573658240:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140884.817979:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.817988:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f000/0x8156357b7fdb9c9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a138b expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.818072:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.818088:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.818095:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.818113:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.818121:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.818126:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.818127:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.818137:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.818142:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.818160:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.818169:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 9 pid: 27790 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.818180:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576026496:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140884.818182:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.818188:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.818192:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140884.818218:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.818329:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.818498:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573658368 00000100:00100000:3.0:1746140884.818501:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573658368 00010000:00010000:3.0:1746140884.818514:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 16 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:3.0:1746140884.818529:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8694 00000100:00100000:3.0:1746140884.818533:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573658368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.818539:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.818549:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 16 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.818556:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 16 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:3.0:1746140884.818567:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.818568:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.818571:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.818577:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.818601:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.818619:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573658368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.818625:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8694 00010000:00010000:1.0:1746140884.818668:0:8460:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.818675:0:8460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.818689:0:8460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.818695:0:8460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.818707:0:8460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.818712:0:8460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800934e0800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140884.818715:0:8460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.818722:0:8460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.818732:0:8460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.818738:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800934e0800/0x8156357b7fdb9c17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.818765:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960573654400:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 43759us (44311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.818771:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16764 00010000:00010000:2.0:1746140884.820985:0:4784:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff88009eea9c00 x1830960576026368) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 15 pid: 4785 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.821016:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092994800/0x8156357b7fdb9b30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a12ab expref: 15 pid: 4785 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.821032:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576026368:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140884.821061:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43200/0x8156357b7fdb9c87 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1368 expref: 34 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.821072:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43200/0x8156357b7fdb9c87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1368 expref: 34 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.821085:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43200, rc 0) 00000100:00100000:2.0:1746140884.821143:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573657472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3515us (3545us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140884.821146:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576026496:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.821150:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16770 00010000:00010000:1.0:1746140884.821162:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140884.821511:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.821619:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573658496 00000100:00100000:0.0:1746140884.821626:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573658496 00010000:00010000:0.0:1746140884.821648:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 10 pid: 27790 timeout: 963 lvb_type: 0 00000100:00100000:0.0:1746140884.821678:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8695 00000100:00100000:0.0:1746140884.821685:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573658496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.821698:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.821703:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 10 pid: 27790 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.821712:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 10 pid: 27790 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.821785:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140884.821834:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615f800/0x8156357b7fdb9bed lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a133e expref: 10 pid: 27790 timeout: 963 lvb_type: 0 00010000:00010000:0.0:1746140884.821844:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.821849:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.821858:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.821864:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.821871:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.821876:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.821881:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.821990:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.822011:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573658496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 327us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.822017:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8695 00000100:00100000:3.0:1746140884.822032:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573658752 00000100:00100000:3.0:1746140884.822043:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573658752 00010000:00010000:1.0:1746140884.822045:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.822056:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140884.822072:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140884.822076:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.822084:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:2.0:1746140884.822093:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:3.0:1746140884.822096:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10695 00000100:00100000:3.0:1746140884.822120:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:32598:x1830960573658752:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:3.0:1746140884.822156:0:14743:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.822175:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013615ee00/0x8156357b7fdb9bfb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1345 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.822188:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.822191:0:14743:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.822240:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:32598:x1830960573658752:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 123us (456us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746140884.822245:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10695 00010000:00010000:2.0:1746140884.822252:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.822259:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.822265:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822265:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.822272:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.822276:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822281:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f19f600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.822281:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c993400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140884.822285:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822285:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822290:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822290:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.822298:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.822300:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140884.822331:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822333:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.822336:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140884.822336:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993400/0x8156357b7fdb9cb1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822339:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.822344:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9cb8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822350:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.822355:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822359:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822359:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822364:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.822368:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822368:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c992c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.822370:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822371:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f19f200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140884.822373:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822374:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822377:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822380:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140884.822382:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140884.822384:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822385:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140884.822387:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140884.822388:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992c00/0x8156357b7fdb9c64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822389:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.822392:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9ca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822395:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.822399:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822403:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822403:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822408:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140884.822412:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822412:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c992a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140884.822414:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822416:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f19f400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140884.822417:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822418:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822421:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822422:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293f00) 00010000:00010000:1.0:1746140884.822424:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140884.822427:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822428:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293f00) 00010000:00010000:2.0:1746140884.822430:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140884.822431:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822431:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c992a00/0x8156357b7fdb9c6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.822435:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f400/0x8156357b7fdb9caa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140884.822460:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993000/0x8156357b7fdb9c5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a135a expref: 11 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.822461:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f000/0x8156357b7fdb9c9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a138b expref: 274 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.822466:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993000/0x8156357b7fdb9c5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a135a expref: 11 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.822468:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f000/0x8156357b7fdb9c9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a138b expref: 274 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.822473:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19f000, rc 0) 00010000:00010000:1.0:1746140884.822473:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993000, rc 0) 00000100:00100000:2.0:1746140884.822509:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:32606:x1830960573658240:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4538us (5574us total) trans 8589944985 rc 301/301 00000100:00100000:1.0:1746140884.822509:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32604:x1830960573657216:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7232us (7331us total) trans 8589944986 rc 301/301 00000100:00100000:1.0:1746140884.822515:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10693 00000100:00100000:2.0:1746140884.822518:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10694 00000100:00100000:0.0:1746140884.823524:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.823585:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573659008 00000100:00100000:2.0:1746140884.823592:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573659008 00000100:00100000:2.0:1746140884.823632:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4684 00000100:00100000:2.0:1746140884.823637:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32598:x1830960573659008:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140884.823760:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:32598:x1830960573659008:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 122us (238us total) trans 8589944987 rc 0/0 00000100:00100000:2.0:1746140884.823766:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4684 00000100:00100000:3.0:1746140884.826090:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.826292:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573659136 00000100:00100000:0.0:1746140884.826302:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573659136 00000100:00100000:0.0:1746140884.826391:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16773 00000100:00100000:0.0:1746140884.826401:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32604:x1830960573659136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140884.826420:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.826442:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1392 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.826477:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 24 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.826485:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.826488:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.826491:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2699264->2748415] (req 2699264->2748415) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.826533:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 24 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.826548:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 24 pid: 32377 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.826562:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576026624:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140884.826662:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.826851:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.827028:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.827118:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573659648 00000100:00100000:2.0:1746140884.827123:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573659648 00000100:00100000:2.0:1746140884.827157:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4685 00000100:00100000:2.0:1746140884.827165:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:32598:x1830960573659648:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140884.827412:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:32598:x1830960573659648:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 248us (385us total) trans 8589944988 rc 0/0 00000100:00100000:2.0:1746140884.827420:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4685 00000100:00100000:2.0:1746140884.827444:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573659392 00000100:00100000:2.0:1746140884.827447:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573659392 00002000:00100000:2.0:1746140884.827473:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f122a00 x1830960573659392/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.827483:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f122a00 with x1830960573659392 ext(0->1048575) 00002000:00010000:2.0:1746140884.827488:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f122a00 00000100:00100000:2.0:1746140884.827507:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8590 00000100:00100000:2.0:1746140884.827515:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573659392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.828431:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576026624:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140884.828459:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2699264->2748415] (req 2699264->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 18 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.828475:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c992e00, rc 0) 00000100:00100000:0.0:1746140884.828498:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32604:x1830960573659136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2099us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.828505:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16773 00000100:00100000:1.0:1746140884.828512:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.828531:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573659776 00000100:00100000:0.0:1746140884.828535:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573659776 00010000:00010000:0.0:1746140884.828550:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 26 pid: 32377 timeout: 963 lvb_type: 1 00000100:00100000:0.0:1746140884.828577:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8696 00000100:00100000:0.0:1746140884.828582:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573659776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140884.828592:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140884.828610:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 26 pid: 32377 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.828622:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 26 pid: 32377 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.828639:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216c00/0x8156357b7fdb9c80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a137d expref: 26 pid: 32377 timeout: 963 lvb_type: 1 00010000:00010000:0.0:1746140884.828650:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.828652:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.828657:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.828665:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.828689:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.828700:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576026752:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140884.828739:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.833163:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576026752:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140884.833188:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140884.833232:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573659776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4644us (4717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.833243:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8696 00000100:00100000:0.0:1746140884.839930:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.840564:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573660032 00000100:00100000:3.0:1746140884.840575:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573660032 00002000:00100000:3.0:1746140884.840629:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (2699264->2703359) req@ffff88009f782a00 x1830960573660032/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.840641:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f782a00 with x1830960573660032 ext(2699264->2703359) 00002000:00010000:3.0:1746140884.840647:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f782a00 00000100:00100000:3.0:1746140884.840675:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8591 00000100:00100000:3.0:1746140884.840684:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573660032:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140884.840922:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573660032:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 237us (1007us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140884.840929:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8591 00002000:00100000:3.0:1746140884.840939:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (2699264->2703359) req@ffff88009f782a00 x1830960573660032/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.840946:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f782a00 with x1830960573660032 ext(2699264->2703359) 00002000:00010000:3.0:1746140884.840948:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f782a00 00000100:00100000:2.0:1746140884.842934:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573659392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15412us (16077us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.842946:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8590 00002000:00100000:2.0:1746140884.842954:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f122a00 x1830960573659392/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.842962:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f122a00 with x1830960573659392 ext(0->1048575) 00002000:00010000:2.0:1746140884.842967:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f122a00 00000100:00100000:0.0:1746140884.844195:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.844335:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573660288 00000100:00100000:2.0:1746140884.844342:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573660288 00002000:00100000:2.0:1746140884.844374:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2744320->2748415) req@ffff88009f782680 x1830960573660288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.844382:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f782680 with x1830960573660288 ext(2744320->2748415) 00002000:00010000:2.0:1746140884.844385:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f782680 00000100:00100000:2.0:1746140884.844400:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8592 00000100:00100000:2.0:1746140884.844405:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573660288:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140884.844556:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573660288:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 150us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140884.844561:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8592 00002000:00100000:2.0:1746140884.844566:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2744320->2748415) req@ffff88009f782680 x1830960573660288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.844573:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f782680 with x1830960573660288 ext(2744320->2748415) 00002000:00010000:2.0:1746140884.844575:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f782680 00000100:00100000:0.0:1746140884.850300:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.850498:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.850608:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573660544 00000100:00100000:1.0:1746140884.850608:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573660672 00000100:00100000:2.0:1746140884.850616:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573660544 00000100:00100000:1.0:1746140884.850616:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573660672 00000100:00100000:1.0:1746140884.850658:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16774 00000100:00100000:1.0:1746140884.850665:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:32601:x1830960573660672:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140884.850673:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4686 00000100:00100000:2.0:1746140884.850678:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32604:x1830960573660544:12345-192.168.204.16@tcp:35:multiop.0 00010000:00010000:1.0:1746140884.850687:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.850705:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1399 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140884.850730:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed5, atime: 0x6813fed5, ctime: 0x6813fed5, blocks: 0x821 00010000:00010000:1.0:1746140884.850748:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.850750:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.850757:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 34 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.850772:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 34 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.850783:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36a00, rc 0) 00000100:00100000:1.0:1746140884.850833:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:32601:x1830960573660672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 169us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.850839:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16774 00000100:00100000:2.0:1746140884.851374:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32604:x1830960573660544:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 694us (1087us total) trans 8589944989 rc 0/0 00000100:00100000:2.0:1746140884.851380:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4686 00000100:00100000:0.0:1746140884.859025:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.859162:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.859262:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.859481:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573660928 00000100:00100000:3.0:1746140884.859490:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573660928 00002000:00100000:3.0:1746140884.859534:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f783800 x1830960573660928/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.859544:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f783800 with x1830960573660928 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.859550:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f783800 00000100:00100000:3.0:1746140884.859565:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573661184 00000100:00100000:3.0:1746140884.859568:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573661184 00002000:00100000:3.0:1746140884.859579:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f3c0000 x1830960573661184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.859585:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0000 with x1830960573661184 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.859588:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c0000 00000100:00100000:3.0:1746140884.859596:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573661440 00000100:00100000:3.0:1746140884.859599:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573661440 00002000:00100000:3.0:1746140884.859611:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f3c0380 x1830960573661440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.859617:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0380 with x1830960573661440 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.859620:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c0380 00000100:00100000:3.0:1746140884.860254:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8593 00000100:00100000:2.0:1746140884.860262:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8594 00000100:00100000:3.0:1746140884.860263:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573660928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.860271:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573661184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.861401:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8595 00000100:00100000:0.0:1746140884.861414:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573661440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140884.862438:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.862470:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573661568 00000100:00100000:1.0:1746140884.862477:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573661568 00000100:00100000:1.0:1746140884.862524:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16775 00000100:00100000:1.0:1746140884.862530:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:32606:x1830960573661568:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140884.862541:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.862559:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13a0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.862592:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.862600:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.862602:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140884.862605:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 26 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.862633:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 17 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.862649:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 17 pid: 4784 timeout: 963 lvb_type: 0 00000100:00100000:1.0:1746140884.862672:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576026880:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.862731:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.871900:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.872610:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573661696 00000100:00100000:2.0:1746140884.872619:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573661696 00002000:00100000:2.0:1746140884.872663:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (2699264->2748415) req@ffff88008f3c0700 x1830960573661696/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.872673:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0700 with x1830960573661696 ext(2699264->2748415) 00010000:00010000:2.0:1746140884.872682:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 18 pid: 4784 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.872697:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 18 pid: 4784 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.872703:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c0700 00000100:00100000:1.0:1746140884.872726:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576026880:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.872738:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1783 00000100:00100000:2.0:1746140884.872744:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573661696:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:1.0:1746140884.872752:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 27 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.872764:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36800, rc 0) 00000100:00100000:1.0:1746140884.872814:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:32606:x1830960573661568:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10284us (10378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.872820:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16775 00000100:00100000:3.0:1746140884.874164:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573660928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13896us (15145us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.874176:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8593 00002000:00100000:3.0:1746140884.874186:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f783800 x1830960573660928/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.874195:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f783800 with x1830960573660928 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.874201:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f783800 00000100:00100000:2.0:1746140884.876067:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573661696:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3311us (4166us total) trans 21474841351 rc 0/0 00000100:00100000:2.0:1746140884.876080:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1783 00002000:00100000:2.0:1746140884.876092:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (2699264->2748415) req@ffff88008f3c0700 x1830960573661696/t21474841351(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.876119:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0700 with x1830960573661696 ext(2699264->2748415) 00010000:00010000:2.0:1746140884.876128:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 20 pid: 4784 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.876143:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 20 pid: 4784 timeout: 963 lvb_type: 0 00002000:00010000:2.0:1746140884.876150:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c0700 00000100:00100000:2.0:1746140884.877352:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573661184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17076us (18182us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.877362:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8594 00002000:00100000:2.0:1746140884.877371:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f3c0000 x1830960573661184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.877379:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0000 with x1830960573661184 ext(1048576->2097151) 00002000:00010000:2.0:1746140884.877383:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c0000 00000100:00100000:2.0:1746140884.878732:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573661440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17316us (19464us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.878741:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8595 00002000:00100000:2.0:1746140884.878749:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f3c0380 x1830960573661440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.878758:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0380 with x1830960573661440 ext(1048576->2097151) 00002000:00010000:2.0:1746140884.878762:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c0380 00000100:00100000:0.0:1746140884.879241:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.880168:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573661824 00000100:00100000:2.0:1746140884.880178:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573661824 00010000:00010000:2.0:1746140884.880212:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 20 pid: 4784 timeout: 963 lvb_type: 0 00000100:00100000:2.0:1746140884.880250:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8697 00000100:00100000:2.0:1746140884.880255:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573661824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.880268:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.880289:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 20 pid: 4784 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.880299:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 20 pid: 4784 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.880340:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c992e00/0x8156357b7fdb9ccd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2748415) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1392 expref: 20 pid: 4784 timeout: 963 lvb_type: 0 00010000:00010000:2.0:1746140884.880367:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.880368:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.880375:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 24 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.880383:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 24 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.880416:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 24 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.880427:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeaa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576027008:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140884.880502:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530000 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.882437:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeaa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576027008:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140884.882458:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.882497:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573661824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2240us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.882507:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8697 00000100:00100000:0.0:1746140884.885156:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.885486:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573662080 00000100:00100000:2.0:1746140884.885496:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573662080 00002000:00100000:2.0:1746140884.885548:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3039232->3043327) req@ffff88008f3c0e00 x1830960573662080/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.885557:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0e00 with x1830960573662080 ext(3039232->3043327) 00002000:00010000:2.0:1746140884.885563:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c0e00 00000100:00100000:2.0:1746140884.885909:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8596 00000100:00100000:2.0:1746140884.885917:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573662080:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140884.886116:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573662080:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 199us (969us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140884.886122:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8596 00002000:00100000:2.0:1746140884.886127:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3039232->3043327) req@ffff88008f3c0e00 x1830960573662080/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.886133:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0e00 with x1830960573662080 ext(3039232->3043327) 00002000:00010000:2.0:1746140884.886136:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c0e00 00000100:00100000:0.0:1746140884.898087:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.898159:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.898175:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573662336 00000100:00100000:0.0:1746140884.898184:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.898185:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573662336 00002000:00100000:2.0:1746140884.898228:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3149823) req@ffff88008f3c1180 x1830960573662336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 504/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.898244:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1180 with x1830960573662336 ext(2097152->3149823) 00002000:00010000:2.0:1746140884.898250:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c1180 00000100:00100000:2.0:1746140884.898264:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573662592 00000100:00100000:2.0:1746140884.898266:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573662592 00002000:00100000:2.0:1746140884.898274:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3149824->4194303) req@ffff88008f3c1500 x1830960573662592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140884.898279:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573662848 00002000:00100000:2.0:1746140884.898280:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1500 with x1830960573662592 ext(3149824->4194303) 00000100:00100000:0.0:1746140884.898280:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:2.0:1746140884.898282:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c1500 00000100:00100000:3.0:1746140884.898289:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573662848 00000100:00100000:0.0:1746140884.898428:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573663104 00000100:00100000:0.0:1746140884.898432:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573663104 00000100:00100000:2.0:1746140884.898438:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8597 00000100:00100000:2.0:1746140884.898444:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573662336:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:0.0:1746140884.898451:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f3c1c00 x1830960573663104/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140884.898457:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8598 00002000:00100000:0.0:1746140884.898459:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1c00 with x1830960573663104 ext(3145728->4194303) 00002000:00010000:0.0:1746140884.898463:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c1c00 00000100:00100000:3.0:1746140884.898470:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573662592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140884.898500:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8599 00000100:00100000:1.0:1746140884.898509:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573663104:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140884.899572:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008f3c1880 x1830960573662848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.899581:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1880 with x1830960573662848 ext(2097152->3145727) 00002000:00010000:3.0:1746140884.899587:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c1880 00000100:00100000:3.0:1746140884.899608:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8600 00000100:00100000:3.0:1746140884.899613:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573662848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.912830:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573662592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14357us (14662us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746140884.912842:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8598 00002000:00100000:3.0:1746140884.912853:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3149824->4194303) req@ffff88008f3c1500 x1830960573662592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.912861:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1500 with x1830960573662592 ext(3149824->4194303) 00002000:00010000:3.0:1746140884.912867:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c1500 00000100:00100000:1.0:1746140884.913035:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573663104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14527us (14752us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.913042:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8599 00002000:00100000:1.0:1746140884.913047:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f3c1c00 x1830960573663104/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.913054:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1c00 with x1830960573663104 ext(3145728->4194303) 00002000:00010000:1.0:1746140884.913057:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c1c00 00000100:00100000:1.0:1746140884.915585:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.916096:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573663360 00000100:00100000:3.0:1746140884.916114:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573663360 00000100:00100000:3.0:1746140884.916157:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10696 00000100:00100000:3.0:1746140884.916164:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32611:x1830960573663360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140884.916185:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.916200:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9ce2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13a7 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.916287:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916297:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916320:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916331:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916336:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916341:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916440:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916447:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916453:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140884.916462:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140884.916532:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916537:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916542:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916548:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f19f800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.916551:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916557:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916566:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140884.916569:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.916573:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916577:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9ce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916603:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916609:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916613:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916621:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f19fe00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140884.916623:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916628:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916635:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388000) 00010000:00010000:3.0:1746140884.916636:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140884.916640:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916645:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fe00/0x8156357b7fdb9cf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140884.916679:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9ce2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 14 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.916689:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 13 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.916698:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.916700:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140884.916703:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19fc00, rc 0) 00000100:00100000:3.0:1746140884.916739:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32611:x1830960573663360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 576us (1162us total) trans 8589944990 rc 0/0 00000100:00100000:3.0:1746140884.916746:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10696 00000100:00100000:3.0:1746140884.917654:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573662848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18034us (19461us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.917666:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8600 00002000:00100000:3.0:1746140884.917677:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008f3c1880 x1830960573662848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.917686:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1880 with x1830960573662848 ext(2097152->3145727) 00002000:00010000:3.0:1746140884.917692:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c1880 00000100:00100000:2.0:1746140884.922210:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573662336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23752us (24119us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.922223:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8597 00002000:00100000:2.0:1746140884.922234:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3149823) req@ffff88008f3c1180 x1830960573662336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 504/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.922244:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1180 with x1830960573662336 ext(2097152->3149823) 00002000:00010000:2.0:1746140884.922250:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c1180 00000100:00100000:0.0:1746140884.922387:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.922843:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573663488 00000100:00100000:2.0:1746140884.922851:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573663488 00000100:00100000:2.0:1746140884.922884:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16776 00000100:00100000:2.0:1746140884.922890:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573663488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.922913:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.922930:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13ae expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.922951:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.922953:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.922960:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 20 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.922974:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 20 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.922983:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42200, rc 0) 00000100:00100000:2.0:1746140884.923005:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573663488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 115us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.923009:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16776 00000100:00100000:1.0:1746140884.923052:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.923060:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573663616 00000100:00100000:0.0:1746140884.923063:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573663616 00000100:00100000:0.0:1746140884.923084:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16777 00000100:00100000:0.0:1746140884.923088:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573663616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140884.923107:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.923117:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13b5 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.923129:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.923130:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140884.923134:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.923145:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140884.923152:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c993e00, rc 0) 00000100:00100000:0.0:1746140884.923167:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573663616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.923172:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16777 00000100:00100000:0.0:1746140884.923486:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.923502:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.923688:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.923811:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.923879:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573663744 00000100:00100000:2.0:1746140884.923883:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573663744 00000100:00100000:1.0:1746140884.924561:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573663872 00000100:00100000:1.0:1746140884.924564:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573663872 00000100:00100000:1.0:1746140884.924583:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573664000 00000100:00100000:1.0:1746140884.924584:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573664000 00000100:00100000:1.0:1746140884.924592:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573664128 00000100:00100000:1.0:1746140884.924593:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573664128 00000100:00100000:1.0:1746140884.924604:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16778 00000100:00100000:1.0:1746140884.924608:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573663744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.924617:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.924628:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13bc expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.924641:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.924643:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.924647:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 18 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.924658:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 18 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.924665:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130889e00, rc 0) 00000100:00100000:1.0:1746140884.924686:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573663744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 78us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.924691:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16778 00000100:00100000:1.0:1746140884.924700:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16779 00000100:00100000:1.0:1746140884.924704:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573663872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.924713:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.924719:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13c3 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.924728:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.924729:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.924732:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 22 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.924743:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 22 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.924749:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130889200, rc 0) 00000100:00100000:1.0:1746140884.924758:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573663872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 54us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.924762:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16779 00000100:00100000:1.0:1746140884.924769:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16780 00000100:00100000:1.0:1746140884.924772:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573664000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.924776:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.924780:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130889800/0x8156357b7fdb9d21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13ca expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.924819:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576027136:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140884.924865:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.924884:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16781 00000100:00100000:1.0:1746140884.924888:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573664128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.924894:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.924899:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13d1 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.924908:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.924909:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.924913:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 18 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.924920:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 18 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.924926:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130888c00, rc 0) 00000100:00100000:1.0:1746140884.924937:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573664128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 49us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.924941:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16781 00000100:00100000:0.0:1746140884.928091:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.928955:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573664256 00000100:00100000:2.0:1746140884.928966:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573664256 00000100:00100000:2.0:1746140884.929108:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16782 00000100:00100000:2.0:1746140884.929116:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:32606:x1830960573664256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140884.929133:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.929150:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13d8 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.929182:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.929190:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 17 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.929196:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.929197:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.929201:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.929229:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 17 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.929239:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 17 pid: 32377 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140884.929249:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576027264:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.929362:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.929370:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140884.929378:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576027392:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.929396:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746140884.931379:0:8460:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140884 -> 1746140885 00000100:00100000:1.0:1746140884.931405:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576027136:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140884.931436:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130889800/0x8156357b7fdb9d21 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ca expref: 22 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.931449:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130889800/0x8156357b7fdb9d21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ca expref: 22 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.932696:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130889800, rc 0) 00000100:00100000:1.0:1746140884.932758:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573664000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7982us (9067us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140884.932768:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16780 00000100:00100000:2.0:1746140884.933782:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576027264:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140884.933797:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576027392:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140884.933806:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140884.933837:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.933843:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140884.933859:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42800, rc 0) 00000100:00100000:2.0:1746140884.933912:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:32606:x1830960573664256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4796us (5830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.933920:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16782 00000100:00100000:2.0:1746140884.934117:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573664512 00000100:00100000:2.0:1746140884.934124:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573664512 00000100:00100000:2.0:1746140884.934159:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16783 00000100:00100000:2.0:1746140884.934165:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573664512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140884.934179:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.934194:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13df expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.934213:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.934223:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d36 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13df expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.934232:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13df expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.934329:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63fe00, rc 0) 00000100:00100000:2.0:1746140884.934349:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573664512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 184us (505us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140884.934355:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16783 00000100:00100000:2.0:1746140884.934376:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573664384 00000100:00100000:2.0:1746140884.934380:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573664384 00010000:00010000:2.0:1746140884.934396:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 18 pid: 32377 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140884.934416:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8698 00000100:00100000:2.0:1746140884.934421:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573664384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.934428:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.934453:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 18 pid: 32377 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140884.934462:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 18 pid: 32377 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140884.934478:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130888c00/0x8156357b7fdb9d28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d1 expref: 18 pid: 32377 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140884.934486:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.934501:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573664384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.934506:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8698 00000100:00100000:0.0:1746140884.937378:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.937444:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.937465:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573664896 00000100:00100000:2.0:1746140884.937476:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573664896 00010000:00010000:2.0:1746140884.937647:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140884.937690:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8699 00000100:00100000:2.0:1746140884.937695:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573664896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.937706:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.937726:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140884.937736:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140884.937753:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c85400/0x8156357b7fdb9c95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1384 expref: 35 pid: 4186 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140884.937764:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.937765:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.937770:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.937776:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.937801:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140884.937810:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576027520:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140884.937890:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.938153:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573664768 00000100:00100000:2.0:1746140884.938158:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573664768 00002000:00100000:2.0:1746140884.938186:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012d3b4000 x1830960573664768/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.938195:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4000 with x1830960573664768 ext(4194304->4886527) 00002000:00010000:2.0:1746140884.938200:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b4000 00000100:00100000:2.0:1746140884.938276:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8601 00000100:00100000:2.0:1746140884.938285:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573664768:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.940897:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576027520:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140884.940928:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.941574:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573664896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3875us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.941584:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8699 00000100:00100000:2.0:1746140884.944111:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573664768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5809us (6648us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140884.944124:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8601 00002000:00100000:2.0:1746140884.944136:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012d3b4000 x1830960573664768/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.944147:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4000 with x1830960573664768 ext(4194304->4886527) 00002000:00010000:2.0:1746140884.944153:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b4000 00000100:00100000:0.0:1746140884.945651:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.946026:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573665152 00000100:00100000:2.0:1746140884.946035:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573665152 00002000:00100000:2.0:1746140884.946076:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2523136->2527231) req@ffff88012d3b4380 x1830960573665152/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.946084:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4380 with x1830960573665152 ext(2523136->2527231) 00002000:00010000:2.0:1746140884.946088:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b4380 00000100:00100000:2.0:1746140884.946132:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8602 00000100:00100000:2.0:1746140884.946140:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573665152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140884.946296:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573665152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 156us (649us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140884.946327:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8602 00002000:00100000:2.0:1746140884.946332:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2523136->2527231) req@ffff88012d3b4380 x1830960573665152/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.946339:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4380 with x1830960573665152 ext(2523136->2527231) 00002000:00010000:2.0:1746140884.946341:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b4380 00000100:00100000:0.0:1746140884.948036:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.948804:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573665408 00000100:00100000:3.0:1746140884.948814:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573665408 00002000:00100000:3.0:1746140884.948856:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88012d3b4700 x1830960573665408/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.948867:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4700 with x1830960573665408 ext(0->1048575) 00002000:00010000:3.0:1746140884.948873:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b4700 00000100:00100000:3.0:1746140884.948900:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8603 00000100:00100000:3.0:1746140884.948908:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573665408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140884.953917:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.953953:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.953981:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.954005:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.954021:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.954048:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573665920 00000100:00100000:0.0:1746140884.954052:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.954058:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573665920 00000100:00100000:0.0:1746140884.954073:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573666816 00000100:00100000:0.0:1746140884.954076:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573666816 00002000:00100000:1.0:1746140884.954111:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88012d3b4e00 x1830960573665920/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746140884.954118:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10697 00002000:00100000:1.0:1746140884.954122:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4e00 with x1830960573665920 ext(1048576->2097151) 00000100:00100000:0.0:1746140884.954125:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:32612:x1830960573666816:12345-192.168.204.16@tcp:101:lfs.0 00002000:00010000:1.0:1746140884.954128:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b4e00 00000100:00100000:1.0:1746140884.954141:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573666176 00000100:00100000:1.0:1746140884.954143:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573666176 00010000:00010000:0.0:1746140884.954143:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746140884.954155:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012d3b5180 x1830960573666176/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746140884.954160:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136977200/0x8156357b7fdb9d3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13e6 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746140884.954161:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b5180 with x1830960573666176 ext(1048576->2097151) 00002000:00010000:1.0:1746140884.954164:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b5180 00000100:00100000:1.0:1746140884.954172:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573666432 00000100:00100000:1.0:1746140884.954174:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573666432 00002000:00100000:1.0:1746140884.954184:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012d3b5500 x1830960573666432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.954191:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b5500 with x1830960573666432 ext(1048576->2097151) 00002000:00010000:1.0:1746140884.954193:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b5500 00000100:00100000:1.0:1746140884.954204:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8604 00000100:00100000:1.0:1746140884.954210:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573665920:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746140884.954218:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954230:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954241:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954251:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954255:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954260:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954374:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954381:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954386:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140884.954408:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573665664 00000004:00200000:0.0:1746140884.954417:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:2.0:1746140884.954420:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573665664 00000004:00200000:0.0:1746140884.954421:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140884.954436:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954445:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954452:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954458:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954466:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954471:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136977000 already unused, calling callback (ffffffffa1368690) 00000100:00100000:2.0:1746140884.954472:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573666688 00000100:00100000:2.0:1746140884.954474:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573666688 00010000:00010000:0.0:1746140884.954475:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954481:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954489:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140884.954492:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746140884.954495:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4687 00010000:00010000:0.0:1746140884.954496:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954500:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136977000/0x8156357b7fdb9d44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140884.954501:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32606:x1830960573665664:12345-192.168.204.16@tcp:35:multiop.0 00010000:00010000:0.0:1746140884.954514:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954517:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954521:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954525:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136976e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140884.954527:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954531:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954535:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090293f00) 00010000:00010000:0.0:1746140884.954537:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140884.954538:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954542:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136976e00/0x8156357b7fdb9d4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140884.954562:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136977200/0x8156357b7fdb9d3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.954577:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.954582:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.954584:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140884.954586:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136976c00, rc 0) 00000100:00100000:0.0:1746140884.954608:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4688 00000100:00100000:0.0:1746140884.954613:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a840c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32601:x1830960573666688:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746140884.954716:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a840c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32601:x1830960573666688:12345-192.168.204.16@tcp:35:cat.0 Request processed in 103us (693us total) trans 8589944992 rc 0/0 00000100:00100000:0.0:1746140884.954723:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4688 00000100:00100000:0.0:1746140884.954758:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:32612:x1830960573666816:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 634us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.954762:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10697 00000100:00100000:2.0:1746140884.954889:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32606:x1830960573665664:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 386us (979us total) trans 8589944991 rc 0/0 00000100:00100000:2.0:1746140884.954896:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4687 00000100:00100000:2.0:1746140884.954968:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8605 00000100:00100000:2.0:1746140884.954975:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573666176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.954985:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8606 00000100:00100000:3.0:1746140884.954993:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573666432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140884.958083:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573665408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9163us (10042us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.958094:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8603 00002000:00100000:3.0:1746140884.958118:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88012d3b4700 x1830960573665408/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.958128:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4700 with x1830960573665408 ext(0->1048575) 00002000:00010000:3.0:1746140884.958134:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b4700 00000100:00100000:1.0:1746140884.964871:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573665920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10489us (10745us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140884.964884:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8604 00002000:00100000:1.0:1746140884.964897:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88012d3b4e00 x1830960573665920/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140884.964906:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4e00 with x1830960573665920 ext(1048576->2097151) 00002000:00010000:1.0:1746140884.964913:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b4e00 00000100:00100000:1.0:1746140884.965417:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.965471:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.965576:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573666944 00000100:00100000:2.0:1746140884.965588:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573666944 00000100:00100000:2.0:1746140884.965629:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573667072 00000100:00100000:2.0:1746140884.965632:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573667072 00000100:00100000:2.0:1746140884.965651:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16784 00000100:00100000:2.0:1746140884.965658:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+5:1985:x1830960573666944:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140884.965674:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.965692:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13ed expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.965717:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140884.965718:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140884.965718:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16785 00010000:00010000:2.0:1746140884.965727:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 6 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140884.965729:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+5:1985:x1830960573667072:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140884.965741:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 6 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.965744:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.965751:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f63fe00, rc 0) 00010000:00010000:1.0:1746140884.965757:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13f4 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.965775:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.965777:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.965784:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 6 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140884.965805:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+6:1985:x1830960573666944:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 148us (389us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140884.965806:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 6 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140884.965812:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16784 00010000:00010000:1.0:1746140884.965815:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5216400, rc 0) 00000100:00100000:1.0:1746140884.965839:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1985:x1830960573667072:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 114us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.965845:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16785 00000100:00100000:3.0:1746140884.968182:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573666432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13179us (14164us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140884.968193:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8606 00002000:00100000:3.0:1746140884.968204:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012d3b5500 x1830960573666432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.968213:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b5500 with x1830960573666432 ext(1048576->2097151) 00002000:00010000:3.0:1746140884.968219:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b5500 00000100:00100000:2.0:1746140884.969544:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573666176:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14562us (15554us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140884.969555:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8605 00002000:00100000:2.0:1746140884.969566:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012d3b5180 x1830960573666176/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.969574:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b5180 with x1830960573666176 ext(1048576->2097151) 00002000:00010000:2.0:1746140884.969579:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b5180 00000100:00100000:0.0:1746140884.971058:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.971117:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573667200 00000100:00100000:1.0:1746140884.971127:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573667200 00000100:00100000:1.0:1746140884.971187:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16786 00000100:00100000:1.0:1746140884.971195:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573667200:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140884.971213:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.971229:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a13fb expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.971251:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.971253:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.971261:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.971276:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.971286:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136977800, rc 0) 00000100:00100000:1.0:1746140884.971362:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573667200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 167us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.971367:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16786 00000100:00100000:0.0:1746140884.972384:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.972404:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573667328 00000100:00100000:3.0:1746140884.972409:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573667328 00000100:00100000:3.0:1746140884.972447:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16787 00000100:00100000:3.0:1746140884.972452:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573667328:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140884.972460:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.972470:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1402 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.972483:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.972485:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140884.972490:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 7 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.972500:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 7 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.972506:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19f200, rc 0) 00000100:00100000:3.0:1746140884.972524:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573667328:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.972528:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16787 00000100:00100000:0.0:1746140884.972668:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.972730:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.972925:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573667456 00000100:00100000:3.0:1746140884.972928:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573667456 00000100:00100000:3.0:1746140884.972943:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573667584 00000100:00100000:3.0:1746140884.972945:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573667584 00000100:00100000:3.0:1746140884.972967:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16788 00000100:00100000:3.0:1746140884.972972:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573667456:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140884.972978:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.972986:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9d75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1409 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.973022:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576027648:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140884.973072:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2a47240 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.973125:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16789 00000100:00100000:1.0:1746140884.973133:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573667584:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140884.973141:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.973150:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136977a00/0x8156357b7fdb9d7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1410 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.973176:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576027776:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140884.973198:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00002000:00010000:1.0:1746140884.975922:0:8460:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140884 -> 1746140885 00000100:00100000:1.0:1746140884.975952:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576027776:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140884.975983:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136977a00/0x8156357b7fdb9d7c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1410 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.975996:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136977a00/0x8156357b7fdb9d7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1410 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.976011:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136977a00, rc 0) 00000100:00100000:1.0:1746140884.976053:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573667584:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2920us (3321us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140884.976060:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16789 00000100:00100000:3.0:1746140884.976332:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576027648:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140884.976349:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9d75 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1409 expref: 8 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.976358:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9d75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1409 expref: 8 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.976369:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19f600, rc 0) 00000100:00100000:3.0:1746140884.976390:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573667456:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3417us (3722us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140884.976395:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16788 00000100:00100000:2.0:1746140884.976842:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.976910:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.976944:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573667712 00000100:00100000:1.0:1746140884.976951:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573667712 00000100:00100000:3.0:1746140884.976961:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573667840 00000100:00100000:3.0:1746140884.976965:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573667840 00000100:00100000:1.0:1746140884.976976:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16790 00000100:00100000:1.0:1746140884.976982:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573667712:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140884.976987:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16791 00000100:00100000:3.0:1746140884.976995:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573667840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140884.976995:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.977003:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.977006:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136976a00/0x8156357b7fdb9d83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1417 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140884.977011:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f19fe00/0x8156357b7fdb9d8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a141e expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.977043:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576027904:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140884.977044:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576028032:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140884.977085:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2a47240 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.977093:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.979134:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.979160:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573668096 00000100:00100000:1.0:1746140884.979167:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573668096 00000100:00100000:1.0:1746140884.979205:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10698 00000100:00100000:1.0:1746140884.979210:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:32612:x1830960573668096:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140884.979224:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140884.979241:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136976200/0x8156357b7fdb9d91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1425 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.979263:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576027904:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140884.979287:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f19fe00/0x8156357b7fdb9d8a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a141e expref: 18 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.979298:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f19fe00/0x8156357b7fdb9d8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a141e expref: 18 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.979326:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19fe00, rc 0) 00010000:00010000:1.0:1746140884.979347:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.979361:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 274 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.979365:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573667840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2370us (2453us total) trans 0 rc 301/301 00010000:00010000:1.0:1746140884.979368:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140884.979371:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16791 00010000:00010000:1.0:1746140884.979375:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.979381:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.979407:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.979418:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 12 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140884.979428:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576028160:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.979497:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.979504:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 12 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140884.979517:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576028288:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.979545:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 274 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.979553:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 274 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140884.979566:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576028416:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.979589:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.979620:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576028032:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140884.979636:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136976a00/0x8156357b7fdb9d83 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1417 expref: 22 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.979645:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136976a00/0x8156357b7fdb9d83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1417 expref: 22 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140884.979654:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136976a00, rc 0) 00000100:00100000:1.0:1746140884.979674:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573667712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2692us (2833us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140884.979680:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16790 00000100:00100000:1.0:1746140884.982657:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576028160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.982670:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576028288:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140884.983345:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.983380:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.983462:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.983521:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573668224 00000100:00100000:3.0:1746140884.983522:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573668352 00000100:00100000:3.0:1746140884.983527:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573668352 00000100:00100000:2.0:1746140884.983527:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573668224 00010000:00010000:3.0:1746140884.983561:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140884.983573:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573668480 00000100:00100000:1.0:1746140884.983576:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573668480 00000100:00100000:3.0:1746140884.983586:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8700 00000100:00100000:3.0:1746140884.983593:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:1982:x1830960573668352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.983606:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.983612:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140884.983622:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140884.983643:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136976c00/0x8156357b7fdb9d52 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13e6 expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140884.983655:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.983659:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140884.983667:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140884.983672:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140884.983713:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960573668352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.983719:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8700 00010000:00010000:2.0:1746140884.983719:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140884.983746:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8701 00000100:00100000:2.0:1746140884.983752:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4796c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960573668224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140884.983759:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140884.983762:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140884.983769:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140884.983781:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f19fc00/0x8156357b7fdb9cf7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a7 expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140884.983793:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.983796:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.983802:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.983807:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140884.983824:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4796c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960573668224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.983829:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8701 00010000:00010000:1.0:1746140884.983952:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 275 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140884.984334:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8702 00000100:00100000:3.0:1746140884.984341:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:1982:x1830960573668480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140884.984349:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140884.984354:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 275 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140884.984362:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 275 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140884.984373:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140884.984376:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140884.984384:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140884.984390:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140884.984405:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140884.984421:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c993200/0x8156357b7fdb9c56 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1353 expref: 275 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140884.984425:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:1982:x1830960573668480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140884.984430:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8702 00000100:00100000:1.0:1746140884.984431:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576028416:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.984450:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.984457:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.984461:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140884.984479:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:2.0:1746140884.984794:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.984901:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573668608 00000100:00100000:0.0:1746140884.984905:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573668608 00000100:00100000:0.0:1746140884.984929:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16792 00000100:00100000:0.0:1746140884.984934:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32611:x1830960573668608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140884.984947:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140884.984959:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a142c expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.984978:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 24 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.984984:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140884.984986:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140884.984989:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 22 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.985010:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 24 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.985020:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 24 pid: 4784 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140884.985031:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576028544:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.985167:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136976200/0x8156357b7fdb9d91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 13 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.985178:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 12 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.985185:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.985187:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746140884.985189:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136976000, rc 0) 00000100:00100000:1.0:1746140884.985321:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:32612:x1830960573668096:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6094us (6178us total) trans 8589944993 rc 0/0 00000100:00100000:1.0:1746140884.985326:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10698 00000100:00100000:0.0:1746140884.985497:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9000 going to sleep for 11 seconds 00000100:00100000:2.0:1746140884.987070:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576028544:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140884.987094:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 22 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.987124:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b630e00, rc 0) 00000100:00100000:2.0:1746140884.987477:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32611:x1830960573668608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2540us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140884.987485:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16792 00000100:00100000:3.0:1746140884.987625:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.987731:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.987785:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573668736 00000100:00100000:2.0:1746140884.987790:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573668736 00000100:00100000:1.0:1746140884.987794:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573668864 00000100:00100000:1.0:1746140884.987798:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573668864 00000100:00100000:1.0:1746140884.987827:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10699 00002000:00100000:2.0:1746140884.987831:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3039232->3145727) req@ffff88009f121180 x1830960573668736/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140884.987833:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:32612:x1830960573668864:12345-192.168.204.16@tcp:101:lfs.0 00002000:00100000:2.0:1746140884.987839:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121180 with x1830960573668736 ext(3039232->3145727) 00010000:00010000:2.0:1746140884.987845:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 25 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140884.987849:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.987858:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 25 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140884.987862:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136976600/0x8156357b7fdb9dad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1433 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140884.987864:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f121180 00000100:00100000:2.0:1746140884.987888:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1784 00000100:00100000:2.0:1746140884.987894:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1983:x1830960573668736:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746140884.987934:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.987946:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 13 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.987953:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.987977:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 13 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.987986:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 13 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140884.987996:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576028672:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140884.988043:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140884.989751:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576028672:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140884.989766:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140884.990201:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.990261:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573668992 00000100:00100000:1.0:1746140884.990266:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573668992 00010000:00010000:1.0:1746140884.990287:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 14 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140884.990336:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8703 00000100:00100000:1.0:1746140884.990342:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573668992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.990352:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.990356:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 14 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140884.990364:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 14 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140884.990381:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136976000/0x8156357b7fdb9d98 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1425 expref: 14 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140884.990391:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140884.990395:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.990407:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.990413:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140884.990426:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.990452:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573668992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.990458:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8703 00010000:00010000:0.0:1746140884.990511:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.990517:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140884.990555:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140884.990560:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140884.990575:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140884.990602:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136976600/0x8156357b7fdb9dad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1433 expref: 13 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.990616:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1433 expref: 12 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140884.990621:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140884.990624:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140884.990626:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136977c00, rc 0) 00000100:00100000:0.0:1746140884.990648:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:32612:x1830960573668864:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2816us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140884.990654:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10699 00000100:00100000:2.0:1746140884.991055:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573668736:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3160us (3323us total) trans 21474841352 rc 0/0 00000100:00100000:2.0:1746140884.991062:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1784 00002000:00100000:2.0:1746140884.991070:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3039232->3145727) req@ffff88009f121180 x1830960573668736/t21474841352(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:300/0 lens 488/448 e 0 to 0 dl 1746140895 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140884.991542:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121180 with x1830960573668736 ext(3039232->3145727) 00010000:00010000:2.0:1746140884.991551:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 27 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140884.991562:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 27 pid: 4784 timeout: 964 lvb_type: 0 00002000:00010000:2.0:1746140884.991574:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f121180 00000100:00100000:0.0:1746140884.993707:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140884.993757:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.994395:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573669120 00000100:00100000:3.0:1746140884.994402:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573669120 00000100:00100000:3.0:1746140884.994434:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573669248 00000100:00100000:3.0:1746140884.994436:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573669248 00000100:00100000:3.0:1746140884.994461:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16793 00000100:00100000:3.0:1746140884.994467:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573669120:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140884.994484:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140884.994499:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9dbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a143a expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.994532:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16794 00000100:00100000:0.0:1746140884.994539:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573669248:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140884.994546:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140884.994552:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576028800:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140884.994556:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9dc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1441 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140884.994579:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576028928:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140884.994620:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:3.0:1746140884.994797:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2a47240 going to sleep for 11 seconds 00000100:00100000:0.0:1746140884.995293:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140884.995703:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573669376 00000100:00100000:1.0:1746140884.995707:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573669376 00010000:00010000:1.0:1746140884.995730:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 27 pid: 4784 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140884.995756:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8704 00000100:00100000:1.0:1746140884.995762:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573669376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140884.995770:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140884.995793:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 27 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140884.995806:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 27 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140884.995823:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.995825:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140884.995832:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 21 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.995840:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 21 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140884.995860:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 21 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140884.995870:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576029056:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140884.995931:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746140884.996479:0:4186:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff88009f122680 x1830960576028800) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 27 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140884.996505:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a36800/0x8156357b7fdb9cdb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13a0 expref: 27 pid: 4784 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140884.996516:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576028800:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140884.996537:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9dbb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a143a expref: 8 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.996547:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f19f800/0x8156357b7fdb9dbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a143a expref: 8 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140884.996554:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19f800, rc 0) 00000100:00100000:3.0:1746140884.996594:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573669120:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2126us (2890us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140884.996601:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16793 00000100:00100000:2.0:1746140884.996603:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576028928:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140884.996619:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9dc2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1441 expref: 8 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.996630:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b630800/0x8156357b7fdb9dc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1441 expref: 8 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140884.996653:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b630800, rc 0) 00000100:00100000:2.0:1746140884.996677:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573669248:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2139us (2919us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140884.996683:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16794 00000100:00100000:1.0:1746140884.997171:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576029056:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140884.998047:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140884.998078:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573669376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2315us (2785us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140884.998087:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8704 00000100:00100000:0.0:1746140884.999051:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140884.999111:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573669632 00000100:00100000:2.0:1746140884.999118:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573669632 00000100:00100000:2.0:1746140884.999158:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10700 00000100:00100000:2.0:1746140884.999164:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:32612:x1830960573669632:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140884.999179:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140884.999194:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439400/0x8156357b7fdb9dc9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1448 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.999275:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.999286:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140884.999296:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140884.999326:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140884.999425:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439400/0x8156357b7fdb9dc9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.999438:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 14 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140884.999444:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140884.999447:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140884.999450:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c439200, rc 0) 00000100:00100000:2.0:1746140884.999482:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+14:32612:x1830960573669632:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 318us (433us total) trans 8589944994 rc 0/0 00000100:00100000:2.0:1746140884.999487:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10700 00000100:00100000:0.0:1746140884.999684:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140884.999778:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573669888 00000100:00100000:3.0:1746140884.999782:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573669888 00002000:00100000:3.0:1746140884.999807:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880130d28700 x1830960573669888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/0 e 0 to 0 dl 1746140895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140884.999816:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d28700 with x1830960573669888 ext(2097152->3145727) 00002000:00010000:3.0:1746140884.999820:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d28700 00000100:00100000:3.0:1746140884.999874:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8607 00000100:00100000:3.0:1746140884.999881:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573669888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140885.001160:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.001399:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.001417:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.001433:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573670016 00000100:00100000:1.0:1746140885.001437:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573670016 00000100:00100000:3.0:1746140885.001442:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573670144 00000100:00100000:3.0:1746140885.001447:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573670144 00000100:00080000:0.0:1746140885.001463:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746140885.001466:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746140885.001762:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573670272 00000100:00100000:1.0:1746140885.001765:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573670272 00000100:00100000:3.0:1746140885.001845:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16795 00000100:00100000:3.0:1746140885.001853:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573670016:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:2.0:1746140885.001853:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16796 00000100:00100000:2.0:1746140885.001860:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573670144:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746140885.001883:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.001884:0:4186:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.001899:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 25 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.001900:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 33 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.001907:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 7 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.001908:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.001914:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.001915:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 23 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.001920:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.001920:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.001922:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.001922:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.001924:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.001924:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.001947:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 23 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.001947:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.001958:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 23 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.001958:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.001970:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576029312:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.001970:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576029184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.002018:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16797 00010000:00010000:2.0:1746140885.002022:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140885.002024:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573670272:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746140885.002030:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 8 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.002036:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576029440:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.002041:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.002050:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 33 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.002056:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 33 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.002057:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.002059:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140885.002063:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 33 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.002064:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 16 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.002069:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140885.002069:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576029568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.002070:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.002073:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.002079:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530000 going to sleep for 11 seconds 00010000:00010000:3.0:1746140885.002086:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 16 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140885.002092:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573670400 00010000:00010000:3.0:1746140885.002094:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 16 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.002094:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573670400 00000100:00100000:0.0:1746140885.002112:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.002113:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576029696:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.002121:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573670528 00000100:00100000:2.0:1746140885.002123:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573670528 00000100:00100000:2.0:1746140885.002133:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16798 00000100:00100000:2.0:1746140885.002136:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573670400:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140885.002141:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.002147:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140885.002150:0:8460:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.002153:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 8 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.002159:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 25 pid: 4186 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140885.002161:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576029824:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.002161:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573670656 00000100:00100000:0.0:1746140885.002164:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573670656 00010000:00010000:2.0:1746140885.002165:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.002171:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 23 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.002176:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.002177:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.002179:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.002181:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16799 00010000:00010000:3.0:1746140885.002182:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 33 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.002186:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573670528:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140885.002189:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 33 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.002192:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 23 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140885.002197:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576029952:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.002199:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 23 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.002201:0:20960:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.002205:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576030080:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140885.002210:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 23 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.002211:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2a47000 going to sleep for 11 seconds 00010000:00010000:0.0:1746140885.002216:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.002217:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.002219:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.002228:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16800 00000100:00100000:2.0:1746140885.002232:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573670656:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140885.002233:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.002233:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 23 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.002241:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 9 pid: 12255 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.002241:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 23 pid: 8460 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.002245:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.002248:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576030336:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.002248:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576030208:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.002253:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.002258:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.002258:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.002260:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.002265:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b99c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746140885.002277:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.002278:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 25 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.002284:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 33 pid: 12255 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.002286:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 25 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.002292:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576030464:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.002299:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576030592:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.002326:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6780 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.002334:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2a47240 going to sleep for 11 seconds 00010000:00010000:3.0:1746140885.002349:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.002357:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 9 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.002365:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576030720:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.002387:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 25 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.002394:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 25 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.002401:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576030848:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.002417:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.006790:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576029184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.006835:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576029312:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.007494:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573669888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7612us (7807us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.007503:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8607 00002000:00100000:3.0:1746140885.007515:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880130d28700 x1830960573669888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:300/0 lens 488/440 e 0 to 0 dl 1746140895 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.007529:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d28700 with x1830960573669888 ext(2097152->3145727) 00010000:00010000:3.0:1746140885.007538:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 22 pid: 8460 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.007552:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 22 pid: 8460 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.007559:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d28700 00000100:00100000:3.0:1746140885.009445:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576029440:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.009445:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576029696:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.009455:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576029824:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.009457:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576029568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.009483:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.010777:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.010835:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573670912 00000100:00100000:0.0:1746140885.010835:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.010843:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573670912 00000100:00100000:0.0:1746140885.010867:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140885.010878:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 10 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.010895:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.011187:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573670784 00000100:00100000:1.0:1746140885.011187:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573671040 00000100:00100000:1.0:1746140885.011191:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573671040 00000100:00100000:3.0:1746140885.011192:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573670784 00000100:00100000:0.0:1746140885.011197:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573671296 00000100:00100000:0.0:1746140885.011201:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573671296 00010000:00010000:3.0:1746140885.011210:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 11 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.011217:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 34 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.011219:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 17 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.011230:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8705 00000100:00100000:1.0:1746140885.011235:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8706 00000100:00100000:3.0:1746140885.011237:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573670912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140885.011239:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8707 00000100:00100000:1.0:1746140885.011240:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573670784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140885.011245:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573671040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.011248:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.011249:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.011251:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.011268:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 11 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.011268:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 34 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.011269:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 11 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.011278:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 34 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.011282:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 11 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.011287:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 11 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.011302:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136977800/0x8156357b7fdb9d67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13fb expref: 11 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.011302:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a36a00/0x8156357b7fdb9cd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1399 expref: 34 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.011325:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5216400/0x8156357b7fdb9d60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13f4 expref: 11 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.011339:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140885.011339:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140885.011341:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.011377:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573671040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 132us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.011378:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573670912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.011378:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573670784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 137us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.011384:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8706 00000100:00100000:3.0:1746140885.011388:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8705 00000100:00100000:0.0:1746140885.011392:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8707 00000100:00100000:1.0:1746140885.011401:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8708 00000100:00100000:1.0:1746140885.011407:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1983:x1830960573671296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.011414:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.011422:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 17 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.011431:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 17 pid: 8460 timeout: 964 lvb_type: 1 00000100:00080000:0.0:1746140885.011433:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746140885.011442:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdb9d13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13bc expref: 17 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.011450:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.011453:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.011465:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573671424 00000100:00100000:1.0:1746140885.011467:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573671296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.011467:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573671424 00000100:00100000:1.0:1746140885.011475:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8708 00010000:00010000:0.0:1746140885.011479:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 22 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.011491:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8709 00000100:00100000:1.0:1746140885.011496:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573671424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.011504:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.011518:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 22 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.011527:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 22 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.011539:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42200/0x8156357b7fdb9d05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ae expref: 22 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.011548:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.011551:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576029952:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.011562:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573671424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.011568:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8709 00010000:00010000:0.0:1746140885.011574:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.011653:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576030080:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.011671:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576030336:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.011689:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576030464:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.011702:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.011733:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576030208:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.011744:0:20960:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.011747:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576030592:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.011756:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140885.011763:0:4186:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.011767:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.011780:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576030720:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.011787:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576030848:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.011793:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140885.011798:0:8460:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.011805:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.011813:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573671808 00000100:00100000:3.0:1746140885.011816:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573671808 00002000:00100000:3.0:1746140885.011841:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2527231) req@ffff880130d2bb80 x1830960573671808/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.011850:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2bb80 with x1830960573671808 ext(2097152->2527231) 00010000:00010000:3.0:1746140885.011856:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 33 pid: 12255 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.011865:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 33 pid: 12255 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.011870:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130d2bb80 00000100:00100000:3.0:1746140885.011883:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1785 00000100:00100000:3.0:1746140885.011889:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1983:x1830960573671808:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140885.012189:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573671168 00000100:00100000:2.0:1746140885.012193:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573671168 00000100:00100000:1.0:1746140885.012204:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573671552 00010000:00010000:2.0:1746140885.012207:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.012207:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573671552 00000100:00100000:0.0:1746140885.012209:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140885.012220:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 34 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.012228:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573671680 00000100:00100000:2.0:1746140885.012230:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573672064 00000100:00100000:0.0:1746140885.012231:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573671680 00000100:00100000:2.0:1746140885.012233:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573672064 00000100:00100000:1.0:1746140885.012235:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8710 00000100:00100000:3.0:1746140885.012239:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8711 00000100:00100000:1.0:1746140885.012239:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573671168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.012242:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 21 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.012243:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573671552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.012243:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 10 pid: 12255 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.012245:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.012249:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140885.012254:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8712 00010000:00010000:1.0:1746140885.012254:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.012255:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 34 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.012258:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8713 00000100:00100000:2.0:1746140885.012259:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573672064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.012262:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 34 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.012262:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.012263:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573671680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.012266:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.012269:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.012273:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43a00/0x8156357b7fdb9c79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a136f expref: 34 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.012273:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c993e00/0x8156357b7fdb9d0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13b5 expref: 16 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.012277:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 10 pid: 12255 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.012279:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 21 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.012281:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.012281:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.012283:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.012283:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.012285:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 10 pid: 12255 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.012287:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.012287:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012288:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 21 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.012294:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.012294:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012298:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130889200/0x8156357b7fdb9d1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13c3 expref: 21 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.012318:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140885.012325:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.012336:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573672064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (128us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140885.012341:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f63fe00/0x8156357b7fdb9d59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13ed expref: 10 pid: 12255 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.012342:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8712 00000100:00100000:1.0:1746140885.012343:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573671168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.012347:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8710 00010000:00010000:0.0:1746140885.012350:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.012364:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573671680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.012370:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8713 00000100:00100000:2.0:1746140885.012371:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.012379:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573671936 00000100:00100000:0.0:1746140885.012381:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573671936 00010000:00010000:0.0:1746140885.012389:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 9 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.012397:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.012401:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573672320 00000100:00100000:0.0:1746140885.012403:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573672320 00000100:00100000:1.0:1746140885.012409:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8714 00000100:00100000:1.0:1746140885.012415:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573671936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.012415:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 26 pid: 4186 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.012422:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.012429:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 9 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.012433:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8715 00010000:00010000:1.0:1746140885.012436:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 9 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.012438:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573672320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.012444:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.012446:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f19f200/0x8156357b7fdb9d6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1402 expref: 9 pid: 4186 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.012450:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 26 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.012458:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140885.012463:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 26 pid: 4186 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.012467:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573672192 00000100:00100000:2.0:1746140885.012470:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573672192 00010000:00010000:1.0:1746140885.012470:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140885.012475:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdb9c8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1376 expref: 27 pid: 4186 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.012480:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 27 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.012483:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.012484:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140885.012485:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573671936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140885.012487:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.012491:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8714 00010000:00010000:0.0:1746140885.012493:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012504:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.012516:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573672320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (119us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140885.012587:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.012603:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1983:x1830960573671552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 359us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.012711:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8716 00000100:00100000:2.0:1746140885.012717:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573672192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.012724:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.012731:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 26 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.012743:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 26 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.012753:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42a00/0x8156357b7fdb9c72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1361 expref: 26 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.012760:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.012762:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140885.012764:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8715 00010000:00010000:2.0:1746140885.012765:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.012770:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8711 00010000:00010000:2.0:1746140885.012770:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746140885.012778:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746140885.012782:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140885.012786:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012793:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.012794:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573672192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.012799:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8716 00010000:00010000:3.0:1746140885.012803:0:8460:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012810:0:8460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012811:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012812:0:4186:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012818:0:4186:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012823:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012824:0:8460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012830:0:8460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012830:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012831:0:4186:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012836:0:8460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012837:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f19fc00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.012841:0:8460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5216600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140885.012841:0:4186:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012841:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012843:0:8460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012846:0:4186:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012848:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012850:0:4186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f19f600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140885.012852:0:4186:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012854:0:8460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012856:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012857:0:4186:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.012862:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f19fc00/0x8156357b7fdb9dec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012863:0:8460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012863:0:4186:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012868:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdb9df3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.012868:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f19f600/0x8156357b7fdb9de5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.012896:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573670016:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11045us (11740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.012900:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573670272:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 10876us (11481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.012902:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573670400:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 10765us (10843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.012902:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16795 00000100:00100000:0.0:1746140885.012907:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16797 00000100:00100000:3.0:1746140885.012910:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16798 00010000:00010000:3.0:1746140885.012928:0:4784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.012992:0:4784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.013007:0:4784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.013012:0:4784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.013017:0:4784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.013026:0:4784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c439000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.013028:0:4784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.013033:0:4784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.013041:0:4784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.013046:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c439000/0x8156357b7fdb9dde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.013380:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960573670144:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11388us (11849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.013386:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16796 00000100:00100000:2.0:1746140885.015386:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.015435:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.015510:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573672448 00000100:00100000:3.0:1746140885.015517:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573672448 00010000:00010000:3.0:1746140885.015547:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 20 pid: 8460 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.015571:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8717 00000100:00100000:3.0:1746140885.015577:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573672448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.015588:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.015609:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 20 pid: 8460 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.015620:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 20 pid: 8460 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.015640:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b630e00/0x8156357b7fdb9da6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a142c expref: 20 pid: 8460 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.015652:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.016165:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.016170:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.016179:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.016200:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.016237:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573672448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 659us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.016243:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8717 00000100:00100000:3.0:1746140885.016266:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573672576 00000100:00100000:3.0:1746140885.016269:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573672576 00000100:00100000:3.0:1746140885.016288:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16801 00000100:00100000:3.0:1746140885.016293:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32611:x1830960573672576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.016327:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.016340:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a144f expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.016362:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140885.016365:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.016371:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746140885.016374:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.016384:0:4784:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.016394:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 16 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.016402:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc2400, rc 0) 00000100:00100000:3.0:1746140885.016419:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32611:x1830960573672576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.016425:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16801 00010000:00010000:2.0:1746140885.016502:0:20960:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.016518:0:20960:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.016542:0:20960:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.016549:0:20960:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.016555:0:20960:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.016561:0:20960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130889400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140885.016564:0:20960:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.016570:0:20960:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.016579:0:20960:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.016584:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130889400/0x8156357b7fdb9dfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.016621:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960573670528:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 14434us (14508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.016628:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16799 00000100:00100000:1.0:1746140885.019870:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573671808:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7969us (8064us total) trans 17179874073 rc 0/0 00000100:00100000:1.0:1746140885.019882:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1785 00002000:00100000:1.0:1746140885.019894:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2527231) req@ffff880130d2bb80 x1830960573671808/t17179874073(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.019904:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2bb80 with x1830960573671808 ext(2097152->2527231) 00010000:00010000:1.0:1746140885.019913:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.019930:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 964 lvb_type: 0 00002000:00010000:1.0:1746140885.019937:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130d2bb80 00000100:00100000:0.0:1746140885.022148:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.022340:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573672704 00000100:00100000:3.0:1746140885.022349:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573672704 00010000:00010000:3.0:1746140885.022380:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.022417:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8718 00000100:00100000:3.0:1746140885.022424:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573672704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.022441:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.022463:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.022475:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.022495:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42800/0x8156357b7fdb9d2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a13d8 expref: 34 pid: 12255 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.022508:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.022510:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.022515:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.022523:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.022588:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140885.022642:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.022666:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573672704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 243us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.022672:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8718 00010000:00010000:0.0:1746140885.022711:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.022733:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.022740:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.022747:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.022753:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f63e000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140885.022757:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.022765:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.022773:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.022775:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.022780:0:4785:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 15 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.022787:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 15 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.022817:0:4785:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 15 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.022828:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576030976:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140885.022896:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.025845:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576030976:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.025871:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.025880:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f63e000/0x8156357b7fdb9e01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.026240:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960573670656:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 24005us (24090us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.026250:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16800 00000100:00100000:0.0:1746140885.028447:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.028527:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573672960 00000100:00100000:3.0:1746140885.028536:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573672960 00000100:00100000:3.0:1746140885.028590:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10701 00000100:00100000:3.0:1746140885.028598:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+14:32612:x1830960573672960:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:3.0:1746140885.028647:0:14742:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.028677:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9db4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1433 expref: 14 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.028697:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.028702:0:14742:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140885.029151:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.029164:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 273 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.029171:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 273 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.029177:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.029183:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 6/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.029212:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.029224:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 11 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.029237:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576031104:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.029353:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 273 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.029361:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 273 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.029369:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576031232:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.029399:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 273 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.029406:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 273 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.029412:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576031360:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.029429:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2a47000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.029799:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.030630:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573673216 00000100:00100000:1.0:1746140885.030637:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573673216 00002000:00100000:1.0:1746140885.030671:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012d3b6d80 x1830960573673216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.030685:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b6d80 with x1830960573673216 ext(2097152->3145727) 00002000:00010000:1.0:1746140885.030690:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b6d80 00000100:00100000:1.0:1746140885.030724:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8608 00000100:00100000:1.0:1746140885.030730:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573673216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.031874:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.031892:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.031914:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.032065:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573673344 00000100:00100000:2.0:1746140885.032071:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573673344 00010000:00010000:2.0:1746140885.032093:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 12 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.032123:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573673600 00000100:00100000:2.0:1746140885.032125:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573673600 00010000:00010000:2.0:1746140885.032134:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 274 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.032142:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573673472 00000100:00100000:3.0:1746140885.032146:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573673472 00000100:00100000:2.0:1746140885.032153:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8719 00000100:00100000:2.0:1746140885.032159:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573673344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.032161:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 275 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.032168:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.032173:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 12 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.032180:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8720 00000100:00100000:3.0:1746140885.032185:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:1984:x1830960573673600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.032188:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 12 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.032192:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.032197:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 275 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.032205:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 275 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.032283:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8721 00000100:00100000:0.0:1746140885.032291:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:1984:x1830960573673472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.032298:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.032317:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 275 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.032541:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.032545:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.032553:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140885.032560:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.032563:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.032568:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.032589:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:1984:x1830960573673600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 403us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.032593:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8720 00000100:00100000:2.0:1746140885.032594:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573673344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 434us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.032600:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8719 00010000:00010000:3.0:1746140885.032629:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdb9b1b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a129d expref: 11 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.032643:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576031104:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.032653:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576031232:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140885.032653:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 274 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.032662:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217800/0x8156357b7fdb9aea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1281 expref: 274 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.032665:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5217400/0x8156357b7fdb9af1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a128f expref: 274 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.032670:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576031360:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140885.032677:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.032680:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.032690:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.032696:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.032704:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.032709:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140885.032711:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.032715:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140885.032724:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1984:x1830960573673472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 436us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.032729:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8721 00000040:00080000:3.0:1746140885.033292:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3403, 88 off288128 00000004:00080000:3.0:1746140885.033300:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864108994991ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033372:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3434, 88 off291032 00000004:00080000:3.0:1746140885.033377:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864109071853ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.033395:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3435, 88 off291120 00000004:00080000:3.0:1746140885.033399:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864109094141ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.033407:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3404, 88 off288216 00000004:00080000:3.0:1746140885.033410:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864109105140ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033418:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3405, 88 off288304 00000004:00080000:3.0:1746140885.033421:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864109116656ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033429:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3436, 88 off291208 00000004:00080000:3.0:1746140885.033431:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864109126563ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.033438:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3437, 88 off291296 00000004:00080000:3.0:1746140885.033440:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864109135255ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.033446:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3438, 88 off291384 00000004:00080000:3.0:1746140885.033448:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864109143576ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.033458:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3406, 88 off288392 00000004:00080000:3.0:1746140885.033461:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864109156042ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033467:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3439, 88 off291472 00000004:00080000:3.0:1746140885.033469:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864109164553ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.033475:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3407, 88 off288480 00000004:00080000:3.0:1746140885.033478:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864109172670ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033484:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3440, 88 off291560 00000004:00080000:3.0:1746140885.033487:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864109182027ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.033493:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3408, 88 off288568 00000004:00080000:3.0:1746140885.033496:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864109191291ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033502:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3409, 88 off288656 00000004:00080000:3.0:1746140885.033505:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864109200267ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033511:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3410, 88 off288744 00000004:00080000:3.0:1746140885.033513:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864109208262ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033519:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3411, 88 off288832 00000004:00080000:3.0:1746140885.033522:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864109216792ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.033528:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3441, 88 off291648 00000004:00080000:3.0:1746140885.033530:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864109225350ns, next at 809142599738ns, rc = 0 00000100:00100000:1.0:1746140885.039271:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573673216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8533us (9465us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.039283:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8608 00002000:00100000:1.0:1746140885.039296:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012d3b6d80 x1830960573673216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.039321:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b6d80 with x1830960573673216 ext(2097152->3145727) 00002000:00010000:1.0:1746140885.039326:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b6d80 00000100:00100000:2.0:1746140885.045148:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.045180:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573673728 00000100:00100000:2.0:1746140885.045189:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573673728 00000100:00100000:2.0:1746140885.045231:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16802 00000100:00100000:2.0:1746140885.045239:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+19:32611:x1830960573673728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.045255:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.045273:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1456 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140885.045297:0:4785:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fed5, atime: 0x6813fed5, ctime: 0x6813fed5, blocks: 0x1589 00010000:00010000:2.0:1746140885.045337:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.045339:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.045347:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 20 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.045361:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 20 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.045371:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a62da00, rc 0) 00000100:00100000:2.0:1746140885.045416:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32611:x1830960573673728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 178us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.045427:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16802 00000100:00100000:2.0:1746140885.047144:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.047551:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573673856 00000100:00100000:1.0:1746140885.047558:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573673856 00000100:00100000:1.0:1746140885.047595:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10702 00000100:00100000:1.0:1746140885.047602:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32611:x1830960573673856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.047619:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.047634:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a145d expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.047693:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140885.047702:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a145d expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.047723:0:27790:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140885.047733:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a145d expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.047744:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.047747:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140885.047750:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a145d expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.047756:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42800, rc 0) 00000100:00100000:1.0:1746140885.047803:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32611:x1830960573673856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 201us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.047809:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10702 00000001:00080000:1.0:1746140885.053408:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944992 is committed 00000004:00010000:3.0:1746140885.053414:0:14742:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d3b4a80 reply state ffff88009365bc00 transno 8589944995 ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00000001:00080000:1.0:1746140885.053422:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944993 is committed 00000100:00100000:3.0:1746140885.053426:0:14742:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746140885.053428:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944986 is committed 00000001:00080000:1.0:1746140885.053432:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944994 is committed 00000001:00080000:1.0:1746140885.053441:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944989 is committed 00000001:00080000:1.0:1746140885.053456:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944995 is committed 00000004:00080000:1.0:1746140885.053460:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2684 committed 00000004:00080000:1.0:1746140885.053476:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2657 committed 00000004:00080000:1.0:1746140885.053482:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2656 committed 00000004:00080000:1.0:1746140885.053483:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2655 committed 00000004:00080000:1.0:1746140885.053485:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2654 committed 00000004:00080000:1.0:1746140885.053486:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2683 committed 00000004:00080000:1.0:1746140885.053487:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2653 committed 00000004:00080000:1.0:1746140885.053490:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2682 committed 00000004:00080000:1.0:1746140885.053491:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2652 committed 00000004:00080000:1.0:1746140885.053493:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2681 committed 00000004:00080000:1.0:1746140885.053494:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2680 committed 00000004:00080000:1.0:1746140885.053496:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2679 committed 00000004:00080000:1.0:1746140885.053497:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2651 committed 00000004:00080000:1.0:1746140885.053499:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2650 committed 00000004:00080000:1.0:1746140885.053501:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2678 committed 00000004:00080000:1.0:1746140885.053503:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2677 committed 00000004:00080000:1.0:1746140885.053504:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2649 committed 00000001:00080000:1.0:1746140885.053509:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944990 is committed 00010000:00080000:3.0:1746140885.053532:0:14742:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746140885.053548:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32612:x1830960573672960:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 24947us (25107us total) trans 8589944995 rc 0/0 00000100:00100000:3.0:1746140885.053557:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10701 00010000:00010000:1.0:1746140885.053567:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140885.053575:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140885.053581:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140885.053586:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afc2600 already unused, calling callback (ffffffffa1368690) 00000100:00100000:3.0:1746140885.053590:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576031488:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746140885.053590:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140885.053596:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140885.053611:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.053613:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140885.053618:0:3296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a145d expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.053628:0:3296:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a145d expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.053636:0:3296:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a145d expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.053641:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746140885.053659:0:3296:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a145d expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.053660:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576031872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.053666:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3296:1830960576032512:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140885.053669:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576032000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.053683:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.053698:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.053705:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576031488 00000100:00100000:1.0:1746140885.053709:0:3296:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.053711:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576031488 00000100:00100000:1.0:1746140885.053719:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576031744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.053720:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576031616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.053735:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576031872 00000100:00100000:2.0:1746140885.053737:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576031872 00000100:00100000:1.0:1746140885.053739:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.053745:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576032000 00000100:00100000:3.0:1746140885.053748:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576032000 00000100:00100000:2.0:1746140885.053748:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576031744 00000100:00100000:2.0:1746140885.053750:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576031744 00000100:00100000:1.0:1746140885.053758:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576032256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.053760:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16803 00000100:00100000:2.0:1746140885.053765:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3313:x1830960576031488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.053766:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16804 00000100:00100000:3.0:1746140885.053771:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3312:x1830960576031872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.053771:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.053791:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576032256 00000100:00100000:1.0:1746140885.053794:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576032256 00000100:00100000:1.0:1746140885.053810:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16805 00000100:00100000:1.0:1746140885.053814:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3311:x1830960576031744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.053836:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16806 00000100:00100000:3.0:1746140885.053839:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3313:x1830960576032000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.053888:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16807 00000100:00100000:2.0:1746140885.053894:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3311:x1830960576032256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.053898:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.053912:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576032128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.053927:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3313:x1830960576032000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (228us total) trans 21474841353 rc 0/0 00000100:00100000:3.0:1746140885.053931:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16806 00000100:00100000:1.0:1746140885.053931:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.054005:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576032768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.054023:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.054199:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576031616 00000100:00100000:0.0:1746140885.054200:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576032128 00000100:00100000:3.0:1746140885.054203:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576031616 00000100:00100000:0.0:1746140885.054204:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576032128 00000100:00100000:1.0:1746140885.054210:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576033280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.054222:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576032768 00000100:00100000:2.0:1746140885.054222:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3311:x1830960576032256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 328us (450us total) trans 21474841355 rc 0/0 00000100:00100000:3.0:1746140885.054224:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576032768 00000100:00100000:1.0:1746140885.054227:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140885.054227:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16808 00000100:00100000:2.0:1746140885.054231:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16807 00000100:00100000:0.0:1746140885.054233:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3310:x1830960576031616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.054235:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576033280 00000100:00100000:3.0:1746140885.054236:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576033280 00000100:00100000:1.0:1746140885.054236:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746140885.054241:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576032896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.054242:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16809 00000100:00100000:3.0:1746140885.054246:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16810 00000100:00100000:2.0:1746140885.054247:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3310:x1830960576032128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.054250:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3310:x1830960576032768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.054253:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.054261:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576033408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.054272:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.054286:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576032896 00000100:00100000:1.0:1746140885.054288:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576032896 00000100:00100000:1.0:1746140885.054299:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576033408 00000100:00100000:1.0:1746140885.054301:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576033408 00000100:00100000:0.0:1746140885.054330:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16811 00000100:00100000:0.0:1746140885.054336:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3310:x1830960576033280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.054342:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16812 00000100:00100000:2.0:1746140885.054344:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3310:x1830960576032128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (413us total) trans 21474841356 rc 0/0 00000100:00100000:1.0:1746140885.054347:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3310:x1830960576032896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.054352:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16809 00000100:00100000:2.0:1746140885.054361:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16813 00000100:00100000:2.0:1746140885.054365:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3310:x1830960576033408:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.054410:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea9c00/2, rc 0, transno 21474841355 00000100:00100000:1.0:1746140885.054416:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576032256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.054449:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576032384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.054454:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3312:x1830960576031872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 683us (770us total) trans 21474841358 rc 0/0 00000100:00100000:3.0:1746140885.054459:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16804 00000100:00100000:2.0:1746140885.054469:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746140885.054470:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:1.0:1746140885.054473:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00000100:00100000:3.0:1746140885.054475:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576032640:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746140885.054475:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.054477:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.054479:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00000100:00100000:2.0:1746140885.054483:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576033024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.054494:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3310:x1830960576033280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (265us total) trans 17179874075 rc 0/0 00000100:00100000:3.0:1746140885.054498:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140885.054500:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16811 00000100:00100000:1.0:1746140885.054502:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3311:x1830960576031744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 688us (762us total) trans 21474841354 rc 0/0 00000100:00100000:1.0:1746140885.054508:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16805 00000100:00100000:3.0:1746140885.054512:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576033152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.054515:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576032384 00000100:00100000:1.0:1746140885.054518:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576032384 00000100:00100000:3.0:1746140885.054524:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.054529:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576032640 00000100:00100000:1.0:1746140885.054529:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576033152 00000100:00100000:1.0:1746140885.054531:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576033152 00000100:00100000:2.0:1746140885.054532:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576032640 00000100:00100000:3.0:1746140885.054538:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576033664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.054541:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16814 00000100:00100000:2.0:1746140885.054544:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16815 00000100:00100000:1.0:1746140885.054545:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3312:x1830960576032384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.054547:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960576033152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.054558:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746140885.054572:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f782300/2, rc 0, transno 21474841353 00000100:00100000:3.0:1746140885.054575:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576032000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.054587:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576033664 00000100:00100000:3.0:1746140885.054589:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576033664 00000100:00100000:3.0:1746140885.054600:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16816 00000100:00100000:3.0:1746140885.054604:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3313:x1830960576032640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.054619:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3312:x1830960576032384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (148us total) trans 21474841359 rc 0/0 00000100:00100000:2.0:1746140885.054622:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3313:x1830960576033152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (97us total) trans 17179874076 rc 0/0 00000100:00100000:1.0:1746140885.054624:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16814 00000100:00100000:2.0:1746140885.054627:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16815 00000100:00100000:1.0:1746140885.054633:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16817 00000100:00100000:3.0:1746140885.054686:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3313:x1830960576032640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (187us total) trans 17179874077 rc 0/0 00000100:00100000:1.0:1746140885.054699:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3313:x1830960576033664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.054742:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.054778:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3313:x1830960576033664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (219us total) trans 21474841360 rc 0/0 00000100:00100000:1.0:1746140885.054783:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16817 00000100:00100000:2.0:1746140885.054787:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576033536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.054791:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576033024 00000100:00100000:1.0:1746140885.054793:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576033024 00000100:00100000:1.0:1746140885.054806:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16818 00000100:00100000:1.0:1746140885.054810:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3312:x1830960576033024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.054880:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3312:x1830960576033024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (143us total) trans 17179874078 rc 0/0 00000100:00100000:1.0:1746140885.054884:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16818 00000004:00080000:1.0:1746140885.054901:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f781500/2, rc 0, transno 21474841354 00000100:00100000:1.0:1746140885.054904:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576031744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.054948:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3313:x1830960576031488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1183us (1306us total) trans 21474841361 rc 0/0 00000100:00100000:1.0:1746140885.054953:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16803 00000004:00080000:1.0:1746140885.054972:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c2680/2, rc 0, transno 17179874075 00000100:00100000:1.0:1746140885.054976:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576033280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.054982:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f781880/2, rc 0, transno 21474841356 00000100:00100000:1.0:1746140885.054985:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576032128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.055073:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.055110:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16816 00000100:00100000:3.0:1746140885.055120:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576033536 00000100:00100000:3.0:1746140885.055123:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576033536 00000004:00080000:2.0:1746140885.055133:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f781f80/2, rc 0, transno 21474841358 00000100:00100000:3.0:1746140885.055137:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16819 00000100:00100000:2.0:1746140885.055138:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576031872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.055140:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3312:x1830960576033536:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140885.055148:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea8e00/2, rc 0, transno 21474841359 00000100:00100000:2.0:1746140885.055151:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576032384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140885.055166:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c1f80/2, rc 0, transno 17179874078 00000100:00100000:2.0:1746140885.055169:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576033024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.055184:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+59:3310:x1830960576031616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 950us (1283us total) trans 21474841357 rc 0/0 00000100:00100000:0.0:1746140885.055191:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16808 00000004:00080000:3.0:1746140885.055208:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c0a80/2, rc 0, transno 17179874077 00000100:00100000:3.0:1746140885.055212:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576032640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140885.055219:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c2300/2, rc 0, transno 17179874076 00000100:00100000:3.0:1746140885.055221:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576033152:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140885.055229:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6bac380/2, rc 0, transno 21474841360 00000100:00100000:3.0:1746140885.055232:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576033664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140885.055238:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f783480/2, rc 0, transno 21474841361 00000100:00100000:3.0:1746140885.055241:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576031488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140885.055253:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f780e00/2, rc 0, transno 21474841357 00000100:00100000:2.0:1746140885.055255:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3310:x1830960576033408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 889us (981us total) trans 17179874074 rc 0/0 00000100:00100000:1.0:1746140885.055257:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576031616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.055264:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16813 00000004:00080000:1.0:1746140885.055269:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c2d80/2, rc 0, transno 17179874074 00000100:00100000:1.0:1746140885.055272:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576033408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.055351:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3310:x1830960576032768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1099us (1325us total) trans 17179874080 rc 0/0 00000100:00100000:3.0:1746140885.055356:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16810 00000100:00100000:2.0:1746140885.055358:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3312:x1830960576033536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 216us (285us total) trans 17179874079 rc 0/0 00000004:00080000:0.0:1746140885.055360:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c3480/2, rc 0, transno 17179874080 00000100:00100000:2.0:1746140885.055364:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16819 00000100:00100000:0.0:1746140885.055365:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576032768:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746140885.055374:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746140885.055376:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.055378:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140885 -> 1746140884 00002000:00010000:1.0:1746140885.055380:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.055381:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000004:00080000:2.0:1746140885.055387:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c2a00/2, rc 0, transno 17179874079 00000100:00100000:2.0:1746140885.055390:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576033536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.055406:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3310:x1830960576032896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1059us (1151us total) trans 17179874081 rc 0/0 00000100:00100000:1.0:1746140885.055412:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16812 00000004:00080000:0.0:1746140885.055414:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c3b80/2, rc 0, transno 17179874081 00000100:00100000:0.0:1746140885.055418:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576032896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.057449:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.057602:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3296:1830960576032512:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140885.057626:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140885.057635:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9e0f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140885.057897:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573673984 00000100:00100000:3.0:1746140885.057902:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573673984 00000100:00100000:3.0:1746140885.057942:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10703 00000100:00100000:3.0:1746140885.057948:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32612:x1830960573673984:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140885.057966:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.057981:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1464 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.058033:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.058046:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.058066:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.058069:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140885.058071:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc3800, rc 0) 00000100:00100000:3.0:1746140885.058129:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32612:x1830960573673984:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 181us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.058135:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10703 00000100:00100000:0.0:1746140885.058342:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.058406:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573674112 00000100:00100000:3.0:1746140885.058409:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573674112 00000100:00100000:3.0:1746140885.058437:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4689 00000100:00100000:3.0:1746140885.058442:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32611:x1830960573674112:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:3.0:1746140885.058513:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32611:x1830960573674112:12345-192.168.204.16@tcp:49:cat.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.058519:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4689 00000100:00100000:2.0:1746140885.061733:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.061815:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573674240 00000100:00100000:3.0:1746140885.061824:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573674240 00000100:00100000:3.0:1746140885.061923:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10704 00000100:00100000:3.0:1746140885.061930:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32612:x1830960573674240:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140885.061947:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.061963:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9e2b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a146b expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.062028:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3000/0x8156357b7fdb9e32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.062040:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3000/0x8156357b7fdb9e32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.062055:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3000/0x8156357b7fdb9e32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140885.062082:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140885.062085:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140885.062108:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3000/0x8156357b7fdb9e32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.062129:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9e2b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a146b expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.062140:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3000/0x8156357b7fdb9e32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a146b expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.062147:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.062150:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140885.062152:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc3000, rc 0) 00000100:00100000:3.0:1746140885.062201:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:32612:x1830960573674240:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 271us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.062206:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10704 00000100:00100000:0.0:1746140885.065897:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.065929:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.065965:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573674368 00000100:00100000:1.0:1746140885.065977:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573674368 00000100:00100000:1.0:1746140885.066028:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573674624 00000100:00100000:1.0:1746140885.066031:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573674624 00000100:00100000:1.0:1746140885.066052:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16820 00000100:00100000:1.0:1746140885.066059:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+5:1983:x1830960573674368:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140885.066076:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.066108:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1472 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140885.066134:0:8459:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fed4, atime: 0x6813fed4, ctime: 0x6813fed4, blocks: 0x821 00010000:00010000:1.0:1746140885.066157:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.066158:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.066167:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 6 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140885.066179:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16821 00010000:00010000:1.0:1746140885.066182:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 6 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140885.066192:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+5:1983:x1830960573674624:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140885.066193:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66a00, rc 0) 00010000:00010000:2.0:1746140885.066208:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.066224:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1480 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.066237:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:2.0:1746140885.066245:0:4782:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fed5, atime: 0x6813fed4, ctime: 0x6813fed5, blocks: 0x821 00000100:00100000:1.0:1746140885.066250:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573674368:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 191us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.066256:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16820 00000100:00100000:3.0:1746140885.066260:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573674880 00010000:00010000:2.0:1746140885.066261:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.066263:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140885.066267:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573674880 00010000:00010000:2.0:1746140885.066270:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 6 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.066283:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 6 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.066292:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a62c000, rc 0) 00000100:00100000:3.0:1746140885.066297:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16822 00000100:00100000:3.0:1746140885.066321:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573674880:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140885.066329:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.066338:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a148e expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.066346:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+6:1983:x1830960573674624:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 159us (416us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140885.066355:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.066356:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140885.066356:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16821 00010000:00010000:3.0:1746140885.066360:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.066369:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 7 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.066375:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc3600, rc 0) 00000100:00100000:3.0:1746140885.066393:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573674880:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 90us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.066399:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16822 00000100:00100000:1.0:1746140885.066445:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.066485:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.066523:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.066618:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573674496 00000100:00100000:2.0:1746140885.066621:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573674496 00000100:00100000:2.0:1746140885.066638:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573674752 00000100:00100000:2.0:1746140885.066640:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573674752 00000100:00100000:0.0:1746140885.066643:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573675008 00000100:00100000:0.0:1746140885.066647:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573675008 00000100:00100000:2.0:1746140885.066652:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16823 00000100:00100000:2.0:1746140885.066657:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573674496:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140885.066663:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140885.066670:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16824 00010000:00010000:2.0:1746140885.066671:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1479 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.066676:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573674752:12345-192.168.204.16@tcp:101:lfs.0 00002000:00010000:2.0:1746140885.066682:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed5, atime: 0x6813fed5, ctime: 0x6813fed5, blocks: 0x821 00010000:00010000:0.0:1746140885.066683:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.066691:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1487 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140885.066706:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed3, atime: 0x6813fed3, ctime: 0x6813fed3, blocks: 0x821 00010000:00010000:0.0:1746140885.066714:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.066716:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140885.066718:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16825 00010000:00010000:0.0:1746140885.066720:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 8 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140885.066726:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:1983:x1830960573675008:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140885.066731:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 8 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.066735:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.066738:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bea200, rc 0) 00010000:00010000:1.0:1746140885.066745:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1495 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.066757:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.066758:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140885.066761:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573674752:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 85us (275us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140885.066763:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 8 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.066767:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16824 00010000:00010000:1.0:1746140885.066773:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 8 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.066786:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66400, rc 0) 00000100:00100000:1.0:1746140885.066810:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573675008:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 85us (287us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140885.066812:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.066813:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140885.066816:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16825 00010000:00010000:2.0:1746140885.066819:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 9 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.066828:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 8 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.066835:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a62c400, rc 0) 00000100:00100000:2.0:1746140885.066853:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573674496:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 197us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.066858:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16823 00000100:00100000:0.0:1746140885.068625:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.068664:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.068705:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573675264 00000100:00100000:2.0:1746140885.068712:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573675264 00002000:00100000:2.0:1746140885.068743:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008fcd0000 x1830960573675264/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.068752:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fcd0000 with x1830960573675264 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.068757:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fcd0000 00000100:00100000:2.0:1746140885.068771:0:21640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573675520 00000100:00100000:2.0:1746140885.068773:0:21640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573675520 00000100:00100000:0.0:1746140885.068784:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8609 00002000:00100000:2.0:1746140885.068786:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008fcd0380 x1830960573675520/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.068793:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fcd0380 with x1830960573675520 ext(3145728->4194303) 00000100:00100000:0.0:1746140885.068793:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573675264:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:2.0:1746140885.068796:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fcd0380 00000100:00100000:2.0:1746140885.069506:0:21640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8610 00000100:00100000:2.0:1746140885.069513:0:21640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573675520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.076173:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.076267:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573675776 00000100:00100000:2.0:1746140885.076276:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573675776 00000100:00100000:2.0:1746140885.076574:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10705 00000100:00100000:2.0:1746140885.076583:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32616:x1830960573675776:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140885.076602:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.076620:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a149c expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.076829:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.076847:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.076860:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.076891:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.076897:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.076903:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.077020:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.077032:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.077038:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.077071:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.077084:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 8 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.077110:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576033792:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.077215:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.077804:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573675264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9011us (9182us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.077814:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8609 00002000:00100000:2.0:1746140885.077822:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008fcd0000 x1830960573675264/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.077831:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fcd0000 with x1830960573675264 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.077834:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fcd0000 00000100:00100000:0.0:1746140885.082149:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.082240:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.082268:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.082289:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.082335:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573676032 00000100:00100000:0.0:1746140885.082335:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.082344:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573676032 00000100:00100000:1.0:1746140885.082359:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573676416 00000100:00100000:1.0:1746140885.082370:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573676416 00000100:00100000:2.0:1746140885.082390:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573676288 00000100:00100000:3.0:1746140885.082391:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573676800 00000100:00100000:2.0:1746140885.082393:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573676288 00000100:00100000:3.0:1746140885.082396:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573676800 00000100:00100000:2.0:1746140885.082409:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573677056 00000100:00100000:2.0:1746140885.082411:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573677056 00000100:00100000:1.0:1746140885.082432:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8611 00000100:00100000:3.0:1746140885.082438:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8612 00000100:00100000:1.0:1746140885.082440:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573676032:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:2.0:1746140885.082445:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8613 00000100:00100000:3.0:1746140885.082446:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573676288:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:2.0:1746140885.082453:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573676416:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140885.082474:0:21376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.082474:0:32428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.082481:0:21692:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.082486:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.082486:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.082488:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.082488:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.082492:0:21692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.082493:0:21376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.082493:0:32428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.082495:0:21692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.082499:0:21692:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.082504:0:21376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.082504:0:32428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.082509:0:21692:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.082512:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8614 00000100:00100000:0.0:1746140885.082519:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573676800:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140885.082536:0:8463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.082542:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.082544:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.082546:0:8463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.082553:0:8463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.082604:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8615 00000100:00100000:1.0:1746140885.082610:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573677056:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140885.082624:0:32429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.082630:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.082632:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.082635:0:32429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.082643:0:32429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.083025:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.083042:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.083071:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.083084:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573677440 00000100:00100000:0.0:1746140885.083087:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573677440 00000100:00100000:0.0:1746140885.083122:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573677568 00000100:00100000:0.0:1746140885.083125:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573677568 00000100:00100000:0.0:1746140885.083139:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573677824 00000100:00100000:0.0:1746140885.083140:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573677824 00000100:00100000:0.0:1746140885.083154:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8616 00000100:00100000:0.0:1746140885.083159:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573677440:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140885.083174:0:8464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.083182:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.083183:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.083185:0:8464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.083194:0:8464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.084107:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8617 00000100:00100000:2.0:1746140885.084115:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573677568:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746140885.084134:0:21690:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.084141:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.084143:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.084147:0:21690:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.084154:0:21690:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.084564:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8618 00000100:00100000:0.0:1746140885.084570:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573677824:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140885.084584:0:21689:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.084591:0:21689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.084592:0:21689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.084595:0:21689:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.084601:0:21689:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.085262:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576033792:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.085285:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140885.085479:0:21640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573675520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15965us (16813us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.085486:0:21640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8610 00002000:00100000:2.0:1746140885.085494:0:21640:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008fcd0380 x1830960573675520/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.085503:0:21640:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fcd0380 with x1830960573675520 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.085508:0:21640:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fcd0380 00000100:00100000:0.0:1746140885.088262:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.088329:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.088364:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573677952 00000100:00100000:0.0:1746140885.088372:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573677952 00010000:00010000:0.0:1746140885.088407:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 9 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.088439:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8722 00000100:00100000:0.0:1746140885.088446:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573677952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.088458:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.088463:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 9 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.088474:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 9 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.088497:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9dd0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1448 expref: 9 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.088520:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.088525:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140885.088533:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140885.088540:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140885.088563:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.088570:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573678208 00000100:00100000:3.0:1746140885.088581:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573678208 00000100:00100000:0.0:1746140885.088593:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573677952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 148us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.088599:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8722 00000100:00100000:3.0:1746140885.088624:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10706 00000100:00100000:3.0:1746140885.088631:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:32619:x1830960573678208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.088652:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.088669:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3e00/0x8156357b7fdb9eb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14a3 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.088729:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.088738:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140885.088754:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140885.088758:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088769:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088777:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088787:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088792:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088797:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088886:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088892:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088901:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140885.088909:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140885.088910:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.088917:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.088926:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.088931:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e436200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140885.088935:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.088940:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.088949:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.088951:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140885.088955:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.088959:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436200/0x8156357b7fdb9e78 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.088976:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088981:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088986:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.088990:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afc2800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.088993:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.088994:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.088999:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.088999:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.089004:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089007:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.089007:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136977800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.089009:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140885.089009:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089012:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089014:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089016:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2800/0x8156357b7fdb9ed3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089025:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140885.089027:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140885.089030:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089033:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089034:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136977800/0x8156357b7fdb9e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089038:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089043:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089045:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089047:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089048:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afc3400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.089050:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089052:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089056:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089056:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e436000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140885.089059:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089061:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140885.089063:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140885.089064:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089065:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.089069:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3400/0x8156357b7fdb9ebe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089071:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4ae6200) 00010000:00010000:2.0:1746140885.089073:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140885.089075:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089076:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.089080:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089080:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e436000/0x8156357b7fdb9e71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.089085:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.089089:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afc3200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.089091:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.089109:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.089118:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4ae6200) 00010000:00010000:3.0:1746140885.089120:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.089123:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089126:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9e63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a149c expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.089127:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3200/0x8156357b7fdb9ecc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.089134:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136977c00/0x8156357b7fdb9e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a149c expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.089142:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136977c00, rc 0) 00010000:00010000:3.0:1746140885.089157:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3e00/0x8156357b7fdb9eb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14a3 expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.089164:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3e00/0x8156357b7fdb9eb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14a3 expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.089171:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc3e00, rc 0) 00000100:00100000:3.0:1746140885.089206:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32619:x1830960573678208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 576us (901us total) trans 8589944997 rc 301/301 00000100:00100000:3.0:1746140885.089212:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10706 00000100:00100000:0.0:1746140885.089886:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.089993:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32616:x1830960573675776:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 13411us (13827us total) trans 8589944996 rc 301/301 00000100:00100000:2.0:1746140885.090000:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10705 00000100:00100000:0.0:1746140885.090016:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.090033:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573678464 00000100:00100000:0.0:1746140885.090035:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.090037:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573678464 00000100:00100000:0.0:1746140885.090153:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.090300:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573678720 00000100:00100000:1.0:1746140885.090302:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573678336 00000100:00100000:2.0:1746140885.090318:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573678720 00000100:00100000:1.0:1746140885.090325:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573678336 00000100:00100000:0.0:1746140885.090327:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573678592 00000100:00100000:0.0:1746140885.090330:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573678592 00000100:00100000:2.0:1746140885.090338:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16826 00000100:00100000:2.0:1746140885.090344:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573678464:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140885.090347:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16827 00000100:00100000:3.0:1746140885.090354:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573678720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.090356:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.090363:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.090370:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14b1 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.090373:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14bf expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.090387:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.090387:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.090389:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.090389:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.090395:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.090395:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 18 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.090408:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 18 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.090411:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.090416:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093877c00, rc 0) 00000100:00100000:0.0:1746140885.090416:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16828 00010000:00010000:3.0:1746140885.090419:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc2000, rc 0) 00000100:00100000:1.0:1746140885.090423:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16829 00000100:00100000:0.0:1746140885.090423:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573678592:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140885.090429:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573678336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140885.090429:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.090436:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14b8 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.090438:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140885.090439:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573678720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.090441:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573678464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.090445:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16827 00010000:00010000:1.0:1746140885.090447:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14aa expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.090448:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16826 00010000:00010000:1.0:1746140885.090462:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.090463:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.090469:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 22 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.090480:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 22 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.090487:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e200, rc 0) 00000100:00100000:1.0:1746140885.090503:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573678336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 75us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.090508:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16829 00010000:00010000:0.0:1746140885.090516:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.090517:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.090522:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 18 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.090532:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 18 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.090538:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66600, rc 0) 00000100:00100000:0.0:1746140885.090550:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573678592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 129us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.090558:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16828 00010000:00010000:1.0:1746140885.094402:0:32429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.094421:0:32429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.094428:0:32429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.094434:0:32429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc91a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140885.094438:0:32429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.094446:0:32429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.094462:0:32429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.094468:0:32429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc91a00/0x8156357b7fdb9e9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.094545:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573677056:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 11932us (12205us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.094555:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8615 00010000:00010000:3.0:1746140885.095741:0:21692:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.095751:0:21692:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.095758:0:21692:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.095763:0:21692:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e436e00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.095766:0:21692:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.095772:0:21692:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.095785:0:21692:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.095795:0:21692:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e436e00/0x8156357b7fdb9e8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.095849:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573676416:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 13396us (13608us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.095857:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8613 00010000:00010000:0.0:1746140885.104260:0:8464:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.104279:0:8464:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.104288:0:8464:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.104294:0:8464:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c993a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140885.104298:0:8464:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.104325:0:8464:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.104345:0:8464:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.104352:0:8464:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c993a00/0x8156357b7fdb9ea2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.104465:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573677440:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 21299us (21434us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.104476:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8616 00000100:00100000:1.0:1746140885.112517:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140885.112902:0:21376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.112917:0:21376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.112922:0:21376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.112926:0:21376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afc2e00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.112929:0:21376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.112934:0:21376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.112948:0:21376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.112952:0:21376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009afc2e00/0x8156357b7fdb9e7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.112954:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573678976 00000100:00100000:0.0:1746140885.112964:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573678976 00002000:00100000:0.0:1746140885.113004:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880093137100 x1830960573678976/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.113014:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137100 with x1830960573678976 ext(4194304->4886527) 00002000:00010000:0.0:1746140885.113019:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093137100 00000100:00100000:3.0:1746140885.113036:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573676288:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 30586us (30762us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.113040:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8619 00000100:00100000:3.0:1746140885.113047:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8612 00000100:00100000:0.0:1746140885.113047:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573678976:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140885.113187:0:21690:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.113198:0:21690:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.113206:0:21690:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.113211:0:21690:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e437000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140885.113215:0:21690:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.113221:0:21690:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.113237:0:21690:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.113242:0:21690:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e437000/0x8156357b7fdb9ea9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.113323:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573677568:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 29189us (30260us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.113332:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8617 00010000:00010000:1.0:1746140885.121118:0:32428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.121136:0:32428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.121145:0:32428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.121152:0:32428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc91c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140885.121156:0:32428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.121163:0:32428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.121182:0:32428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.121189:0:32428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc91c00/0x8156357b7fdb9e86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.121486:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573676032:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 39042us (39343us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.121496:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8611 00000100:00100000:2.0:1746140885.127269:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140885.127301:0:21689:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.127340:0:21689:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.127349:0:21689:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.127359:0:21689:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c993800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140885.127364:0:21689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.127371:0:21689:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.127392:0:21689:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.127399:0:21689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c993800/0x8156357b7fdb9eb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.127500:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573677824:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 42928us (44425us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.127510:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8618 00000100:00100000:3.0:1746140885.127590:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573679104 00000100:00100000:3.0:1746140885.127598:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573679104 00000100:00100000:3.0:1746140885.127637:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10707 00000100:00100000:3.0:1746140885.127643:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32619:x1830960573679104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.127662:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.127679:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2a00/0x8156357b7fdb9efd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14c6 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.127734:0:8463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.127745:0:8463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.127751:0:8463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.127756:0:8463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b48400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.127759:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140885.127759:0:8463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.127766:0:8463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.127770:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140885.127776:0:8463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.127779:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140885.127782:0:8463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b48400/0x8156357b7fdb9e94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746140885.127805:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140885.127809:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140885.127821:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140885.127831:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573676800:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 45312us (45540us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.127838:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8614 00010000:00010000:3.0:1746140885.127843:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2a00/0x8156357b7fdb9efd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.127858:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.127865:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.127867:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140885.127878:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc2c00, rc 0) 00000100:00100000:3.0:1746140885.127900:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32619:x1830960573679104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 257us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.127905:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10707 00000100:00100000:2.0:1746140885.130149:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573678976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17095us (17636us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140885.130159:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8619 00002000:00100000:2.0:1746140885.130169:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880093137100 x1830960573678976/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.130180:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137100 with x1830960573678976 ext(4194304->4886527) 00002000:00010000:2.0:1746140885.130185:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093137100 00000100:00100000:0.0:1746140885.130286:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.130335:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.130420:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.130434:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573679232 00000100:00100000:0.0:1746140885.130440:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573679232 00000100:00100000:2.0:1746140885.130455:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573679360 00000100:00100000:2.0:1746140885.130459:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573679360 00000100:00100000:0.0:1746140885.130480:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573679488 00000100:00100000:0.0:1746140885.130482:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573679488 00000100:00100000:2.0:1746140885.130840:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16830 00000100:00100000:2.0:1746140885.130848:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573679232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.130861:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140885.130868:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16831 00010000:00010000:2.0:1746140885.130874:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14cd expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.130876:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573679360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.130883:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.130892:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14d4 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.130894:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.130896:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.130903:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 25 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.130903:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.130904:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140885.130908:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16832 00010000:00010000:1.0:1746140885.130909:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 35 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.130916:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 25 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.130916:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573679488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.130921:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 35 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.130924:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.130925:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801354a8800, rc 0) 00010000:00010000:1.0:1746140885.130926:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ec6000, rc 0) 00010000:00010000:0.0:1746140885.130932:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14db expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.130943:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140885.130945:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573679360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 71us (610us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140885.130945:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140885.130949:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573679232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 103us (665us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140885.130950:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 36 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140885.130951:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16831 00000100:00100000:2.0:1746140885.130956:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16830 00010000:00010000:0.0:1746140885.130959:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 35 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.130967:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67a00, rc 0) 00000100:00100000:0.0:1746140885.131750:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573679488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 833us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.131758:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16832 00000100:00100000:2.0:1746140885.131884:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.131943:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.131987:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573679616 00000100:00100000:3.0:1746140885.131992:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573679616 00000100:00100000:2.0:1746140885.132012:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.132013:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573679744 00000100:00100000:3.0:1746140885.132014:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573679744 00000100:00100000:3.0:1746140885.132031:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573679872 00000100:00100000:3.0:1746140885.132033:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573679872 00000100:00100000:3.0:1746140885.132046:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16833 00000100:00100000:3.0:1746140885.132051:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573679616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.132059:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.132068:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14e2 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.132082:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.132083:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.132088:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 27 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.132111:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 27 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.132119:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc3a00, rc 0) 00000100:00100000:3.0:1746140885.132143:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573679616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.132149:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16833 00000100:00100000:3.0:1746140885.132160:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16834 00000100:00100000:3.0:1746140885.132165:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573679744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.132171:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.132177:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14e9 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.132187:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.132189:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.132193:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 27 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.132200:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 27 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.132206:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc2e00, rc 0) 00000100:00100000:3.0:1746140885.132222:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573679744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.132227:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16834 00000100:00100000:3.0:1746140885.132236:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16835 00000100:00100000:3.0:1746140885.132241:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573679872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.132247:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.132253:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14f0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.132268:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.132270:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.132273:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 36 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.132282:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 36 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.132289:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afc3c00, rc 0) 00000100:00100000:3.0:1746140885.132324:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573679872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 62us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.132329:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16835 00000100:00100000:0.0:1746140885.140127:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.140241:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573680128 00000100:00100000:3.0:1746140885.140250:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573680128 00000100:00100000:3.0:1746140885.140326:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4690 00000100:00100000:3.0:1746140885.140335:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32611:x1830960573680128:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140885.140558:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32611:x1830960573680128:12345-192.168.204.16@tcp:35:cat.0 Request processed in 223us (441us total) trans 8589944998 rc 0/0 00000100:00100000:3.0:1746140885.140565:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4690 00000100:00100000:0.0:1746140885.144718:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.145809:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573680384 00000100:00100000:3.0:1746140885.145820:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573680384 00000100:00100000:3.0:1746140885.145891:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10708 00000100:00100000:3.0:1746140885.145898:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:32612:x1830960573680384:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:3.0:1746140885.145948:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.145973:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3000/0x8156357b7fdb9e32 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a146b expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.145988:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.145992:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140885.146026:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.146036:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 267 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.146042:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.146072:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 267 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.146085:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 267 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.146106:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576033920:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.146200:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.147757:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.147828:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.147841:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573680640 00000100:00100000:2.0:1746140885.147848:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573680640 00002000:00100000:2.0:1746140885.147881:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f170000 x1830960573680640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140885.147882:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576033920:192.168.204.16@tcp:104: 00002000:00100000:2.0:1746140885.147891:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170000 with x1830960573680640 ext(0->1048575) 00002000:00010000:2.0:1746140885.147895:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f170000 00010000:00010000:3.0:1746140885.147899:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.147912:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8620 00000100:00100000:2.0:1746140885.147918:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573680640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140885.148361:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573680768 00000100:00100000:1.0:1746140885.148366:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573680768 00010000:00010000:1.0:1746140885.148388:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 268 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.148408:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8723 00000100:00100000:1.0:1746140885.148413:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1984:x1830960573680768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.148422:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.148428:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 268 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.148437:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 268 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.148452:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2c00/0x8156357b7fdb9f04 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14c6 expref: 268 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.148467:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.148471:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.148478:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.148484:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.148497:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.148527:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:1984:x1830960573680768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.148532:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8723 00010000:00010000:3.0:1746140885.148733:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.148740:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00010000:3.0:1746140885.148909:0:27790:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f172a00 reply state ffff880099d5f000 transno 8589944999 ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140885.148918:0:27790:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746140885.148964:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.148990:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:32612:x1830960573680384:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 3090us (4283us total) trans 8589944999 rc 0/0 00000100:00100000:3.0:1746140885.148996:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10708 00000100:00100000:0.0:1746140885.149102:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573681024 00000100:00100000:0.0:1746140885.149106:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573681024 00002000:00100000:0.0:1746140885.149127:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f170700 x1830960573681024/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.149137:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170700 with x1830960573681024 ext(1048576->2097151) 00002000:00010000:0.0:1746140885.149141:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f170700 00000100:00100000:0.0:1746140885.149154:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8621 00000100:00100000:0.0:1746140885.149160:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573681024:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.149593:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.149660:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573681280 00000100:00100000:1.0:1746140885.149664:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573681280 00002000:00100000:1.0:1746140885.149679:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800948fa300 x1830960573681280/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.149687:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fa300 with x1830960573681280 ext(1048576->2097151) 00002000:00010000:1.0:1746140885.149690:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948fa300 00000100:00100000:1.0:1746140885.149708:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8622 00000100:00100000:1.0:1746140885.149713:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573681280:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.150488:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.150538:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573681536 00000100:00100000:2.0:1746140885.150542:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573681536 00002000:00100000:2.0:1746140885.150560:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f171c00 x1830960573681536/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.150568:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171c00 with x1830960573681536 ext(1048576->2097151) 00002000:00010000:2.0:1746140885.150571:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f171c00 00000100:00100000:2.0:1746140885.150584:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8623 00000100:00100000:2.0:1746140885.150589:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1983:x1830960573681536:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.158193:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.159000:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.159274:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.159542:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573681664 00000100:00100000:2.0:1746140885.159552:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573681664 00000100:00100000:2.0:1746140885.159604:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573681920 00000100:00100000:2.0:1746140885.159607:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573681920 00000100:00100000:2.0:1746140885.159618:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573681792 00000100:00100000:2.0:1746140885.159620:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573681792 00000100:00100000:2.0:1746140885.159634:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16836 00000100:00100000:2.0:1746140885.159641:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573681664:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140885.159836:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140885.159840:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140884 -> 1746140885 00002000:00010000:2.0:1746140885.159842:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140884 -> 1746140885 00002000:00010000:2.0:1746140885.159844:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140884 -> 1746140885 00002000:00010000:2.0:1746140885.159846:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00010000:00010000:1.0:1746140885.159848:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.159858:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.159864:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.159869:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afc2600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140885.159874:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.159881:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.159896:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00000100:00100000:2.0:1746140885.159897:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573681664:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 255us (1715us total) trans 21474841362 rc 0/0 00010000:00010000:1.0:1746140885.159898:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140885.159902:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.159903:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16836 00010000:00010000:1.0:1746140885.159906:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc2600/0x8156357b7fdb9f35 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.159919:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16837 00000100:00100000:2.0:1746140885.159924:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573681920:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746140885.159930:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16838 00000100:00100000:1.0:1746140885.159938:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573681792:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746140885.160037:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140885.160039:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.160041:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.160043:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.160045:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140885.160064:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573681792:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 128us (790us total) trans 17179874083 rc 0/0 00000100:00100000:1.0:1746140885.160070:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16838 00002000:00010000:1.0:1746140885.160118:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140885.160121:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.160122:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140884 -> 1746140885 00002000:00010000:1.0:1746140885.160124:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.160126:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140885.160143:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573681920:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 218us (1144us total) trans 17179874082 rc 0/0 00000100:00100000:1.0:1746140885.160149:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16837 00000100:00100000:0.0:1746140885.162860:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.162891:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.162908:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.163161:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573682048 00000100:00100000:1.0:1746140885.163170:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573682048 00000100:00100000:1.0:1746140885.163204:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573682176 00000100:00100000:1.0:1746140885.163206:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573682176 00000100:00100000:1.0:1746140885.163214:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573682304 00000100:00100000:1.0:1746140885.163216:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573682304 00000100:00100000:1.0:1746140885.163230:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16839 00000100:00100000:1.0:1746140885.163236:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573682048:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140885.163265:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573681024:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14103us (14301us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.163273:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8621 00002000:00100000:0.0:1746140885.163282:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f170700 x1830960573681024/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.163291:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170700 with x1830960573681024 ext(1048576->2097151) 00002000:00010000:0.0:1746140885.163296:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f170700 00000100:00100000:0.0:1746140885.163353:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16840 00000100:00100000:0.0:1746140885.163360:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573682176:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746140885.163438:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:0.0:1746140885.163441:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.163443:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.163444:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140885.163445:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.163446:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140883 -> 1746140885 00002000:00010000:0.0:1746140885.163447:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00002000:00010000:1.0:1746140885.163448:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140883 -> 1746140885 00002000:00010000:1.0:1746140885.163449:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140883 -> 1746140885 00002000:00010000:1.0:1746140885.163451:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140885.163464:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573682048:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 229us (612us total) trans 21474841363 rc 0/0 00000100:00100000:0.0:1746140885.163464:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573682176:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 106us (572us total) trans 21474841364 rc 0/0 00000100:00100000:0.0:1746140885.163470:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16840 00000100:00100000:1.0:1746140885.163473:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16839 00000100:00100000:0.0:1746140885.163481:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16841 00000100:00100000:0.0:1746140885.163486:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573682304:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746140885.163573:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140885.163575:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.163577:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140884 -> 1746140885 00002000:00010000:0.0:1746140885.163579:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.163580:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746140885.163596:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573682304:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 110us (686us total) trans 17179874084 rc 0/0 00000100:00100000:0.0:1746140885.163600:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16841 00000100:00100000:0.0:1746140885.163714:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.163762:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573682560 00000100:00100000:2.0:1746140885.163767:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573682560 00000100:00100000:2.0:1746140885.163795:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10709 00000100:00100000:2.0:1746140885.163800:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32616:x1830960573682560:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140885.163813:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.163817:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746140885.163844:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdb9e1d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a145d expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.163864:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.163869:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140885.163877:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9f3c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14f7 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.163918:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.163927:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.163933:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.163956:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.163966:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 7 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.163976:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576034048:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.164070:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573680640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16151us (16315us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.164078:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8620 00002000:00100000:3.0:1746140885.164085:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f170000 x1830960573680640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.164105:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170000 with x1830960573680640 ext(0->1048575) 00002000:00010000:3.0:1746140885.164109:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f170000 00000100:00100000:2.0:1746140885.165033:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.165684:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573681280:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15968us (16089us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.165693:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8622 00002000:00100000:0.0:1746140885.165702:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800948fa300 x1830960573681280/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.165710:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fa300 with x1830960573681280 ext(1048576->2097151) 00002000:00010000:0.0:1746140885.165713:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948fa300 00000100:00100000:0.0:1746140885.167457:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.167464:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576034048:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.167487:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.169551:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573681536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18954us (19057us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.169564:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8623 00002000:00100000:2.0:1746140885.169575:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f171c00 x1830960573681536/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.169585:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171c00 with x1830960573681536 ext(1048576->2097151) 00002000:00010000:2.0:1746140885.169590:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f171c00 00000100:00100000:1.0:1746140885.169918:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573682688 00000100:00100000:0.0:1746140885.169918:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.169926:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573682688 00010000:00010000:1.0:1746140885.169955:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 8 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.169987:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8724 00000100:00100000:1.0:1746140885.169993:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573682688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.170005:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.170011:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 8 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.170022:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 8 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.170043:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afc3800/0x8156357b7fdb9e24 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1464 expref: 8 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.170060:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.170064:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.170073:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.170079:0:9847:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.170117:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573682816 00000100:00100000:2.0:1746140885.170120:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573682816 00010000:00010000:1.0:1746140885.170122:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.170141:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10710 00000100:00100000:2.0:1746140885.170147:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32612:x1830960573682816:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746140885.170147:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573682688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 156us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.170158:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8724 00010000:00010000:2.0:1746140885.170165:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.170174:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a14fe expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.170221:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.170221:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.170228:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.170229:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.170242:0:14785:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.170250:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.170260:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.170262:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140885.170264:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.170269:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f400, rc 0) 00000100:00100000:2.0:1746140885.170285:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32612:x1830960573682816:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 139us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.170289:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10710 00000100:00100000:1.0:1746140885.170851:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.170911:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573682944 00000100:00100000:2.0:1746140885.170915:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573682944 00000100:00100000:2.0:1746140885.170946:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10711 00000100:00100000:2.0:1746140885.170951:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32619:x1830960573682944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.170958:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.170966:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1505 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.170989:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.170996:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.171002:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.171004:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140885.171006:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.171011:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f800, rc 0) 00000100:00100000:2.0:1746140885.171034:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32619:x1830960573682944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.171039:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10711 00000040:00080000:3.0:1746140885.171562:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3412, 88 off288920 00000004:00080000:3.0:1746140885.171567:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247261971ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171620:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3442, 88 off291736 00000004:00080000:3.0:1746140885.171624:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864247319532ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.171647:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3443, 88 off291824 00000004:00080000:3.0:1746140885.171650:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864247345371ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.171658:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3413, 88 off289008 00000004:00080000:3.0:1746140885.171660:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247355522ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171666:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3414, 88 off289096 00000004:00080000:3.0:1746140885.171669:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247363967ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171675:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3444, 88 off291912 00000004:00080000:3.0:1746140885.171678:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864247373612ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.171685:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3445, 88 off292000 00000004:00080000:3.0:1746140885.171688:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864247383363ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.171697:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3446, 88 off292088 00000004:00080000:3.0:1746140885.171700:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864247394896ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.171706:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3415, 88 off289184 00000004:00080000:3.0:1746140885.171708:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247403601ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171766:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3447, 88 off292176 00000004:00080000:3.0:1746140885.171770:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864247465435ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.171798:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3416, 88 off289272 00000004:00080000:3.0:1746140885.171801:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247496285ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171810:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3448, 88 off292264 00000004:00080000:3.0:1746140885.171813:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864247508007ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.171820:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3417, 88 off289360 00000004:00080000:3.0:1746140885.171822:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247517760ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171829:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3418, 88 off289448 00000004:00080000:3.0:1746140885.171832:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247527315ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171839:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3419, 88 off289536 00000004:00080000:3.0:1746140885.171842:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247536797ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171849:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3420, 88 off289624 00000004:00080000:3.0:1746140885.171851:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864247546811ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.171859:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3449, 88 off292352 00000004:00080000:3.0:1746140885.171862:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864247557176ns, next at 809142599738ns, rc = 0 00000100:00100000:1.0:1746140885.180737:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.181461:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573683200 00000100:00100000:0.0:1746140885.181469:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573683200 00000100:00100000:0.0:1746140885.181512:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10712 00000100:00100000:0.0:1746140885.181519:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32622:x1830960573683200:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140885.181540:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.181558:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66e00/0x8156357b7fdb9f58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a150c expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.181676:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181688:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181696:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181705:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181709:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181713:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181797:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181801:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181805:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140885.181811:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140885.181902:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181906:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181910:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181913:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140885.181916:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181920:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181927:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.181928:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140885.181931:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181937:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdb9f6d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181945:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181948:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181954:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181957:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140885.181958:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181961:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181974:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140885.181975:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140885.181977:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181979:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9f5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181983:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181986:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181989:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181992:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140885.181993:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181996:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.181998:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4de00) 00010000:00010000:0.0:1746140885.181999:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140885.182000:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.182002:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdb9f66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.182025:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66e00/0x8156357b7fdb9f58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a150c expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.182029:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66e00/0x8156357b7fdb9f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a150c expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.182033:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66e00, rc 0) 00000100:00100000:0.0:1746140885.182089:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32622:x1830960573683200:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 570us (1361us total) trans 8589945001 rc 301/301 00000100:00100000:0.0:1746140885.182104:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10712 00000001:00080000:1.0:1746140885.189606:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944996 is committed 00000001:00080000:1.0:1746140885.189619:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945000 is committed 00000004:00080000:1.0:1746140885.189624:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2692 committed 00010000:00010000:3.0:1746140885.189632:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.189646:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.189648:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746140885.189653:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.189663:0:27790:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.189670:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.189678:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.189684:0:27790:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.189689:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.189726:0:27790:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.189743:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576034176:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140885.189827:0:27790:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.189836:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576034304:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140885.189852:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530840 going to sleep for 11 seconds 00000004:00080000:1.0:1746140885.189876:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2666 committed 00000004:00080000:1.0:1746140885.189883:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2665 committed 00000004:00080000:1.0:1746140885.189885:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2664 committed 00000004:00080000:1.0:1746140885.189886:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2663 committed 00000004:00080000:1.0:1746140885.189889:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2691 committed 00000004:00080000:1.0:1746140885.189890:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2662 committed 00000004:00080000:1.0:1746140885.189895:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2690 committed 00000004:00080000:1.0:1746140885.189897:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2661 committed 00000004:00080000:1.0:1746140885.189898:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2689 committed 00000004:00080000:1.0:1746140885.189900:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2688 committed 00000004:00080000:1.0:1746140885.189901:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2687 committed 00000004:00080000:1.0:1746140885.189902:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2660 committed 00000004:00080000:1.0:1746140885.189904:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2659 committed 00000004:00080000:1.0:1746140885.189906:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2686 committed 00000004:00080000:1.0:1746140885.189907:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2685 committed 00000004:00080000:1.0:1746140885.189910:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2658 committed 00000001:00080000:1.0:1746140885.189914:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944999 is committed 00000001:00080000:1.0:1746140885.189921:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944997 is committed 00000100:00100000:1.0:1746140885.190129:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576034432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.190166:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.190186:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576034944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.190187:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576034432 00000100:00100000:0.0:1746140885.190195:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576034432 00000100:00100000:1.0:1746140885.190201:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.190210:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576035456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.190224:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140885.190226:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576034944 00000100:00100000:0.0:1746140885.190227:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576034944 00000100:00100000:1.0:1746140885.190234:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576035968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.190236:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576035456 00000100:00100000:0.0:1746140885.190238:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576035456 00000100:00100000:1.0:1746140885.190246:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.190260:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746140885.190264:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576034560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.190277:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140885.190281:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576035968 00000100:00100000:0.0:1746140885.190283:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576035968 00000100:00100000:0.0:1746140885.190302:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16842 00000100:00100000:0.0:1746140885.190330:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3310:x1830960576034432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140885.190507:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140885.190509:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.190511:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.190513:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.190515:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140885.190543:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3310:x1830960576034432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (377us total) trans 17179874085 rc 0/0 00000100:00100000:0.0:1746140885.190548:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16842 00000100:00100000:0.0:1746140885.190563:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16843 00000100:00100000:0.0:1746140885.190567:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3310:x1830960576034944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.190647:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3310:x1830960576034944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (443us total) trans 17179874086 rc 0/0 00000100:00100000:0.0:1746140885.190652:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16843 00000100:00100000:0.0:1746140885.190660:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16844 00000100:00100000:0.0:1746140885.190664:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960576035456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.190731:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16845 00000100:00100000:2.0:1746140885.190737:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960576035968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.190748:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576034816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.190848:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3310:x1830960576035968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (600us total) trans 21474841365 rc 0/0 00000100:00100000:2.0:1746140885.190853:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16845 00000100:00100000:1.0:1746140885.190937:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576035072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.190944:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.190957:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.190958:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576035328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.190973:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.190973:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576035584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.190980:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013569a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576035840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.190990:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.190995:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576034560 00000100:00100000:3.0:1746140885.190997:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576034560 00000100:00100000:1.0:1746140885.191004:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013569a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576036096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.191012:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576034816 00000100:00100000:3.0:1746140885.191013:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576034816 00000100:00100000:3.0:1746140885.191019:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576035072 00000100:00100000:1.0:1746140885.191019:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.191021:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576035072 00000100:00100000:3.0:1746140885.191028:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576035328 00000100:00100000:3.0:1746140885.191029:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576035328 00000100:00100000:3.0:1746140885.191033:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576035584 00000100:00100000:3.0:1746140885.191034:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576035584 00000100:00100000:3.0:1746140885.191038:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576036096 00000100:00100000:3.0:1746140885.191038:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576036096 00000100:00100000:3.0:1746140885.191043:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16846 00000100:00100000:3.0:1746140885.191046:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3310:x1830960576034560:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.191047:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f519f80/2, rc 0, transno 17179874085 00000100:00100000:1.0:1746140885.191052:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576034432:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.191059:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece3b80/2, rc 0, transno 17179874086 00000100:00100000:1.0:1746140885.191062:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576034944:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.191069:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135699c00/2, rc 0, transno 21474841365 00000100:00100000:1.0:1746140885.191075:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576035968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.191104:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576034688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.191112:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16847 00000100:00100000:2.0:1746140885.191117:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3313:x1830960576034816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.191124:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746140885.191130:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140885.191133:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:3.0:1746140885.191134:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00000100:00100000:1.0:1746140885.191134:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576035200:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746140885.191135:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:3.0:1746140885.191137:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140885.191146:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.191154:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576035712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.191158:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3310:x1830960576034560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (880us total) trans 17179874087 rc 0/0 00000100:00100000:3.0:1746140885.191162:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16846 00000100:00100000:1.0:1746140885.191166:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.191169:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576034688 00000100:00100000:3.0:1746140885.191170:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576034688 00000100:00100000:1.0:1746140885.191173:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576036224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.191175:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576035200 00000100:00100000:3.0:1746140885.191176:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576035200 00000100:00100000:3.0:1746140885.191180:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576035712 00000100:00100000:3.0:1746140885.191181:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576035712 00000100:00100000:1.0:1746140885.191185:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.191186:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16848 00000100:00100000:3.0:1746140885.191188:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3310:x1830960576035072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.191201:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3313:x1830960576034816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (256us total) trans 17179874088 rc 0/0 00000100:00100000:1.0:1746140885.191204:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576036224 00000100:00100000:2.0:1746140885.191206:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16847 00000100:00100000:1.0:1746140885.191207:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576036224 00000100:00100000:2.0:1746140885.191215:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16849 00000100:00100000:2.0:1746140885.191219:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3313:x1830960576035328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.191222:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16850 00000100:00100000:1.0:1746140885.191227:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+64:3310:x1830960576035584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.191243:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3310:x1830960576035072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (285us total) trans 17179874089 rc 0/0 00000100:00100000:3.0:1746140885.191246:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16848 00000100:00100000:3.0:1746140885.191252:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16851 00000100:00100000:3.0:1746140885.191254:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3310:x1830960576036096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.191282:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3313:x1830960576035328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (308us total) trans 17179874090 rc 0/0 00000100:00100000:2.0:1746140885.191287:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16849 00000100:00100000:2.0:1746140885.191294:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16852 00000100:00100000:2.0:1746140885.191298:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3312:x1830960576034688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.191334:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16853 00000100:00100000:1.0:1746140885.191339:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3312:x1830960576035200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140885.191371:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746140885.191373:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.191375:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.191377:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.191378:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746140885.191397:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3312:x1830960576034688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (273us total) trans 17179874091 rc 0/0 00000100:00100000:2.0:1746140885.191401:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16852 00000100:00100000:2.0:1746140885.191409:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16854 00000100:00100000:2.0:1746140885.191412:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:3312:x1830960576035712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.191422:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16855 00000100:00100000:2.0:1746140885.191425:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3312:x1830960576036224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.191433:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3312:x1830960576035200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (284us total) trans 17179874092 rc 0/0 00000100:00100000:1.0:1746140885.191439:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16853 00000100:00100000:3.0:1746140885.191454:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3310:x1830960576036096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (433us total) trans 21474841367 rc 0/0 00000100:00100000:3.0:1746140885.191459:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16851 00000100:00100000:1.0:1746140885.191474:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746140885.191480:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576036480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.191487:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.191500:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.191503:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576036352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.191515:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3312:x1830960576036224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (328us total) trans 21474841368 rc 0/0 00000100:00100000:3.0:1746140885.191521:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746140885.191522:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf12680/2, rc 0, transno 17179874091 00000100:00100000:2.0:1746140885.191523:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16855 00000100:00100000:1.0:1746140885.191525:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576034688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.191531:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576035840 00000004:00080000:1.0:1746140885.191531:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece1880/2, rc 0, transno 17179874092 00000100:00100000:2.0:1746140885.191534:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576035840 00000100:00100000:1.0:1746140885.191534:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576035200:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.191540:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135699500/2, rc 0, transno 21474841368 00000100:00100000:1.0:1746140885.191542:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576036224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140885.191543:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece1500/2, rc 0, transno 17179874088 00000100:00100000:2.0:1746140885.191546:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576036480 00000100:00100000:3.0:1746140885.191547:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576034816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.191548:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576036480 00000004:00080000:3.0:1746140885.191553:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece0380/2, rc 0, transno 17179874090 00000100:00100000:3.0:1746140885.191555:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576035328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.191556:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576036352 00000100:00100000:2.0:1746140885.191558:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576036352 00002000:00010000:1.0:1746140885.191562:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140885.191564:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00000100:00100000:2.0:1746140885.191565:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16856 00002000:00010000:1.0:1746140885.191566:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00000100:00100000:2.0:1746140885.191568:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3313:x1830960576035840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140885.191568:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00000100:00100000:3.0:1746140885.191569:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16857 00002000:00010000:1.0:1746140885.191570:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140885.191574:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3311:x1830960576036480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.191589:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+68:3310:x1830960576035584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 362us (598us total) trans 21474841366 rc 0/0 00000100:00100000:1.0:1746140885.191594:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16850 00000100:00100000:1.0:1746140885.191604:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16858 00000100:00100000:1.0:1746140885.191608:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+67:3313:x1830960576036352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.191666:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:3313:x1830960576035840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (177us total) trans 21474841369 rc 0/0 00000100:00100000:2.0:1746140885.191670:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16856 00000004:00080000:3.0:1746140885.191677:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013569a300/2, rc 0, transno 21474841369 00000100:00100000:3.0:1746140885.191681:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013569a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576035840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.191684:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+69:3313:x1830960576036352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (161us total) trans 21474841371 rc 0/0 00000004:00080000:3.0:1746140885.191689:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135698380/2, rc 0, transno 21474841371 00000100:00100000:3.0:1746140885.191691:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576036352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.191692:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16858 00000100:00100000:3.0:1746140885.191733:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3311:x1830960576036480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (232us total) trans 21474841370 rc 0/0 00000100:00100000:3.0:1746140885.191737:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16857 00002000:00010000:2.0:1746140885.191747:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:2.0:1746140885.191749:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.191751:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.191753:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.191755:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00000004:00080000:3.0:1746140885.191757:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b66680/2, rc 0, transno 21474841370 00000100:00100000:3.0:1746140885.191764:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576036480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.191776:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3312:x1830960576035712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 363us (608us total) trans 21474841372 rc 0/0 00000004:00080000:1.0:1746140885.191778:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf13800/2, rc 0, transno 17179874087 00000100:00100000:2.0:1746140885.191781:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16854 00000100:00100000:1.0:1746140885.191782:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576034560:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.191787:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece2680/2, rc 0, transno 17179874089 00000100:00100000:1.0:1746140885.191789:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576035072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.191795:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece0000/2, rc 0, transno 21474841366 00000100:00100000:1.0:1746140885.191797:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576035584:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140885.191802:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013569a680/2, rc 0, transno 21474841367 00000100:00100000:1.0:1746140885.191804:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013569a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576036096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140885.191813:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135699880/2, rc 0, transno 21474841372 00000100:00100000:1.0:1746140885.191815:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576035712:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140885.192264:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140885.192268:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.192270:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.192272:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.192273:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140885.192317:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3310:x1830960576035456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1639us (2078us total) trans 21474841373 rc 0/0 00000100:00100000:0.0:1746140885.192323:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16844 00000100:00100000:1.0:1746140885.192890:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.192972:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00080000:1.0:1746140885.193003:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece0a80/2, rc 0, transno 21474841373 00000100:00100000:1.0:1746140885.193007:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576035456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.193010:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576034176:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140885.193020:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576034304:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140885.193054:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9f3c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 8 pid: 27790 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746140885.193070:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 7 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.193109:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e400, rc 0) 00000100:00100000:3.0:1746140885.193149:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32616:x1830960573682560:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 29348us (29435us total) trans 8589945000 rc 0/0 00000100:00100000:3.0:1746140885.193156:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10709 00000100:00100000:3.0:1746140885.193179:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573683328 00000100:00100000:3.0:1746140885.193183:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573683328 00000100:00100000:3.0:1746140885.193201:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573683456 00000100:00100000:3.0:1746140885.193203:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573683456 00000100:00100000:3.0:1746140885.193227:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4691 00000100:00100000:3.0:1746140885.193232:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32619:x1830960573683328:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:3.0:1746140885.193292:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32619:x1830960573683328:12345-192.168.204.16@tcp:49:cat.0 Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.193297:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4691 00000100:00100000:3.0:1746140885.193325:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4692 00000100:00100000:3.0:1746140885.193329:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32612:x1830960573683456:12345-192.168.204.16@tcp:49:lfs.0 00000100:00100000:3.0:1746140885.193360:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32612:x1830960573683456:12345-192.168.204.16@tcp:49:lfs.0 Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.193365:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4692 00000100:00100000:0.0:1746140885.195460:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.195607:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573683584 00000100:00100000:2.0:1746140885.195615:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573683584 00000100:00100000:2.0:1746140885.195651:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16859 00000100:00100000:2.0:1746140885.195658:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573683584:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140885.195811:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140885.195815:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.195817:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.195819:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.195820:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140885.195871:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573683584:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 212us (417us total) trans 21474841374 rc 0/0 00000100:00100000:2.0:1746140885.195878:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16859 00000100:00100000:0.0:1746140885.197021:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.197190:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573683712 00000100:00100000:2.0:1746140885.197195:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573683712 00000100:00100000:2.0:1746140885.197231:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16860 00000100:00100000:2.0:1746140885.197238:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573683712:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140885.197386:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140885.197389:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.197391:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.197393:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.197395:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140885.197438:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573683712:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 199us (418us total) trans 17179874093 rc 0/0 00000100:00100000:2.0:1746140885.197448:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16860 00000100:00100000:0.0:1746140885.199149:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.199186:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.199273:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573683840 00000100:00100000:2.0:1746140885.199280:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573683840 00000100:00100000:3.0:1746140885.199284:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573683968 00000100:00100000:3.0:1746140885.199288:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573683968 00000100:00100000:3.0:1746140885.199337:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16861 00000100:00100000:2.0:1746140885.199343:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16862 00000100:00100000:3.0:1746140885.199344:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573683840:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:2.0:1746140885.199349:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573683968:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140885.199369:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.199382:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573684096 00000100:00100000:1.0:1746140885.199386:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573684096 00000100:00100000:0.0:1746140885.199392:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.199406:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573684224 00000100:00100000:1.0:1746140885.199407:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573684224 00000100:00100000:1.0:1746140885.199419:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16863 00000100:00100000:1.0:1746140885.199424:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573684096:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140885.199432:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16864 00000100:00100000:0.0:1746140885.199440:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573684224:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140885.199459:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140885.199461:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.199462:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.199463:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:2.0:1746140885.199465:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746140885.199473:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140885.199476:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:3.0:1746140885.199477:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:3.0:1746140885.199479:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:3.0:1746140885.199481:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140885.199494:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573683968:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 145us (307us total) trans 21474841375 rc 0/0 00000100:00100000:2.0:1746140885.199498:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16862 00000100:00100000:3.0:1746140885.199502:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573683840:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 159us (359us total) trans 17179874094 rc 0/0 00002000:00010000:1.0:1746140885.199506:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00000100:00100000:3.0:1746140885.199508:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16861 00002000:00010000:1.0:1746140885.199509:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.199511:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.199512:0:4785:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746140885.199514:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.199515:0:4785:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140885 -> 1746140885 00002000:00010000:1.0:1746140885.199516:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00002000:00010000:0.0:1746140885.199516:0:4785:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.199518:0:4785:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.199519:0:4785:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746140885.199534:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573684096:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 109us (165us total) trans 21474841376 rc 0/0 00000100:00100000:0.0:1746140885.199537:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573684224:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 99us (143us total) trans 17179874095 rc 0/0 00000100:00100000:1.0:1746140885.199540:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16863 00000100:00100000:0.0:1746140885.199544:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16864 00000100:00100000:0.0:1746140885.200439:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.200489:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573684480 00000100:00100000:2.0:1746140885.200494:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573684480 00002000:00100000:2.0:1746140885.200524:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b754a80 x1830960573684480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.200534:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754a80 with x1830960573684480 ext(1048576->2097151) 00002000:00010000:2.0:1746140885.200539:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754a80 00000100:00100000:2.0:1746140885.200628:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8624 00000100:00100000:2.0:1746140885.200637:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573684480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.201001:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.201054:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573684736 00000100:00100000:3.0:1746140885.201058:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573684736 00000100:00100000:0.0:1746140885.201062:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.201104:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4693 00000100:00100000:3.0:1746140885.201110:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a840050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:32612:x1830960573684736:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746140885.201261:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a840050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:32612:x1830960573684736:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 151us (260us total) trans 8589945002 rc 0/0 00000100:00100000:3.0:1746140885.201267:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4693 00000100:00100000:3.0:1746140885.201333:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573684864 00000100:00100000:3.0:1746140885.201336:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573684864 00000100:00100000:3.0:1746140885.201353:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16865 00000100:00100000:3.0:1746140885.201357:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32616:x1830960573684864:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140885.201366:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.201380:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1513 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.201403:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 19 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.201411:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 37 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.201418:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 13 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.201429:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.201430:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.201433:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [4059136->4194303] (req 4059136->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.201459:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 13 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.201471:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 13 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.201482:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576036608:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.201551:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 37 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.201559:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 37 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.201567:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576036736:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.201596:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 19 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.201603:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 19 pid: 4784 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.201615:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576036864:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.201636:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.202351:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.202535:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573685120 00000100:00100000:3.0:1746140885.202539:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573685120 00000100:00100000:3.0:1746140885.202582:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4694 00000100:00100000:3.0:1746140885.202588:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:32612:x1830960573685120:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1746140885.202676:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.202694:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:32612:x1830960573685120:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 106us (344us total) trans 8589945003 rc 0/0 00000100:00100000:3.0:1746140885.202700:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4694 00000100:00100000:3.0:1746140885.202733:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576036608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.202741:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576036736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.202741:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.202757:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573685248 00000100:00100000:0.0:1746140885.202759:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573685248 00010000:00010000:0.0:1746140885.202777:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 38 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.202795:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573685376 00000100:00100000:0.0:1746140885.202797:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573685376 00000100:00100000:1.0:1746140885.202803:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8725 00010000:00010000:0.0:1746140885.202805:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 14 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.202812:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573685248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140885.202819:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8726 00010000:00010000:1.0:1746140885.202821:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140885.202824:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573685376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.202830:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.202838:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 38 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.202838:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 14 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.202845:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 14 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.202925:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 38 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.202944:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009afc3c00/0x8156357b7fdb9f2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f0 expref: 38 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.202955:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.202977:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573685248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 167us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.202983:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8725 00010000:00010000:0.0:1746140885.203009:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec66400/0x8156357b7fdb9e5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1495 expref: 14 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.203018:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.203033:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573685376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 209us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.203039:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8726 00000100:00100000:3.0:1746140885.206060:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576036864:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.206114:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [4059136->4194303] (req 4059136->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.206131:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ba4fc00, rc 0) 00000100:00100000:3.0:1746140885.206187:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+19:32616:x1830960573684864:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4827us (5122us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.206195:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16865 00000100:00100000:0.0:1746140885.211605:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.211649:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573685504 00000100:00100000:2.0:1746140885.211659:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573685504 00010000:00010000:2.0:1746140885.211698:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 19 pid: 4784 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.211735:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8727 00000100:00100000:2.0:1746140885.211741:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573685504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.211753:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.211775:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 19 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.211787:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 19 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.211817:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009afc2400/0x8156357b7fdb9e08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a144f expref: 19 pid: 4784 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.211830:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.211832:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.211839:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 18 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.211847:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 18 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.211881:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 18 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.211893:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576036992:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.211980:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.212713:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573684480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12077us (12274us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.212723:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8624 00002000:00100000:3.0:1746140885.212733:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b754a80 x1830960573684480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.212742:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754a80 with x1830960573684480 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.212747:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754a80 00000100:00100000:2.0:1746140885.214606:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576036992:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.214630:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.214675:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573685504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2933us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.214685:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8727 00000100:00100000:0.0:1746140885.216116:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.216273:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573685760 00000100:00100000:3.0:1746140885.216281:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573685760 00002000:00100000:3.0:1746140885.216353:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (4059136->4063231) req@ffff88009b756300 x1830960573685760/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.216362:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756300 with x1830960573685760 ext(4059136->4063231) 00002000:00010000:3.0:1746140885.216368:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756300 00000100:00100000:3.0:1746140885.216390:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8625 00000100:00100000:3.0:1746140885.216397:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573685760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140885.216558:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573685760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 161us (443us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140885.216564:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8625 00002000:00100000:3.0:1746140885.216569:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (4059136->4063231) req@ffff88009b756300 x1830960573685760/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.216577:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756300 with x1830960573685760 ext(4059136->4063231) 00002000:00010000:3.0:1746140885.216580:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756300 00000100:00100000:0.0:1746140885.224180:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.224293:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.224424:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573686016 00000100:00100000:3.0:1746140885.224434:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573686016 00000100:00100000:2.0:1746140885.224447:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573686144 00000100:00100000:2.0:1746140885.224452:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573686144 00002000:00100000:3.0:1746140885.224478:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880093130380 x1830960573686016/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140885.224485:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16866 00002000:00100000:3.0:1746140885.224489:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130380 with x1830960573686016 ext(1048576->2097151) 00000100:00100000:2.0:1746140885.224493:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32616:x1830960573686144:12345-192.168.204.16@tcp:101:multiop.0 00002000:00010000:3.0:1746140885.224495:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130380 00010000:00010000:2.0:1746140885.224511:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140885.224521:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8626 00000100:00100000:3.0:1746140885.224526:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1982:x1830960573686016:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140885.224529:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a151a expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.224554:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 23 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.224563:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 26 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.224570:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 13 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.224577:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.224579:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.224582:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4509695] (req 4194304->4509695) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 23 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.224611:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 13 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.224795:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 13 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.224813:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576037120:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.224936:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 26 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.224949:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 26 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.224957:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576037248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.224982:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 23 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.224989:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 23 pid: 4785 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.224996:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576037376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.225009:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.230956:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.230987:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.231018:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.231217:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576037120:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.231226:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573686400 00000100:00100000:2.0:1746140885.231227:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576037248:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.231233:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573686400 00000100:00100000:2.0:1746140885.231233:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576037376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.231265:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->4509695] (req 4194304->4509695) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.231281:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ee00, rc 0) 00000100:00100000:2.0:1746140885.231358:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+24:32616:x1830960573686144:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6865us (7066us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.231366:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16866 00010000:00010000:3.0:1746140885.231481:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 23 pid: 4785 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.231502:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573686272 00000100:00100000:3.0:1746140885.231505:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573686272 00000100:00100000:2.0:1746140885.231520:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573686528 00000100:00100000:2.0:1746140885.231526:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573686528 00010000:00010000:2.0:1746140885.231544:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 27 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.231570:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8728 00000100:00100000:2.0:1746140885.231578:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573686400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140885.231612:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8729 00000100:00100000:1.0:1746140885.231630:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573686528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.231678:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 14 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.231697:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8730 00000100:00100000:3.0:1746140885.231703:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573686272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.232183:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.232183:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.232184:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.232209:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 14 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.232212:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 23 pid: 4785 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.232212:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 27 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.232220:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 14 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.232231:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 27 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.232242:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 23 pid: 4785 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.232263:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009afc3600/0x8156357b7fdb9e47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a148e expref: 14 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.232275:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009afc2e00/0x8156357b7fdb9f27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e9 expref: 27 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.232280:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a62da00/0x8156357b7fdb9e16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1456 expref: 23 pid: 4785 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.232282:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.232284:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.232290:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 22 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.232299:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 22 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.232332:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140885.232332:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140885.232349:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 22 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.232360:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576037504:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.232376:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573686400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 798us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.232376:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960573686528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 754us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.232383:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8728 00000100:00100000:1.0:1746140885.232386:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8729 00000100:00100000:3.0:1746140885.232415:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530780 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.233214:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1982:x1830960573686016:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8686us (9044us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.233222:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8626 00002000:00100000:3.0:1746140885.233230:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880093130380 x1830960573686016/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.233238:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130380 with x1830960573686016 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.233242:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130380 00000100:00100000:3.0:1746140885.235826:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576037504:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140885.235848:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.235911:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573686272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4206us (4921us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.235921:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8730 00000100:00100000:0.0:1746140885.236872:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.237153:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573686784 00000100:00100000:3.0:1746140885.237160:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573686784 00002000:00100000:3.0:1746140885.237195:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (4505600->4509695) req@ffff88012b069f80 x1830960573686784/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.237204:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069f80 with x1830960573686784 ext(4505600->4509695) 00002000:00010000:3.0:1746140885.237208:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b069f80 00000100:00100000:3.0:1746140885.237238:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8627 00000100:00100000:3.0:1746140885.237244:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573686784:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140885.237401:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573686784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 157us (536us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140885.237407:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8627 00002000:00100000:3.0:1746140885.237411:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (4505600->4509695) req@ffff88012b069f80 x1830960573686784/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.237418:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069f80 with x1830960573686784 ext(4505600->4509695) 00002000:00010000:3.0:1746140885.237421:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b069f80 00000100:00100000:0.0:1746140885.241573:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.241641:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573687040 00000100:00100000:3.0:1746140885.241650:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573687040 00000100:00100000:0.0:1746140885.241652:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746140885.241716:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012b06ad80 x1830960573687040/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.241725:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06ad80 with x1830960573687040 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.241731:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b06ad80 00000100:00100000:2.0:1746140885.241914:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573687296 00000100:00100000:2.0:1746140885.241919:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573687296 00000100:00100000:3.0:1746140885.242039:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8628 00000100:00100000:3.0:1746140885.242047:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1983:x1830960573687040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.242104:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4695 00000100:00100000:2.0:1746140885.242115:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32616:x1830960573687296:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140885.242473:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32616:x1830960573687296:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 360us (821us total) trans 8589945004 rc 0/0 00000100:00100000:2.0:1746140885.242484:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4695 00000100:00100000:3.0:1746140885.250651:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1983:x1830960573687040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8595us (9075us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.250662:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8628 00002000:00100000:3.0:1746140885.250674:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012b06ad80 x1830960573687040/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.250683:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06ad80 with x1830960573687040 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.250688:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b06ad80 00000100:00100000:1.0:1746140885.259492:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.259561:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.259663:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573687424 00000100:00100000:2.0:1746140885.259671:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573687424 00000100:00100000:2.0:1746140885.259784:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573687552 00000100:00100000:2.0:1746140885.259787:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573687552 00000100:00100000:0.0:1746140885.259876:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16867 00000100:00100000:2.0:1746140885.259887:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16868 00000100:00100000:2.0:1746140885.259895:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1982:x1830960573687552:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140885.259895:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573687424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.259911:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.259916:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.259928:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdb9f89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1528 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.259933:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7200/0x8156357b7fdb9f90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1521 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.259976:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576037632:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140885.259986:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576037760:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.260804:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.260828:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.262267:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576037632:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140885.262277:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576037760:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.262298:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdb9f89 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1528 expref: 36 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.262298:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7200/0x8156357b7fdb9f90 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1521 expref: 27 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.262328:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdb9f89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1528 expref: 36 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.262328:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7200/0x8156357b7fdb9f90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1521 expref: 27 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.262351:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb7200, rc 0) 00010000:00010000:2.0:1746140885.262352:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ea00, rc 0) 00000100:00100000:1.0:1746140885.262390:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573687424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2504us (2905us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140885.262398:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16867 00000100:00100000:2.0:1746140885.262461:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1982:x1830960573687552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2567us (2899us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140885.262467:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16868 00000100:00100000:0.0:1746140885.263919:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.263979:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573687680 00000100:00100000:2.0:1746140885.263987:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573687680 00000100:00100000:2.0:1746140885.264028:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16869 00000100:00100000:2.0:1746140885.264034:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:32619:x1830960573687680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.264049:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.264063:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a152f expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.264089:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 21 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.264110:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.264112:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.264115:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.264143:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 21 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.264156:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 21 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.264167:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576037888:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.264253:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.269232:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576037888:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.269267:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.269292:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f000, rc 0) 00000100:00100000:2.0:1746140885.269374:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:32619:x1830960573687680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5338us (5457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.269383:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16869 00000100:00100000:0.0:1746140885.271273:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.271399:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573687808 00000100:00100000:3.0:1746140885.271408:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573687808 00002000:00100000:3.0:1746140885.271450:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4509695) req@ffff88012b06b480 x1830960573687808/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.271458:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06b480 with x1830960573687808 ext(4194304->4509695) 00010000:00010000:3.0:1746140885.271467:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 22 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.271481:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 22 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.271486:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b06b480 00000100:00100000:3.0:1746140885.271584:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1786 00000100:00100000:3.0:1746140885.271592:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573687808:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140885.278017:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573687808:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6412us (6736us total) trans 21474841377 rc 0/0 00000100:00100000:2.0:1746140885.278032:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1786 00002000:00100000:2.0:1746140885.278043:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4509695) req@ffff88012b06b480 x1830960573687808/t21474841377(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.278054:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06b480 with x1830960573687808 ext(4194304->4509695) 00010000:00010000:2.0:1746140885.278063:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 24 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.278080:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 24 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:2.0:1746140885.278088:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b06b480 00000100:00100000:0.0:1746140885.280709:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.280933:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573687936 00000100:00100000:3.0:1746140885.280942:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573687936 00010000:00010000:3.0:1746140885.280974:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 24 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.281011:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8731 00000100:00100000:3.0:1746140885.281017:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573687936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.281033:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.281054:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 24 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.281065:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 24 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.281086:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdb9f82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a151a expref: 24 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.281127:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.281130:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.281137:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.281144:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.281177:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.281187:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576038016:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140885.281269:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.282715:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576038016:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140885.282729:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.282766:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573687936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1748us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.282775:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8731 00000100:00100000:0.0:1746140885.285532:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.286846:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573688192 00000100:00100000:2.0:1746140885.286856:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573688192 00002000:00100000:2.0:1746140885.286905:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88012b068000 x1830960573688192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.286915:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068000 with x1830960573688192 ext(2097152->3145727) 00002000:00010000:2.0:1746140885.286921:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b068000 00000100:00100000:2.0:1746140885.286940:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8629 00000100:00100000:2.0:1746140885.286949:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573688192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.294945:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.295021:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573688320 00000100:00100000:2.0:1746140885.295031:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573688320 00000100:00100000:2.0:1746140885.295086:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16870 00000100:00100000:2.0:1746140885.295106:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:32622:x1830960573688320:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140885.295123:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.295139:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1536 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.295168:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.295178:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 30 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.295184:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.295189:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.295191:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.295194:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.295221:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.295232:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 22 pid: 4782 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.295244:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576038144:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.295363:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 30 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.295371:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 30 pid: 8460 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.295378:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576038272:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.295403:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.295410:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 12 pid: 32376 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.295418:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576038400:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.295437:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.296706:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576038144:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.296717:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576038272:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.296723:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576038400:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.296746:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.296767:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ec00, rc 0) 00000100:00100000:2.0:1746140885.296797:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:32622:x1830960573688320:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1704us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.296805:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16870 00000100:00100000:0.0:1746140885.297236:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.297447:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573688448 00000100:00100000:3.0:1746140885.297452:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573688448 00010000:00010000:3.0:1746140885.297474:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 23 pid: 4782 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.297497:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8732 00000100:00100000:3.0:1746140885.297501:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573688448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.297509:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.297527:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 23 pid: 4782 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.297534:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 23 pid: 4782 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.297549:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009afc2000/0x8156357b7fdb9ee8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14bf expref: 23 pid: 4782 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.297559:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.297574:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573688448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.297578:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8732 00000100:00100000:0.0:1746140885.297638:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.297684:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.297771:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573688704 00000100:00100000:2.0:1746140885.297775:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573688704 00000100:00100000:3.0:1746140885.297777:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573688576 00000100:00100000:3.0:1746140885.297781:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573688576 00010000:00010000:2.0:1746140885.297789:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 30 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.297793:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 13 pid: 32376 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.297869:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8733 00000100:00100000:2.0:1746140885.297876:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573688704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.297884:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.297893:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 30 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.297902:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 30 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.297914:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009afc3a00/0x8156357b7fdb9f20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14e2 expref: 30 pid: 8460 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.297927:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.297946:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573688704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.297951:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8733 00000100:00100000:2.0:1746140885.297962:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8734 00000100:00100000:2.0:1746140885.297966:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573688576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.297972:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.297978:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 13 pid: 32376 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.297986:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 13 pid: 32376 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.297997:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bea200/0x8156357b7fdb9e55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1487 expref: 13 pid: 32376 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.298004:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.298006:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.298011:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 28 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.298018:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 28 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.298040:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 28 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.298049:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576038528:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.298103:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.299603:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573688192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12651us (14074us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.299614:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8629 00002000:00100000:3.0:1746140885.299623:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88012b068000 x1830960573688192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.299632:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068000 with x1830960573688192 ext(2097152->3145727) 00002000:00010000:3.0:1746140885.299636:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b068000 00000100:00100000:0.0:1746140885.299774:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.299829:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573688960 00000100:00100000:3.0:1746140885.299835:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573688960 00002000:00100000:3.0:1746140885.299860:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a2:0x0] (1789952->1794047) req@ffff88009edc9c00 x1830960573688960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.299867:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9c00 with x1830960573688960 ext(1789952->1794047) 00002000:00010000:3.0:1746140885.299871:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9c00 00000100:00100000:3.0:1746140885.299933:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8630 00000100:00100000:3.0:1746140885.299940:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573688960:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140885.300068:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576038528:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140885.300073:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573688960:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 134us (300us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140885.300078:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8630 00002000:00100000:3.0:1746140885.300082:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a2:0x0] (1789952->1794047) req@ffff88009edc9c00 x1830960573688960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746140885.300085:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746140885.300089:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9c00 with x1830960573688960 ext(1789952->1794047) 00002000:00010000:3.0:1746140885.300102:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc9c00 00000100:00100000:2.0:1746140885.300125:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573688576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2157us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.300132:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8734 00000100:00100000:0.0:1746140885.302944:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.303039:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573689088 00000100:00100000:2.0:1746140885.303049:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573689088 00000100:00100000:2.0:1746140885.303110:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16871 00000100:00100000:2.0:1746140885.303118:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:32619:x1830960573689088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.303134:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.303152:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a153d expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.303181:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 17 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.303187:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.303189:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.303193:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.303407:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 17 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.303418:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140885.303420:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 17 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.303453:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573689216 00000100:00100000:1.0:1746140885.303457:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573689216 00000100:00100000:1.0:1746140885.303488:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16872 00000100:00100000:1.0:1746140885.303493:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:32622:x1830960573689216:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140885.303501:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.303510:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1544 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.303537:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576038656:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140885.303595:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 28 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.303602:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.303603:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.303606:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->2658303] (req 2097152->2658303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 28 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.303625:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 28 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.303632:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 28 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.303641:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576038784:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.303750:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140885.303827:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140885.304802:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576038784:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140885.304827:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->2658303] (req 2097152->2658303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 28 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.304842:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136977c00, rc 0) 00000100:00100000:1.0:1746140885.304886:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:32622:x1830960573689216:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1391us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.304893:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16872 00000100:00100000:3.0:1746140885.305205:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576038656:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.305220:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.305228:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e600, rc 0) 00000100:00100000:3.0:1746140885.305261:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32619:x1830960573689088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2145us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.305268:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16871 00000100:00100000:0.0:1746140885.305442:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.305530:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573689344 00000100:00100000:3.0:1746140885.305534:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573689344 00002000:00100000:3.0:1746140885.305561:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (4059136->4194303) req@ffff88009edc8a80 x1830960573689344/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.305569:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8a80 with x1830960573689344 ext(4059136->4194303) 00010000:00010000:3.0:1746140885.305575:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 18 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.305584:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 18 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.305590:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc8a80 00000100:00100000:3.0:1746140885.305614:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1787 00000100:00100000:3.0:1746140885.305620:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573689344:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140885.306221:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.306401:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573689472 00000100:00100000:2.0:1746140885.306406:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573689472 00010000:00010000:2.0:1746140885.306428:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 28 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.306461:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8735 00000100:00100000:2.0:1746140885.306467:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573689472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.306478:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.306498:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 28 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.306508:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 28 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.306527:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdb9f97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a152f expref: 28 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.306539:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.306541:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.306546:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.306553:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.306626:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.306640:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576038912:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.306701:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.308024:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573689344:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2399us (2578us total) trans 17179874096 rc 0/0 00000100:00100000:3.0:1746140885.308034:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1787 00002000:00100000:3.0:1746140885.308044:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (4059136->4194303) req@ffff88009edc8a80 x1830960573689344/t17179874096(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.308053:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8a80 with x1830960573689344 ext(4059136->4194303) 00010000:00010000:3.0:1746140885.308060:0:21690:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 20 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.308113:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576038912:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.308131:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.308152:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573689472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1685us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.308159:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8735 00010000:00010000:3.0:1746140885.308238:0:21690:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 20 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.308246:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009edc8a80 00000100:00100000:0.0:1746140885.309397:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.309447:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573689600 00000100:00100000:2.0:1746140885.309455:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573689600 00010000:00010000:2.0:1746140885.309479:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 20 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.309503:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8736 00000100:00100000:2.0:1746140885.309509:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573689600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.309519:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.309536:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 20 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.309546:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 20 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.309564:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ba4fc00/0x8156357b7fdb9f7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4059136->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1513 expref: 20 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.309579:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.309581:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.309585:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 35 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.309591:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 35 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.309613:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 35 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.309620:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576039040:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.309680:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.310682:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576039040:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.310697:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.310722:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1983:x1830960573689600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1213us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.310729:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8736 00000100:00100000:0.0:1746140885.312458:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.312584:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573689856 00000100:00100000:3.0:1746140885.312594:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573689856 00002000:00100000:3.0:1746140885.312637:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (2654208->2658303) req@ffff88009f2c0000 x1830960573689856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.312647:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0000 with x1830960573689856 ext(2654208->2658303) 00002000:00010000:3.0:1746140885.312653:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c0000 00000100:00100000:3.0:1746140885.312682:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8631 00000100:00100000:3.0:1746140885.312689:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573689856:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140885.312848:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573689856:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 159us (394us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140885.312853:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8631 00002000:00100000:3.0:1746140885.312858:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3a3:0x0] (2654208->2658303) req@ffff88009f2c0000 x1830960573689856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.312865:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0000 with x1830960573689856 ext(2654208->2658303) 00002000:00010000:3.0:1746140885.312867:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c0000 00000100:00100000:0.0:1746140885.314990:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.315248:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573690112 00000100:00100000:2.0:1746140885.315257:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573690112 00000100:00100000:2.0:1746140885.315617:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4696 00000100:00100000:2.0:1746140885.315627:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32622:x1830960573690112:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140885.315951:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32622:x1830960573690112:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 325us (968us total) trans 8589945005 rc 0/0 00000100:00100000:2.0:1746140885.316270:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4696 00000100:00100000:1.0:1746140885.316571:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.316609:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.316644:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.316696:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573690496 00000100:00100000:3.0:1746140885.316702:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573690496 00002000:00100000:3.0:1746140885.316729:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880135b64380 x1830960573690496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.316739:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64380 with x1830960573690496 ext(2097152->3145727) 00002000:00010000:3.0:1746140885.316744:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b64380 00000100:00100000:3.0:1746140885.316767:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573690624 00000100:00100000:3.0:1746140885.316770:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573690624 00002000:00100000:3.0:1746140885.316780:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880135b67480 x1830960573690624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.316786:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67480 with x1830960573690624 ext(3145728->4194303) 00002000:00010000:3.0:1746140885.316788:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b67480 00000100:00100000:3.0:1746140885.316796:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573690880 00000100:00100000:3.0:1746140885.316797:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573690880 00002000:00100000:3.0:1746140885.316808:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135b67100 x1830960573690880/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.316814:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67100 with x1830960573690880 ext(3145728->4194303) 00002000:00010000:3.0:1746140885.316817:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b67100 00000100:00100000:3.0:1746140885.316826:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8632 00000100:00100000:3.0:1746140885.316832:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573690496:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140885.317004:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8633 00000100:00100000:2.0:1746140885.317010:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573690624:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140885.317463:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8634 00000100:00100000:1.0:1746140885.317472:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573690880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140885.327925:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573690496:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11078us (11551us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.327938:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8632 00002000:00100000:3.0:1746140885.327950:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880135b64380 x1830960573690496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.327967:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64380 with x1830960573690496 ext(2097152->3145727) 00002000:00010000:3.0:1746140885.327973:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b64380 00000100:00100000:1.0:1746140885.330704:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573690880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 13225us (14049us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.331471:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8634 00002000:00100000:1.0:1746140885.331483:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135b67100 x1830960573690880/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.331493:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67100 with x1830960573690880 ext(3145728->4194303) 00002000:00010000:1.0:1746140885.331499:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b67100 00000100:00100000:2.0:1746140885.332504:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573690624:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15490us (15890us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.332513:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8633 00002000:00100000:2.0:1746140885.332520:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880135b67480 x1830960573690624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.332527:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67480 with x1830960573690624 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.332531:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b67480 00000100:00100000:0.0:1746140885.341850:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.341957:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573691136 00000100:00100000:2.0:1746140885.341966:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573691136 00002000:00100000:2.0:1746140885.342012:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009fc34e00 x1830960573691136/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.342021:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34e00 with x1830960573691136 ext(4194304->4886527) 00002000:00010000:2.0:1746140885.342027:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34e00 00000100:00100000:2.0:1746140885.342058:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8635 00000100:00100000:2.0:1746140885.342065:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573691136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.352098:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573691136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10015us (10240us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140885.352112:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8635 00002000:00100000:2.0:1746140885.352125:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009fc34e00 x1830960573691136/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.352143:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34e00 with x1830960573691136 ext(4194304->4886527) 00002000:00010000:2.0:1746140885.352149:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34e00 00000100:00100000:0.0:1746140885.360749:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.360805:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.361004:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573691648 00000100:00100000:2.0:1746140885.361016:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573691648 00000100:00100000:2.0:1746140885.361078:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4697 00000100:00100000:2.0:1746140885.361086:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32619:x1830960573691648:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140885.361136:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573691392 00000100:00100000:3.0:1746140885.361140:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573691392 00000100:00100000:3.0:1746140885.361512:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10713 00000100:00100000:3.0:1746140885.361519:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32629:x1830960573691392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.361531:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.361547:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438e00/0x8156357b7fdb9fb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a154b expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.361610:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32619:x1830960573691648:12345-192.168.204.16@tcp:35:cat.0 Request processed in 525us (804us total) trans 8589945006 rc 0/0 00000100:00100000:2.0:1746140885.361617:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4697 00010000:00010000:3.0:1746140885.361740:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361753:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361768:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361782:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361787:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361792:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361886:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361897:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361903:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140885.361912:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140885.361957:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361963:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361969:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361975:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c438600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.361979:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361985:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.361995:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140885.361998:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.362001:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362006:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438600/0x8156357b7fdb9fba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362032:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362041:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362045:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362049:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c439200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.362052:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362055:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362061:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388000) 00010000:00010000:3.0:1746140885.362064:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.362066:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362070:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439200/0x8156357b7fdb9fc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.362110:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c438e00/0x8156357b7fdb9fb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.362121:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.362127:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.362129:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140885.362131:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c439c00, rc 0) 00000100:00100000:3.0:1746140885.362160:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32629:x1830960573691392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 643us (1425us total) trans 8589945007 rc 0/0 00000100:00100000:3.0:1746140885.362166:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10713 00000100:00100000:0.0:1746140885.364391:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.364426:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.364462:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.364552:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573691904 00000100:00100000:2.0:1746140885.364561:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573691904 00000100:00100000:2.0:1746140885.364600:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573692032 00000100:00100000:2.0:1746140885.364602:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573692032 00000100:00100000:2.0:1746140885.364633:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16873 00000100:00100000:2.0:1746140885.364639:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573691904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.364655:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.364671:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdb9fd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1559 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.364727:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576039168:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.364811:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.364839:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16874 00000100:00100000:2.0:1746140885.364844:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573692032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.364852:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.364862:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1560 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.364874:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.364876:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.364884:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 20 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.364897:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 20 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140885.364914:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573691776 00000100:00100000:1.0:1746140885.364919:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573691776 00000100:00100000:1.0:1746140885.364948:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16875 00000100:00100000:1.0:1746140885.364954:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573691776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.364962:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.364972:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9fe4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1552 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.364998:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576039296:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140885.365020:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6600 going to sleep for 11 seconds 00010000:00010000:2.0:1746140885.365182:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8fc00, rc 0) 00000100:00100000:2.0:1746140885.365217:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573692032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 371us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.365223:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16874 00002000:00010000:2.0:1746140885.366351:0:24958:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime: 1746140885 -> 1746140886 00002000:00010000:2.0:1746140885.366384:0:24958:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140885 -> 1746140886 00002000:00010000:2.0:1746140885.366386:0:24958:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime: 1746140885 -> 1746140886 00000100:00100000:2.0:1746140885.366415:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576039168:192.168.204.16@tcp:106: 00002000:00010000:1.0:1746140885.366435:0:32376:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140885 -> 1746140886 00002000:00010000:1.0:1746140885.366437:0:32376:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140885 -> 1746140886 00002000:00010000:1.0:1746140885.366439:0:32376:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140885 -> 1746140886 00010000:00010000:2.0:1746140885.366443:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdb9fd6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1559 expref: 25 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140885.366446:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576039296:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.366453:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdb9fd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1559 expref: 25 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.366460:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9fe4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1552 expref: 25 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.366467:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec66c00/0x8156357b7fdb9fe4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1552 expref: 24 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.366485:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66c00, rc 0) 00000100:00100000:1.0:1746140885.366511:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573691776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1557us (2131us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140885.366663:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16875 00010000:00010000:2.0:1746140885.367109:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8fa00, rc 0) 00000100:00100000:2.0:1746140885.367142:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573691904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2503us (2714us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140885.367148:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16873 00000100:00100000:0.0:1746140885.373679:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.373729:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.373884:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.374229:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573692416 00000100:00100000:1.0:1746140885.374229:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573692672 00000100:00100000:3.0:1746140885.374230:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573692544 00000100:00100000:3.0:1746140885.374238:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573692544 00000100:00100000:2.0:1746140885.374238:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573692416 00000100:00100000:1.0:1746140885.374238:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573692672 00002000:00100000:3.0:1746140885.374280:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc34000 x1830960573692544/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.374280:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009fc36300 x1830960573692672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.374290:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc36300 with x1830960573692672 ext(1048576->2097151) 00002000:00010000:1.0:1746140885.374295:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc36300 00000100:00100000:1.0:1746140885.374352:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8636 00000100:00100000:1.0:1746140885.374361:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573692672:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140885.374648:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34000 with x1830960573692544 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.374652:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc34000 00000100:00100000:3.0:1746140885.374665:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8637 00000100:00100000:3.0:1746140885.374670:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573692544:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746140885.374966:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc37800 x1830960573692416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.374975:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37800 with x1830960573692416 ext(0->1048575) 00002000:00010000:2.0:1746140885.374979:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc37800 00000100:00100000:2.0:1746140885.375002:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8638 00000100:00100000:2.0:1746140885.375008:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1982:x1830960573692416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.384759:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1982:x1830960573692416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9739us (11079us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.384771:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8638 00002000:00100000:2.0:1746140885.384783:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc37800 x1830960573692416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.384792:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37800 with x1830960573692416 ext(0->1048575) 00002000:00010000:2.0:1746140885.384797:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc37800 00000100:00100000:1.0:1746140885.386254:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1982:x1830960573692672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11890us (12519us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.386263:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8636 00002000:00100000:1.0:1746140885.386271:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009fc36300 x1830960573692672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.386279:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc36300 with x1830960573692672 ext(1048576->2097151) 00002000:00010000:1.0:1746140885.386283:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc36300 00000100:00100000:3.0:1746140885.389940:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573692544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15257us (16043us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.389952:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8637 00002000:00100000:3.0:1746140885.389964:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc34000 x1830960573692544/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.389973:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34000 with x1830960573692544 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.389979:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc34000 00000100:00100000:0.0:1746140885.395869:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.395978:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573692928 00000100:00100000:2.0:1746140885.395987:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573692928 00000100:00100000:2.0:1746140885.396040:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16876 00000100:00100000:2.0:1746140885.396049:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32629:x1830960573692928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.396068:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.396085:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1567 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.396129:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.396136:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.396138:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.396141:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.396172:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.396723:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 26 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.396735:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576039424:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.397126:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.398475:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576039424:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.398500:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.398515:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4c00, rc 0) 00000100:00100000:2.0:1746140885.398553:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:32629:x1830960573692928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2505us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.398561:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16876 00000100:00100000:0.0:1746140885.399433:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.399515:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573693056 00000100:00100000:3.0:1746140885.399522:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573693056 00002000:00100000:3.0:1746140885.399561:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1789952->2097151) req@ffff88009fc35f80 x1830960573693056/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.399570:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35f80 with x1830960573693056 ext(1789952->2097151) 00010000:00010000:3.0:1746140885.399577:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 27 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.399595:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 27 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.399601:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc35f80 00000100:00100000:3.0:1746140885.399632:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1788 00000100:00100000:3.0:1746140885.399638:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573693056:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140885.405344:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573693056:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5691us (5898us total) trans 21474841378 rc 0/0 00000100:00100000:3.0:1746140885.405356:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1788 00002000:00100000:3.0:1746140885.405368:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1789952->2097151) req@ffff88009fc35f80 x1830960573693056/t21474841378(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.405377:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35f80 with x1830960573693056 ext(1789952->2097151) 00010000:00010000:3.0:1746140885.405387:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 29 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.405403:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 29 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.405410:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc35f80 00000100:00100000:0.0:1746140885.408292:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.408432:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573693184 00000100:00100000:2.0:1746140885.408443:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573693184 00010000:00010000:2.0:1746140885.408482:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 29 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.408522:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8737 00000100:00100000:2.0:1746140885.408530:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573693184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.408543:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.408568:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 29 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.408581:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 29 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.408603:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdb9f9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1536 expref: 29 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.408633:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.408635:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.408642:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.408655:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.408686:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.408697:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576039552:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.408784:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.410361:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576039552:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.410376:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.410412:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573693184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1879us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.410421:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8737 00000100:00100000:0.0:1746140885.411850:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.412060:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573693440 00000100:00100000:3.0:1746140885.412073:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573693440 00002000:00100000:3.0:1746140885.412121:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a51cdf80 x1830960573693440/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.412131:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cdf80 with x1830960573693440 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.412137:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cdf80 00000100:00100000:3.0:1746140885.412167:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8639 00000100:00100000:3.0:1746140885.412174:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573693440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140885.418698:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573693440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6512us (6841us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.418710:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8639 00002000:00100000:3.0:1746140885.418731:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a51cdf80 x1830960573693440/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.418741:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cdf80 with x1830960573693440 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.418748:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cdf80 00000100:00100000:0.0:1746140885.422987:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.423127:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573693568 00000100:00100000:2.0:1746140885.423138:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573693568 00000100:00100000:2.0:1746140885.424170:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16877 00000100:00100000:2.0:1746140885.424181:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:32629:x1830960573693568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.424199:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.424217:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a156e expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.424244:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.424251:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.424253:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.424256:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 24 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.424286:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 27 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.424318:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 27 pid: 32376 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.424335:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576039680:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.424431:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.427395:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.427417:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576039680:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.427484:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573693696 00000100:00100000:3.0:1746140885.427490:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573693696 00002000:00100000:3.0:1746140885.427531:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2658303) req@ffff8800a51cc700 x1830960573693696/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.427541:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cc700 with x1830960573693696 ext(2097152->2658303) 00010000:00010000:3.0:1746140885.427548:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 28 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.427563:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 28 pid: 32376 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.427569:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cc700 00010000:00010000:2.0:1746140885.427620:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 24 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.427633:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4e00, rc 0) 00000100:00100000:0.0:1746140885.427718:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1789 00000100:00100000:2.0:1746140885.427721:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:32629:x1830960573693568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3539us (4745us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.427728:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573693696:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140885.427764:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16877 00000100:00100000:2.0:1746140885.433774:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573693696:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6038us (6378us total) trans 21474841379 rc 0/0 00000100:00100000:2.0:1746140885.433785:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1789 00002000:00100000:2.0:1746140885.433797:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2658303) req@ffff8800a51cc700 x1830960573693696/t21474841379(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.433806:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cc700 with x1830960573693696 ext(2097152->2658303) 00010000:00010000:2.0:1746140885.433815:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 30 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.433831:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 30 pid: 32376 timeout: 964 lvb_type: 0 00002000:00010000:2.0:1746140885.433838:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cc700 00000100:00100000:0.0:1746140885.435533:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.435600:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573693952 00000100:00100000:3.0:1746140885.435608:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573693952 00000100:00100000:3.0:1746140885.435692:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10714 00000100:00100000:3.0:1746140885.435700:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32632:x1830960573693952:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140885.435720:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.435737:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3400/0x8156357b7fdb9ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1575 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.435840:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.435851:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.435861:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.435872:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.435877:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.435882:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.435981:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.435989:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.435994:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140885.436001:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140885.436077:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436101:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436106:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436112:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936f3800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.436118:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436124:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436134:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140885.436137:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.436140:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436145:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3800/0x8156357b7fdba000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436205:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436211:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436215:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436219:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936f3a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.436221:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436229:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436235:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388f00) 00010000:00010000:3.0:1746140885.436237:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.436239:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436243:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3a00/0x8156357b7fdba007 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.436278:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3400/0x8156357b7fdb9ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 273 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.436288:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 272 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.436294:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.436295:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140885.436297:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3c00, rc 0) 00000100:00100000:3.0:1746140885.436491:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32632:x1830960573693952:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 791us (963us total) trans 8589945008 rc 0/0 00000100:00100000:3.0:1746140885.436497:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10714 00000100:00100000:0.0:1746140885.438435:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.439234:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573694080 00000100:00100000:2.0:1746140885.439245:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573694080 00010000:00010000:2.0:1746140885.439284:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 30 pid: 32376 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.439366:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8738 00000100:00100000:2.0:1746140885.439374:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573694080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.439388:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.439415:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 30 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.439426:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 30 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.439447:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136977c00/0x8156357b7fdb9fac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1544 expref: 30 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.439473:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.439475:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.439481:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.439489:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.439521:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.439538:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576039808:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.439609:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.440642:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.440976:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573694208 00000100:00100000:2.0:1746140885.440984:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573694208 00000100:00100000:3.0:1746140885.441531:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576039808:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140885.441540:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16878 00010000:00010000:3.0:1746140885.441551:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.441551:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32632:x1830960573694208:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140885.441568:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.441583:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a157c expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.441590:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1982:x1830960573694080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2216us (3159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.441600:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8738 00010000:00010000:1.0:1746140885.441609:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 12 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.441617:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 37 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.441624:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 19 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.441630:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.441631:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.441634:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 37 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.441657:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 19 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.441672:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 19 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.441681:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576039936:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140885.441770:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 37 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.441778:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 37 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.441785:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040064:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140885.441876:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 12 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.441883:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 12 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.441890:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040192:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.441906:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140885.442864:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576039936:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.443258:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040064:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.443268:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140885.443295:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 37 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.443333:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67200, rc 0) 00000100:00100000:1.0:1746140885.443363:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:32632:x1830960573694208:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1815us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.443370:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16878 00000100:00100000:0.0:1746140885.447467:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.447504:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.447546:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.447588:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573694336 00000100:00100000:1.0:1746140885.447600:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573694336 00010000:00010000:1.0:1746140885.447638:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 20 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.447670:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573694592 00000100:00100000:1.0:1746140885.447672:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573694592 00010000:00010000:1.0:1746140885.447682:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 13 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.447694:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573694464 00000100:00100000:1.0:1746140885.447696:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573694464 00010000:00010000:1.0:1746140885.447705:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 37 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.447721:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8739 00000100:00100000:1.0:1746140885.447728:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573694336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140885.447733:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8740 00010000:00010000:1.0:1746140885.447739:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140885.447745:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573694592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.447759:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 20 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.447761:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.447773:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 20 pid: 4784 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.447828:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8741 00000100:00100000:2.0:1746140885.447837:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573694464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.447845:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.447878:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 13 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.447891:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 13 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.447914:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a62c400/0x8156357b7fdb9e4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1479 expref: 13 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.447993:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.448035:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573694592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 293us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.448042:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8740 00010000:00010000:1.0:1746140885.448224:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093877c00/0x8156357b7fdb9ee1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b1 expref: 20 pid: 4784 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.448230:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 37 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.448240:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 37 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.448253:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ec6000/0x8156357b7fdb9f12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14d4 expref: 37 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.448258:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.448260:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.448266:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 36 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.448275:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 36 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.448283:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.448328:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573694464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 468us (756us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140885.448333:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 36 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.448335:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8741 00000100:00100000:1.0:1746140885.448346:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576040320:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140885.448411:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140885.449648:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576040320:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140885.449663:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.449710:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573694336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1981us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.449718:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8739 00000100:00100000:2.0:1746140885.450721:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.450856:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.450910:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573694848 00000100:00100000:0.0:1746140885.450916:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573694848 00002000:00100000:0.0:1746140885.451063:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a7:0x0] (1982464->1986559) req@ffff88009f783100 x1830960573694848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.451073:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f783100 with x1830960573694848 ext(1982464->1986559) 00002000:00010000:0.0:1746140885.451078:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f783100 00000100:00100000:0.0:1746140885.451113:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573695104 00000100:00100000:0.0:1746140885.451119:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573695104 00002000:00100000:0.0:1746140885.451142:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f781180 x1830960573695104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.451149:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f781180 with x1830960573695104 ext(2097152->3145727) 00002000:00010000:0.0:1746140885.451152:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f781180 00000100:00100000:0.0:1746140885.451179:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8640 00000100:00100000:3.0:1746140885.451185:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8641 00000100:00100000:0.0:1746140885.451185:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573694848:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140885.451192:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573695104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.451457:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573694848:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 271us (736us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140885.451464:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8640 00002000:00100000:0.0:1746140885.451469:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a7:0x0] (1982464->1986559) req@ffff88009f783100 x1830960573694848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.451476:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f783100 with x1830960573694848 ext(1982464->1986559) 00002000:00010000:0.0:1746140885.451479:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f783100 00000100:00100000:1.0:1746140885.451499:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.451517:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573695488 00000100:00100000:0.0:1746140885.451520:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573695488 00002000:00100000:0.0:1746140885.451531:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f24dc00 x1830960573695488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.451544:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24dc00 with x1830960573695488 ext(3145728->4194303) 00002000:00010000:0.0:1746140885.451547:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24dc00 00000100:00100000:0.0:1746140885.451568:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8642 00000100:00100000:0.0:1746140885.451663:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573695488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.451692:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.451711:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.451735:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573695744 00000100:00100000:2.0:1746140885.451739:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573695744 00002000:00100000:2.0:1746140885.451761:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f780000 x1830960573695744/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.451769:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f780000 with x1830960573695744 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.451774:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f780000 00000100:00100000:2.0:1746140885.451794:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573695616 00000100:00100000:2.0:1746140885.451796:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573695616 00002000:00100000:2.0:1746140885.451805:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880093131c00 x1830960573695616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140885.451806:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8643 00002000:00100000:2.0:1746140885.451811:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131c00 with x1830960573695616 ext(2097152->3145727) 00000100:00100000:3.0:1746140885.451812:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573695744:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:2.0:1746140885.451813:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093131c00 00000100:00100000:2.0:1746140885.451821:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8644 00000100:00100000:2.0:1746140885.451826:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573695616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140885.458598:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.458684:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573696000 00000100:00100000:2.0:1746140885.458696:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573696000 00000100:00100000:0.0:1746140885.458981:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573695488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7403us (7480us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.458991:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8642 00002000:00100000:0.0:1746140885.459001:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f24dc00 x1830960573695488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.459011:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24dc00 with x1830960573695488 ext(3145728->4194303) 00002000:00010000:0.0:1746140885.459016:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24dc00 00000100:00100000:2.0:1746140885.459121:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16879 00000100:00100000:2.0:1746140885.459134:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32632:x1830960573696000:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140885.459153:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.459169:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1583 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.459198:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.459206:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 37 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.459218:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 22 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.459224:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.459226:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.459229:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1048576->1101823] (req 1048576->1101823) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 37 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.459257:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 22 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.459269:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 22 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.459280:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.459381:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 37 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.459389:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 37 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.459397:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040576:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.459423:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.459435:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 11 pid: 4782 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.459442:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.459460:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.463983:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040448:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.465865:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.465896:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.465968:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040576:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.465980:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576040704:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.465984:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573696128 00000100:00100000:1.0:1746140885.465993:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573696128 00010000:00010000:2.0:1746140885.466010:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1048576->1101823] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 37 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.466027:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5800, rc 0) 00010000:00010000:1.0:1746140885.466029:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 12 pid: 4782 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.466057:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573696256 00000100:00100000:1.0:1746140885.466060:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573696256 00010000:00010000:1.0:1746140885.466070:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 23 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.466080:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:32632:x1830960573696000:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6950us (7489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.466099:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16879 00000100:00100000:1.0:1746140885.466104:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8742 00000100:00100000:1.0:1746140885.466112:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573696128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140885.466116:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8743 00000100:00100000:3.0:1746140885.466125:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573696256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.466125:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.466135:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.466145:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 23 pid: 8458 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.466146:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 12 pid: 4782 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.466156:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 12 pid: 4782 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.466166:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 23 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.466324:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.466368:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573696384 00000100:00100000:2.0:1746140885.466374:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573696384 00010000:00010000:2.0:1746140885.466392:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 37 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.466412:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8744 00000100:00100000:2.0:1746140885.466418:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573696384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.466427:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.466562:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a62c000/0x8156357b7fdb9e40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1480 expref: 12 pid: 4782 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.466579:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140885.466597:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec66600/0x8156357b7fdb9eef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14b8 expref: 23 pid: 8458 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.466600:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 37 pid: 8458 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.466611:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 37 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.466612:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573696128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 501us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.466619:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8742 00010000:00010000:3.0:1746140885.466621:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140885.466633:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67a00/0x8156357b7fdb9f19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14db expref: 37 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.466640:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573696256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 517us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.466646:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8743 00010000:00010000:2.0:1746140885.466648:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.466650:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.466656:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 36 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.466665:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 36 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.466690:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 36 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.466701:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573695744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14888us (15009us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.466701:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b068a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576040832:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140885.466708:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8643 00002000:00100000:3.0:1746140885.466716:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f780000 x1830960573695744/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.466725:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f780000 with x1830960573695744 ext(3145728->4194303) 00002000:00010000:3.0:1746140885.466729:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f780000 00000100:00100000:2.0:1746140885.466748:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.468933:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573695104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17734us (18068us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.468944:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8641 00002000:00100000:3.0:1746140885.468954:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f781180 x1830960573695104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.468962:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f781180 with x1830960573695104 ext(2097152->3145727) 00002000:00010000:3.0:1746140885.468968:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f781180 00000100:00100000:2.0:1746140885.470700:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573695616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18865us (18980us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.470711:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8644 00002000:00100000:2.0:1746140885.470720:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880093131c00 x1830960573695616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.470734:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131c00 with x1830960573695616 ext(2097152->3145727) 00002000:00010000:2.0:1746140885.470739:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093131c00 00000100:00100000:2.0:1746140885.471697:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b068a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576040832:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.471711:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.471739:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573696384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5322us (5438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.471746:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8744 00000100:00100000:0.0:1746140885.474711:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.474795:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573696640 00000100:00100000:3.0:1746140885.474804:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573696640 00000100:00100000:2.0:1746140885.474822:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746140885.474847:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1097728->1101823) req@ffff88009b752300 x1830960573696640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.474855:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b752300 with x1830960573696640 ext(1097728->1101823) 00002000:00010000:3.0:1746140885.474860:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b752300 00000100:00100000:0.0:1746140885.474875:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573696896 00000100:00100000:3.0:1746140885.474878:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8645 00000100:00100000:0.0:1746140885.474879:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573696896 00000100:00100000:3.0:1746140885.474884:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573696640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140885.474918:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10715 00000100:00100000:0.0:1746140885.474924:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32634:x1830960573696896:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140885.474940:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.474957:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485a00/0x8156357b7fdba02a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a158a expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.475042:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140885.475053:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573696640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 168us (351us total) trans 0 rc 4096/4096 00010000:00010000:0.0:1746140885.475056:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.475059:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8645 00010000:00010000:0.0:1746140885.475063:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140885.475065:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1097728->1101823) req@ffff88009b752300 x1830960573696640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746140885.475069:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00002000:00100000:3.0:1746140885.475072:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b752300 with x1830960573696640 ext(1097728->1101823) 00002000:00010000:3.0:1746140885.475075:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b752300 00010000:00010000:0.0:1746140885.475111:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.475125:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 271 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.475135:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b752680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576040960:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140885.475209:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.475216:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 11 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.475224:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b751180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576041088:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.475243:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.476107:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.476289:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573697024 00000100:00100000:2.0:1746140885.476297:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573697024 00000100:00100000:2.0:1746140885.476356:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16880 00000100:00100000:0.0:1746140885.476360:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.476361:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573697024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.476372:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.476385:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801399b4800/0x8156357b7fdba038 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1591 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.476419:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576041216:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140885.476425:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573697152 00000100:00100000:3.0:1746140885.476430:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573697152 00000100:00100000:3.0:1746140885.476452:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16881 00000100:00100000:3.0:1746140885.476458:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573697152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.476466:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.476477:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba03f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1598 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.476479:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.476507:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576041344:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140885.476547:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.476780:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.476826:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573697408 00000100:00100000:2.0:1746140885.476830:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573697408 00000100:00100000:2.0:1746140885.476863:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4698 00000100:00100000:2.0:1746140885.476869:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32632:x1830960573697408:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746140885.476877:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.477014:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.477029:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:32632:x1830960573697408:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 159us (249us total) trans 8589945009 rc 0/0 00000100:00100000:2.0:1746140885.477039:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4698 00000100:00100000:3.0:1746140885.477066:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573697536 00000100:00100000:3.0:1746140885.477070:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573697536 00000100:00100000:2.0:1746140885.477071:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573697664 00000100:00100000:2.0:1746140885.477074:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573697664 00010000:00010000:2.0:1746140885.477097:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 12 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.477098:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 273 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.477118:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8745 00000100:00100000:2.0:1746140885.477123:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573697664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.477130:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.477135:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 12 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.477144:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 12 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.477160:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.477163:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.477169:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.477174:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.477193:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573697664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.477198:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8745 00000100:00100000:3.0:1746140885.477205:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8746 00000100:00100000:3.0:1746140885.477213:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:1985:x1830960573697536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.477222:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.477227:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 273 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.477237:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 273 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.477251:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b752680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576040960:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.477262:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f3c00/0x8156357b7fdba00e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1575 expref: 273 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.477262:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c439c00/0x8156357b7fdb9fc8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a154b expref: 11 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.477277:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00000100:00100000:1.0:1746140885.477277:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b751180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576041088:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.477281:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.477290:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.477295:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.477323:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.477324:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140885.477330:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.477334:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140885.477346:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1985:x1830960573697536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (470us total) trans 0 rc 0/0 00000004:00200000:1.0:1746140885.477350:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:3.0:1746140885.477353:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8746 00010000:00010000:1.0:1746140885.477450:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485a00/0x8156357b7fdba02a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.477462:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.477468:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.477470:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746140885.477473:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d485200, rc 0) 00000100:00100000:1.0:1746140885.477750:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32634:x1830960573696896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2824us (2933us total) trans 8589945010 rc 0/0 00000100:00100000:1.0:1746140885.477756:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10715 00002000:00010000:3.0:1746140885.478121:0:32376:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime: 1746140885 -> 1746140886 00002000:00010000:3.0:1746140885.478124:0:32376:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime: 1746140885 -> 1746140886 00002000:00010000:3.0:1746140885.478127:0:32376:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime: 1746140885 -> 1746140886 00000100:00100000:3.0:1746140885.478143:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576041216:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140885.478159:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801399b4800/0x8156357b7fdba038 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1591 expref: 21 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.478168:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801399b4800/0x8156357b7fdba038 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1591 expref: 21 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.478177:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4800, rc 0) 00000100:00100000:3.0:1746140885.478214:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573697024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1852us (2107us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140885.478220:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16880 00002000:00010000:2.0:1746140885.478477:0:24958:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime: 1746140885 -> 1746140886 00002000:00010000:2.0:1746140885.478481:0:24958:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140885 -> 1746140886 00002000:00010000:2.0:1746140885.478483:0:24958:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime: 1746140885 -> 1746140886 00000100:00100000:2.0:1746140885.478499:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576041344:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.478520:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba03f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1598 expref: 19 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.478531:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba03f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1598 expref: 19 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.478540:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3e00, rc 0) 00000100:00100000:2.0:1746140885.478566:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573697152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2108us (2206us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140885.478573:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16881 00000100:00100000:0.0:1746140885.482710:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.482846:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573697920 00000100:00100000:3.0:1746140885.482857:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573697920 00002000:00100000:3.0:1746140885.482904:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009b753b80 x1830960573697920/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.482915:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b753b80 with x1830960573697920 ext(4194304->4886527) 00002000:00010000:3.0:1746140885.482920:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b753b80 00000100:00100000:3.0:1746140885.482961:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8646 00000100:00100000:3.0:1746140885.482970:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573697920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140885.489608:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573697920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6625us (6896us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140885.489623:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8646 00002000:00100000:3.0:1746140885.489637:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009b753b80 x1830960573697920/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.489647:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b753b80 with x1830960573697920 ext(4194304->4886527) 00002000:00010000:3.0:1746140885.489653:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b753b80 00000100:00100000:1.0:1746140885.492973:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.493128:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.493187:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573698176 00000100:00100000:2.0:1746140885.493187:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573698048 00000100:00100000:3.0:1746140885.493197:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573698176 00000100:00100000:2.0:1746140885.493198:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573698048 00000100:00100000:2.0:1746140885.493258:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16882 00000100:00100000:3.0:1746140885.493265:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16883 00000100:00100000:2.0:1746140885.493266:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1983:x1830960573698048:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140885.493272:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573698176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.493282:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.493284:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.493298:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba054 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15a6 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.493298:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801399b4200/0x8156357b7fdba04d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a159f expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.493376:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576041472:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.493378:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576041600:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140885.493487:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.493495:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.494982:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576041600:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.495006:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801399b4200/0x8156357b7fdba04d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a159f expref: 21 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.495024:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801399b4200/0x8156357b7fdba04d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a159f expref: 21 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.495041:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4200, rc 0) 00000100:00100000:3.0:1746140885.495085:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576041472:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.495100:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573698048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1822us (2126us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140885.495108:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16882 00010000:00010000:3.0:1746140885.495120:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba054 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15a6 expref: 20 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.495132:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba054 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15a6 expref: 19 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.495142:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3200, rc 0) 00000100:00100000:3.0:1746140885.495178:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573698176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1904us (2048us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140885.495187:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16883 00000100:00100000:0.0:1746140885.497026:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.497109:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.497242:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573698432 00000100:00100000:2.0:1746140885.497252:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573698432 00000100:00100000:2.0:1746140885.497497:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573698304 00000100:00100000:2.0:1746140885.497501:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573698304 00000100:00100000:3.0:1746140885.497554:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16884 00000100:00100000:3.0:1746140885.497565:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573698432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.497584:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.497603:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f3800/0x8156357b7fdba05b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15b4 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.497657:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576041728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.497835:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16885 00000100:00100000:2.0:1746140885.497843:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573698304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.497851:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.497860:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801399b5400/0x8156357b7fdba062 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15ad expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.497888:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576041856:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140885.498253:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.498690:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.500738:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576041728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.500738:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576041856:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.500767:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801399b5400/0x8156357b7fdba062 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ad expref: 21 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.500772:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3800/0x8156357b7fdba05b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15b4 expref: 21 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.500781:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5400/0x8156357b7fdba062 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ad expref: 21 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.500783:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3800/0x8156357b7fdba05b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15b4 expref: 21 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.500793:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3800, rc 0) 00010000:00010000:2.0:1746140885.500794:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5400, rc 0) 00000100:00100000:3.0:1746140885.500836:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573698432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3273us (3816us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140885.500843:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16884 00000100:00100000:2.0:1746140885.500971:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573698304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3127us (3859us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140885.500977:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16885 00000100:00100000:0.0:1746140885.506418:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.506497:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573698688 00000100:00100000:2.0:1746140885.506507:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573698688 00000100:00100000:2.0:1746140885.506569:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4699 00000100:00100000:2.0:1746140885.506577:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a840850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32629:x1830960573698688:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140885.506805:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a840850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32629:x1830960573698688:12345-192.168.204.16@tcp:35:cat.0 Request processed in 228us (396us total) trans 8589945011 rc 0/0 00000100:00100000:2.0:1746140885.506812:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4699 00000100:00100000:0.0:1746140885.511930:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.512203:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573698816 00000100:00100000:2.0:1746140885.512213:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573698816 00000100:00100000:3.0:1746140885.512618:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16886 00000100:00100000:3.0:1746140885.512629:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32634:x1830960573698816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140885.512646:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.512662:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15bb expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.512695:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 35 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.512703:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 19 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.512710:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.512712:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.512715:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3420160->3948543] (req 3420160->3948543) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 19 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.512743:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 19 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.512754:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 19 pid: 20960 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.512765:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576041984:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.512856:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 35 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.512865:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 35 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.512872:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576042112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.512893:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.514279:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576041984:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.514288:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576042112:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.514324:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3420160->3948543] (req 3420160->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 19 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.514340:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3e00, rc 0) 00000100:00100000:3.0:1746140885.514369:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+19:32634:x1830960573698816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1743us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.514377:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16886 00000100:00100000:0.0:1746140885.517992:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.518128:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.518209:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573698944 00000100:00100000:2.0:1746140885.518219:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573698944 00010000:00010000:2.0:1746140885.518258:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 19 pid: 20960 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.518284:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573699072 00000100:00100000:2.0:1746140885.518286:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573699072 00010000:00010000:2.0:1746140885.518296:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 36 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.518341:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8747 00000100:00100000:3.0:1746140885.518348:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8748 00000100:00100000:2.0:1746140885.518348:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573698944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140885.518357:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573699072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.518364:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.518367:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.518386:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 36 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.518386:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 19 pid: 20960 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.518397:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 19 pid: 20960 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.518601:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 36 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.518626:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fc00/0x8156357b7fdb9fdd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1560 expref: 19 pid: 20960 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.518632:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e600/0x8156357b7fdb9fa5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a153d expref: 36 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.518789:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.518791:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.518799:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.518808:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.518842:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.518853:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576042240:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140885.518854:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.518901:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573699072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 545us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.518912:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8748 00000100:00100000:2.0:1746140885.518927:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.520257:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576042240:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.520273:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.520330:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573698944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1982us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.520339:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8747 00000100:00100000:0.0:1746140885.521390:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.521497:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573699328 00000100:00100000:3.0:1746140885.521503:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573699328 00002000:00100000:3.0:1746140885.521532:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3420160->3424255) req@ffff88009b751180 x1830960573699328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.521539:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b751180 with x1830960573699328 ext(3420160->3424255) 00002000:00010000:3.0:1746140885.521543:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b751180 00000100:00100000:3.0:1746140885.521566:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8647 00000100:00100000:3.0:1746140885.521570:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573699328:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140885.521719:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573699328:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 148us (331us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140885.521725:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8647 00002000:00100000:3.0:1746140885.521730:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3420160->3424255) req@ffff88009b751180 x1830960573699328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.521737:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b751180 with x1830960573699328 ext(3420160->3424255) 00002000:00010000:3.0:1746140885.521739:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b751180 00000100:00100000:0.0:1746140885.527576:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.527696:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573699584 00000100:00100000:2.0:1746140885.527705:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573699584 00002000:00100000:2.0:1746140885.527747:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3944448->3948543) req@ffff88009b752680 x1830960573699584/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.527811:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b752680 with x1830960573699584 ext(3944448->3948543) 00002000:00010000:2.0:1746140885.527817:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b752680 00000100:00100000:2.0:1746140885.527850:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8648 00000100:00100000:2.0:1746140885.527857:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573699584:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140885.528032:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573699584:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 175us (467us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140885.528038:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8648 00002000:00100000:2.0:1746140885.528044:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3944448->3948543) req@ffff88009b752680 x1830960573699584/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.528051:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b752680 with x1830960573699584 ext(3944448->3948543) 00002000:00010000:2.0:1746140885.528054:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b752680 00000100:00100000:0.0:1746140885.580954:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.581051:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573699840 00000100:00100000:1.0:1746140885.581062:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573699840 00000100:00100000:1.0:1746140885.581738:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10716 00000100:00100000:1.0:1746140885.581747:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32640:x1830960573699840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.581771:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.581790:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37e00/0x8156357b7fdba070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15c2 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.581904:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.581917:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.581927:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.581939:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.581944:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.581949:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582053:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582061:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582067:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:1.0:1746140885.582080:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140885.582181:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582188:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582193:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582198:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a37a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140885.582202:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582208:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582218:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140885.582221:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140885.582226:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582231:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582255:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582260:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582265:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582273:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a36000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140885.582276:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582280:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582286:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092d0f700) 00010000:00010000:1.0:1746140885.582288:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140885.582290:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582295:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba07e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.582350:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37e00/0x8156357b7fdba070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 275 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.582361:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 274 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.582368:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.582370:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746140885.582372:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37000, rc 0) 00000100:00100000:1.0:1746140885.582419:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32640:x1830960573699840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 674us (1475us total) trans 8589945012 rc 0/0 00000100:00100000:1.0:1746140885.582425:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10716 00000100:00100000:0.0:1746140885.587187:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.587240:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.587796:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573699968 00000100:00100000:3.0:1746140885.587806:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573699968 00000100:00100000:3.0:1746140885.587850:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573700096 00000100:00100000:3.0:1746140885.587851:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573700096 00000100:00100000:1.0:1746140885.587865:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.587866:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16887 00000100:00100000:3.0:1746140885.587872:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16888 00000100:00100000:0.0:1746140885.587876:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573699968:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140885.587883:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573700224 00000100:00100000:3.0:1746140885.587885:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573700224 00010000:00010000:0.0:1746140885.587898:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140885.587902:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16889 00000100:00100000:3.0:1746140885.587907:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573700224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.587915:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.587918:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15c9 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.587925:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f3400/0x8156357b7fdba09a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15d7 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.587941:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.587943:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.587950:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 31 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.587966:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 31 pid: 4785 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140885.587972:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576042368:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140885.587977:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37c00, rc 0) 00000100:00100000:2.0:1746140885.587993:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573700096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.588006:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.588016:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15d0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.588030:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.588031:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140885.588034:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573699968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 160us (856us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140885.588037:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 32 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140885.588041:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16887 00010000:00010000:2.0:1746140885.588049:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 32 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140885.588054:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45309c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746140885.588058:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5200, rc 0) 00000100:00100000:2.0:1746140885.588079:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573700096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 200us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.588096:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16888 00002000:00010000:3.0:1746140885.589282:0:9872:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime: 1746140885 -> 1746140886 00002000:00010000:3.0:1746140885.589287:0:9872:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140885 -> 1746140886 00002000:00010000:3.0:1746140885.589289:0:9872:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime: 1746140885 -> 1746140886 00000100:00100000:3.0:1746140885.589436:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576042368:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140885.589463:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3400/0x8156357b7fdba09a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d7 expref: 36 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.589473:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3400/0x8156357b7fdba09a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d7 expref: 36 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.589500:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3400, rc 0) 00000100:00100000:3.0:1746140885.589740:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573700224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1831us (1875us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140885.589748:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16889 00000100:00100000:0.0:1746140885.597142:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.597180:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.597201:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.597230:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.597294:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573700608 00000100:00100000:2.0:1746140885.597330:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573700608 00002000:00100000:2.0:1746140885.597377:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f728700 x1830960573700608/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.597385:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728700 with x1830960573700608 ext(0->1048575) 00002000:00010000:2.0:1746140885.597391:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f728700 00000100:00100000:2.0:1746140885.597409:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573700864 00000100:00100000:2.0:1746140885.597411:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573700864 00000100:00100000:3.0:1746140885.597421:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573700992 00002000:00100000:2.0:1746140885.597423:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1982463) req@ffff88009f72bb80 x1830960573700864/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140885.597425:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573700992 00002000:00100000:2.0:1746140885.597430:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f72bb80 with x1830960573700864 ext(1048576->1982463) 00002000:00010000:2.0:1746140885.597433:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f72bb80 00002000:00100000:3.0:1746140885.597439:0:21690:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3a8:0x0] (1101824->2097151) req@ffff88009f729880 x1830960573700992/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.597445:0:21690:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729880 with x1830960573700992 ext(1101824->2097151) 00000100:00100000:2.0:1746140885.597448:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573701248 00002000:00010000:3.0:1746140885.597449:0:21690:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f729880 00000100:00100000:2.0:1746140885.597450:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573701248 00002000:00100000:2.0:1746140885.597462:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f72ad80 x1830960573701248/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140885.597466:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8649 00002000:00100000:2.0:1746140885.597468:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f72ad80 with x1830960573701248 ext(1048576->2097151) 00002000:00010000:2.0:1746140885.597471:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f72ad80 00000100:00100000:3.0:1746140885.597472:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573700608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.597482:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8650 00000100:00100000:2.0:1746140885.597486:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573700864:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140885.597490:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8651 00000100:00100000:1.0:1746140885.597500:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573700992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.598034:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8652 00000100:00100000:0.0:1746140885.598042:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573701248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.610631:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573700864:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13132us (13438us total) trans 0 rc 933888/933888 00000100:00100000:2.0:1746140885.610643:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8650 00002000:00100000:2.0:1746140885.610656:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1982463) req@ffff88009f72bb80 x1830960573700864/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.610665:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f72bb80 with x1830960573700864 ext(1048576->1982463) 00002000:00010000:2.0:1746140885.610671:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f72bb80 00000100:00100000:2.0:1746140885.612920:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573700992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15414us (15710us total) trans 0 rc 995328/995328 00000100:00100000:2.0:1746140885.612933:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8651 00002000:00100000:2.0:1746140885.612943:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1101824->2097151) req@ffff88009f729880 x1830960573700992/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 995328/995328 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.612953:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729880 with x1830960573700992 ext(1101824->2097151) 00002000:00010000:2.0:1746140885.612957:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f729880 00000100:00100000:3.0:1746140885.614192:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573700608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16713us (17057us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.614203:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8649 00002000:00100000:3.0:1746140885.614212:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f728700 x1830960573700608/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.614220:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728700 with x1830960573700608 ext(0->1048575) 00002000:00010000:3.0:1746140885.614225:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f728700 00000100:00100000:2.0:1746140885.618199:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573701248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20148us (20955us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.618212:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8652 00002000:00100000:2.0:1746140885.618224:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f72ad80 x1830960573701248/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.618233:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f72ad80 with x1830960573701248 ext(1048576->2097151) 00002000:00010000:2.0:1746140885.618241:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f72ad80 00000100:00100000:0.0:1746140885.629927:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.630404:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573701504 00000100:00100000:2.0:1746140885.630413:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573701504 00002000:00100000:2.0:1746140885.630463:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880094450a80 x1830960573701504/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.630471:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094450a80 with x1830960573701504 ext(2097152->3145727) 00002000:00010000:2.0:1746140885.630476:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094450a80 00000100:00100000:2.0:1746140885.630508:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8653 00000100:00100000:2.0:1746140885.630514:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573701504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.643435:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573701504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12913us (13508us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.643445:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8653 00002000:00100000:2.0:1746140885.643455:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880094450a80 x1830960573701504/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.643463:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094450a80 with x1830960573701504 ext(2097152->3145727) 00002000:00010000:2.0:1746140885.643468:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094450a80 00000100:00100000:1.0:1746140885.648051:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.648051:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.648158:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573701632 00000100:00100000:2.0:1746140885.648165:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573701888 00000100:00100000:3.0:1746140885.648170:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573701632 00000100:00100000:2.0:1746140885.648172:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573701888 00000100:00100000:3.0:1746140885.648225:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16890 00000100:00100000:3.0:1746140885.648233:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:32640:x1830960573701632:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140885.648248:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10717 00010000:00010000:3.0:1746140885.648249:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140885.648254:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32642:x1830960573701888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140885.648266:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15de expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.648271:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.648284:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba0af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15e5 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.648293:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.648510:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648521:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648530:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648539:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648543:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648547:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648625:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648631:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648635:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140885.648641:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140885.648700:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648705:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648709:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648716:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801399b5e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.648717:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.648719:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.648720:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140885.648724:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.648724:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648732:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140885.648734:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140885.648737:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648740:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5e00/0x8156357b7fdba0b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648752:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648756:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648760:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.648761:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.648762:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801399b4600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140885.648764:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648767:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648771:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e4b5e00) 00010000:00010000:2.0:1746140885.648773:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140885.648775:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648778:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba0bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.648805:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba0af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.648813:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 14 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.648818:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.648820:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140885.648822:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5600, rc 0) 00000100:00100000:2.0:1746140885.648858:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32642:x1830960573701888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 605us (814us total) trans 8589945013 rc 0/0 00000100:00100000:2.0:1746140885.648863:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10717 00010000:00010000:3.0:1746140885.649791:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 17 pid: 24958 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.649809:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576042496:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.649909:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.651030:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.651206:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573702144 00000100:00100000:2.0:1746140885.651212:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573702144 00000100:00100000:2.0:1746140885.651243:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4700 00000100:00100000:2.0:1746140885.651249:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32642:x1830960573702144:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140885.652201:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576042496:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.652223:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.652238:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f3200, rc 0) 00000100:00100000:2.0:1746140885.652474:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32642:x1830960573702144:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1223us (1448us total) trans 8589945014 rc 0/0 00000100:00100000:2.0:1746140885.652482:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4700 00000100:00100000:3.0:1746140885.652540:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32640:x1830960573701632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4308us (4494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.652546:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16890 00000100:00100000:0.0:1746140885.652636:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.652689:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573702272 00000100:00100000:3.0:1746140885.652693:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573702272 00002000:00100000:3.0:1746140885.652718:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3420160->3948543) req@ffff88012d3b6680 x1830960573702272/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.652725:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b6680 with x1830960573702272 ext(3420160->3948543) 00010000:00010000:3.0:1746140885.652732:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 18 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.652748:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 18 pid: 24958 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.652755:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b6680 00000100:00100000:3.0:1746140885.652770:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1790 00000100:00100000:3.0:1746140885.652775:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573702272:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140885.662895:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573702272:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 10111us (10256us total) trans 17179874097 rc 0/0 00000100:00100000:3.0:1746140885.662907:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1790 00002000:00100000:3.0:1746140885.662918:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3420160->3948543) req@ffff88012d3b6680 x1830960573702272/t17179874097(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.662926:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b6680 with x1830960573702272 ext(3420160->3948543) 00010000:00010000:3.0:1746140885.662935:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 20 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.662949:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 20 pid: 24958 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.662956:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b6680 00000100:00100000:0.0:1746140885.664577:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.664629:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.664637:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573702400 00000100:00100000:3.0:1746140885.664646:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573702400 00000100:00100000:3.0:1746140885.664684:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16891 00000100:00100000:3.0:1746140885.664691:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32642:x1830960573702400:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140885.664710:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140885.664713:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573702528 00000100:00100000:2.0:1746140885.664717:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573702528 00010000:00010000:3.0:1746140885.664727:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15ec expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.664734:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 21 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.664752:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 35 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.664756:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8749 00010000:00010000:3.0:1746140885.664759:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746140885.664760:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573702528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.664761:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140885.664764:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1064960->1339391] (req 1064960->1339391) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 22 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.664768:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.664784:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 22 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.664789:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 35 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.664792:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 22 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.664798:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 35 pid: 32376 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.664807:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576042624:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.664807:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3e00/0x8156357b7fdba069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3948543) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15bb expref: 22 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.664834:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.664835:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.664840:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 35 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.664847:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 35 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.664865:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45309c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746140885.664866:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 35 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.664874:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576042752:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.665535:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b425ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.666910:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576042624:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.666937:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1064960->1339391] (req 1064960->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 21 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.666952:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f080e00, rc 0) 00000100:00100000:3.0:1746140885.666999:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32642:x1830960573702400:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2306us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.667109:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16891 00000100:00100000:2.0:1746140885.667190:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576042752:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.667201:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.667219:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573702528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2458us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.667227:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8749 00000100:00100000:0.0:1746140885.668439:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.668590:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573702656 00000100:00100000:3.0:1746140885.668597:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573702656 00002000:00100000:3.0:1746140885.668633:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1101823) req@ffff88012d3b7800 x1830960573702656/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.668642:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b7800 with x1830960573702656 ext(1048576->1101823) 00010000:00010000:3.0:1746140885.668651:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 36 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.668663:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 36 pid: 32376 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.668668:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b7800 00000100:00100000:3.0:1746140885.668684:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1791 00000100:00100000:3.0:1746140885.668690:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573702656:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140885.670623:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573702656:12345-192.168.204.16@tcp:4:cat.0 Request processed in 1925us (2180us total) trans 17179874098 rc 0/0 00000100:00100000:3.0:1746140885.670633:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1791 00002000:00100000:3.0:1746140885.670643:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1101823) req@ffff88012d3b7800 x1830960573702656/t17179874098(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.670651:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b7800 with x1830960573702656 ext(1048576->1101823) 00010000:00010000:3.0:1746140885.670661:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 38 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.670678:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 38 pid: 32376 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.670684:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b7800 00000100:00100000:0.0:1746140885.673522:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.674205:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.674404:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573703040 00000100:00100000:3.0:1746140885.674413:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573703040 00002000:00100000:3.0:1746140885.674455:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012d3b7480 x1830960573703040/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.674464:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b7480 with x1830960573703040 ext(2097152->3145727) 00002000:00010000:3.0:1746140885.674469:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b7480 00000100:00100000:3.0:1746140885.674488:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8654 00000100:00100000:3.0:1746140885.674495:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573703040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.675334:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573702784 00000100:00100000:2.0:1746140885.675340:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573702784 00010000:00010000:2.0:1746140885.675361:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 40 pid: 32376 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.675397:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8750 00000100:00100000:2.0:1746140885.675403:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1983:x1830960573702784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.675412:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.675428:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 40 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.675439:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 40 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.675459:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5800/0x8156357b7fdba023 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1583 expref: 40 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.675476:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.675478:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.675485:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.675497:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.675527:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 19 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.675538:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576042880:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.675602:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00000100:00100000:1.0:1746140885.675602:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.675695:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.676999:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573703296 00000100:00100000:2.0:1746140885.677005:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573703296 00000100:00100000:0.0:1746140885.677008:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573703552 00000100:00100000:0.0:1746140885.677012:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573703552 00002000:00100000:2.0:1746140885.677034:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f24f480 x1830960573703296/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.677034:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f24d180 x1830960573703552/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.677042:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f480 with x1830960573703296 ext(3145728->4194303) 00002000:00100000:0.0:1746140885.677042:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24d180 with x1830960573703552 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.677046:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f24f480 00002000:00010000:0.0:1746140885.677046:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24d180 00000100:00100000:0.0:1746140885.677073:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8655 00000100:00100000:2.0:1746140885.677076:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8656 00000100:00100000:0.0:1746140885.677079:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573703552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.677080:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573703296:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746140885.679659:0:1272:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140885.691078:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.691273:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576042880:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140885.691290:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.691365:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1983:x1830960573702784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 15961us (17850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.691375:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8750 00000100:00100000:2.0:1746140885.691574:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573703296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14493us (15973us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.691577:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573703808 00000100:00100000:3.0:1746140885.691584:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573703808 00000100:00100000:2.0:1746140885.691586:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8656 00002000:00100000:2.0:1746140885.691595:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f24f480 x1830960573703296/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.691604:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f480 with x1830960573703296 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.691609:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f24f480 00002000:00100000:3.0:1746140885.691613:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1064960->1069055) req@ffff88012d3b6a00 x1830960573703808/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.691620:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b6a00 with x1830960573703808 ext(1064960->1069055) 00002000:00010000:3.0:1746140885.691623:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b6a00 00000100:00100000:3.0:1746140885.691645:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8657 00000100:00100000:3.0:1746140885.691652:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573703808:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140885.691778:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573703808:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 126us (709us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140885.691787:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8657 00002000:00100000:3.0:1746140885.691791:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1064960->1069055) req@ffff88012d3b6a00 x1830960573703808/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.691797:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b6a00 with x1830960573703808 ext(1064960->1069055) 00002000:00010000:3.0:1746140885.691800:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b6a00 00000100:00100000:2.0:1746140885.692804:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573703040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18306us (18596us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.692811:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8654 00002000:00100000:2.0:1746140885.692817:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012d3b7480 x1830960573703040/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.692823:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b7480 with x1830960573703040 ext(2097152->3145727) 00002000:00010000:2.0:1746140885.692826:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b7480 00000100:00100000:2.0:1746140885.693971:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573703552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16888us (18272us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.693978:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8655 00002000:00100000:2.0:1746140885.693984:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f24d180 x1830960573703552/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.693992:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24d180 with x1830960573703552 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.693995:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24d180 00000100:00100000:0.0:1746140885.701644:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.701702:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.701799:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573704192 00000100:00100000:3.0:1746140885.701809:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573704192 00000100:00100000:3.0:1746140885.701848:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16892 00000100:00100000:3.0:1746140885.701855:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573704192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.701873:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.701891:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba0d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15f3 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.701938:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576043008:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.702054:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573704064 00000100:00100000:2.0:1746140885.702058:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573704064 00002000:00100000:2.0:1746140885.702098:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1335296->1339391) req@ffff88009f7a9880 x1830960573704064/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.702113:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a9880 with x1830960573704064 ext(1335296->1339391) 00002000:00010000:2.0:1746140885.702117:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7a9880 00000100:00100000:2.0:1746140885.702132:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8658 00000100:00100000:2.0:1746140885.702137:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573704064:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140885.703674:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573704064:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1530us (2033us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140885.703683:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8658 00002000:00100000:2.0:1746140885.703693:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1335296->1339391) req@ffff88009f7a9880 x1830960573704064/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.703701:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a9880 with x1830960573704064 ext(1335296->1339391) 00002000:00010000:2.0:1746140885.703706:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7a9880 00000100:00100000:3.0:1746140885.703894:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.708457:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576043008:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140885.708616:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba0d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15f3 expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.708630:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba0d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15f3 expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.708943:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.709052:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573704448 00000100:00100000:2.0:1746140885.709058:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573704448 00000100:00100000:2.0:1746140885.709121:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10718 00000100:00100000:2.0:1746140885.709128:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32644:x1830960573704448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140885.709146:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.709160:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4000/0x8156357b7fdba0e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a15fa expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.709252:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709263:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709272:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709282:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709287:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709291:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709395:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4400/0x8156357b7fdba0f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709403:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4400/0x8156357b7fdba0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709408:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4400/0x8156357b7fdba0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140885.709415:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140885.709482:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709487:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709492:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709497:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801399b5400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140885.709500:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709505:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709513:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140885.709516:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140885.709519:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709523:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba0e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709545:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709550:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709553:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709557:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801399b5800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140885.709558:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709562:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709567:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e4b5400) 00010000:00010000:2.0:1746140885.709568:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140885.709570:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709574:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba0ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.709603:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4000/0x8156357b7fdba0e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15fa expref: 277 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.709612:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4400/0x8156357b7fdba0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15fa expref: 276 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.709617:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.709619:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140885.709620:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4400, rc 0) 00000100:00100000:2.0:1746140885.709677:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32644:x1830960573704448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 546us (731us total) trans 8589945015 rc 0/0 00000100:00100000:2.0:1746140885.709683:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10718 00010000:00010000:3.0:1746140885.710494:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8b200, rc 0) 00000100:00100000:3.0:1746140885.710535:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573704192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8678us (8830us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140885.710542:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16892 00000100:00100000:0.0:1746140885.715930:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.716515:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.717968:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573704832 00000100:00100000:3.0:1746140885.717980:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573704832 00000100:00100000:3.0:1746140885.718062:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 771 00000100:00100000:2.0:1746140885.718227:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573704704 00000100:00100000:2.0:1746140885.718234:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573704704 00002000:00100000:2.0:1746140885.718272:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f7a9f80 x1830960573704704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.718281:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a9f80 with x1830960573704704 ext(4194304->4886527) 00002000:00010000:2.0:1746140885.718285:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7a9f80 00000100:00100000:2.0:1746140885.718342:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8659 00000100:00100000:2.0:1746140885.718351:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573704704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140885.719781:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:1983:x1830960573704832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.719798:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.719835:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4400/0x8156357b7fdba0f5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15fa expref: 276 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.719858:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.719863:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.719900:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:1983:x1830960573704832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1828us (3384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.719907:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 771 00000100:00100000:0.0:1746140885.721191:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.721342:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573704960 00000100:00100000:2.0:1746140885.721348:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573704960 00000100:00100000:2.0:1746140885.721392:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10719 00000100:00100000:2.0:1746140885.721397:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:32646:x1830960573704960:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140885.721414:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.721428:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4000/0x8156357b7fdba103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1601 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.721477:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.721487:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.721495:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.721506:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.721511:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.721515:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.721606:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.721615:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 14 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.721620:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140885.721646:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 14 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.721657:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 14 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.721672:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576043136:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.721749:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719240 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.725707:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573704704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7347us (9773us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140885.725719:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8659 00000100:00100000:3.0:1746140885.725721:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576043136:192.168.204.16@tcp:104: 00002000:00100000:2.0:1746140885.725731:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f7a9f80 x1830960573704704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746140885.725743:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00002000:00100000:2.0:1746140885.725745:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a9f80 with x1830960573704704 ext(4194304->4886527) 00002000:00010000:2.0:1746140885.725750:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7a9f80 00000100:00100000:0.0:1746140885.729625:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.730202:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573705216 00000100:00100000:2.0:1746140885.730212:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573705216 00000100:00100000:2.0:1746140885.730258:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4701 00000100:00100000:2.0:1746140885.730265:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:27404:x1830960573705216:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746140885.730532:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+16:27404:x1830960573705216:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 267us (918us total) trans 8589945016 rc 0/0 00000100:00100000:2.0:1746140885.730539:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4701 00000100:00100000:0.0:1746140885.731441:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.731513:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573705344 00000100:00100000:3.0:1746140885.731945:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573705344 00000100:00100000:3.0:1746140885.732000:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16893 00000100:00100000:3.0:1746140885.732007:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573705344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.732023:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.732039:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8b400/0x8156357b7fdba11f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1608 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.732104:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576043264:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140885.732194:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.733456:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576043264:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140885.733479:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b400/0x8156357b7fdba11f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1608 expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.733488:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b400/0x8156357b7fdba11f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1608 expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.733498:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8b400, rc 0) 00000100:00100000:3.0:1746140885.733798:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573705344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1790us (2356us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140885.733804:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16893 00000100:00100000:1.0:1746140885.733862:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.733960:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573705472 00000100:00100000:3.0:1746140885.733966:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573705472 00010000:00010000:3.0:1746140885.733990:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 16 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.734022:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8751 00000100:00100000:3.0:1746140885.734029:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573705472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.734041:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.734047:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 16 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.734057:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 16 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.734075:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d485200/0x8156357b7fdba031 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a158a expref: 16 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.734096:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.734101:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.734109:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.734115:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140885.734141:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.734172:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573705472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 143us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.734177:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8751 00010000:00010000:0.0:1746140885.734225:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734232:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140885.734395:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140885.734400:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140885.734418:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734428:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734437:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734442:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734447:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734453:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801399b5800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140885.734457:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734463:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734471:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140885.734754:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140885.734758:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734763:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba10a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734948:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734955:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734960:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734964:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801399b5400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140885.734966:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734971:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734978:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e4b5400) 00010000:00010000:0.0:1746140885.734980:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140885.734982:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.734987:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5400/0x8156357b7fdba111 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.735017:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4000/0x8156357b7fdba103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 11 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.735028:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.735034:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.735036:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140885.735037:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4a00, rc 0) 00000100:00100000:0.0:1746140885.735192:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:32646:x1830960573704960:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 13793us (14006us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.735199:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10719 00000100:00100000:0.0:1746140885.737422:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.737664:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.737742:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.737761:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.737779:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573705600 00000100:00100000:1.0:1746140885.737787:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573705600 00000100:00100000:1.0:1746140885.737823:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573705984 00000100:00100000:1.0:1746140885.737824:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573705984 00000100:00100000:1.0:1746140885.737834:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573706112 00000100:00100000:1.0:1746140885.737836:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573706112 00000100:00100000:1.0:1746140885.737846:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16894 00000100:00100000:1.0:1746140885.737851:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573705600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.737866:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.737882:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fc4600/0x8156357b7fdba126 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a160f expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.737931:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576043392:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.737976:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16895 00000100:00100000:1.0:1746140885.737987:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.737992:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573705984:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746140885.738008:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16896 00010000:00010000:2.0:1746140885.738009:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140885.738014:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573706112:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140885.738021:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.738026:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801399b4200/0x8156357b7fdba12d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a161d expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.738027:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fc4c00/0x8156357b7fdba134 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1624 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.738049:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576043520:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140885.738066:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.738081:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576043648:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140885.738112:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.738126:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573706240 00000100:00100000:1.0:1746140885.738128:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573706240 00000100:00100000:1.0:1746140885.738151:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16897 00000100:00100000:1.0:1746140885.738155:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573706240:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140885.738162:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140885.738164:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746140885.738170:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a162b expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.738185:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.738187:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.738194:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.738207:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.738215:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fc5400, rc 0) 00000100:00100000:1.0:1746140885.738235:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573706240:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 79us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.738241:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16897 00000100:00100000:0.0:1746140885.738388:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573705856 00000100:00100000:0.0:1746140885.738391:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573705856 00000100:00100000:0.0:1746140885.738420:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10720 00000100:00100000:0.0:1746140885.738424:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32649:x1830960573705856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140885.738436:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.738446:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36800/0x8156357b7fdba142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1616 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.738545:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738555:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738564:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738575:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738581:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738586:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738682:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738689:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738695:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140885.738703:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140885.738781:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738787:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738792:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738798:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a37800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140885.738801:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738807:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738814:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140885.738816:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140885.738819:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738823:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37800/0x8156357b7fdba149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738832:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738836:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738846:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738850:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a36c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140885.738852:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738856:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738860:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152100) 00010000:00010000:0.0:1746140885.738862:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140885.738864:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738867:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36c00/0x8156357b7fdba150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140885.738895:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36800/0x8156357b7fdba142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 18 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.738902:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 17 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.738907:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.738909:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140885.738910:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36400, rc 0) 00000100:00100000:0.0:1746140885.738927:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32649:x1830960573705856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 502us (1513us total) trans 8589945017 rc 0/0 00000100:00100000:0.0:1746140885.738932:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10720 00000100:00100000:0.0:1746140885.738960:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.738973:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573706496 00000100:00100000:0.0:1746140885.738976:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573706496 00000100:00100000:0.0:1746140885.738988:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16898 00000100:00100000:0.0:1746140885.738992:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573706496:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140885.738998:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.739005:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1639 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.739014:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.739016:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.739020:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 16 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.739030:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 16 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.739036:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36600, rc 0) 00000100:00100000:0.0:1746140885.739047:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573706496:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 55us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.739052:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16898 00000100:00100000:0.0:1746140885.739139:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.739148:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573706368 00000100:00100000:0.0:1746140885.739150:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573706368 00000100:00100000:0.0:1746140885.739178:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16899 00000100:00100000:0.0:1746140885.739183:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573706368:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140885.739189:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.739196:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1632 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.739205:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.739206:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.739210:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 14 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.739218:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 14 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.739224:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37400, rc 0) 00000100:00100000:0.0:1746140885.739235:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573706368:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.739240:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16899 00000100:00100000:1.0:1746140885.742842:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576043520:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140885.742864:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576043648:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140885.742888:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801399b4200/0x8156357b7fdba12d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a161d expref: 15 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.742888:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fc4c00/0x8156357b7fdba134 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1624 expref: 15 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.742902:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801399b4200/0x8156357b7fdba12d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a161d expref: 15 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.742913:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4200, rc 0) 00000100:00100000:2.0:1746140885.742955:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576043392:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.742970:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fc4600/0x8156357b7fdba126 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a160f expref: 38 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.742978:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fc4600/0x8156357b7fdba126 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a160f expref: 38 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.742990:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fc4600, rc 0) 00010000:00010000:1.0:1746140885.743019:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fc4c00/0x8156357b7fdba134 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1624 expref: 15 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140885.743228:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573705600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5374us (5562us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140885.743229:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573705984:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5241us (5483us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140885.743235:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16894 00000100:00100000:3.0:1746140885.743239:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16895 00010000:00010000:1.0:1746140885.743284:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fc4c00, rc 0) 00000100:00100000:1.0:1746140885.743301:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573706112:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5288us (5539us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140885.743334:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16896 00000100:00100000:1.0:1746140885.745170:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.745940:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.746004:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573706624 00000100:00100000:3.0:1746140885.746014:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573706624 00000100:00100000:0.0:1746140885.746038:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.746050:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573706752 00000100:00100000:3.0:1746140885.746052:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573706752 00000100:00100000:3.0:1746140885.746067:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16900 00000100:00100000:0.0:1746140885.746068:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.746073:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573706624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.746101:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.746118:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8b800/0x8156357b7fdba173 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1640 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.746152:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573707136 00000100:00100000:2.0:1746140885.746158:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16901 00000100:00100000:1.0:1746140885.746163:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573707136 00000100:00100000:2.0:1746140885.746168:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573706752:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140885.746169:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576043776:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.746175:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.746184:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1647 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.746197:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.746199:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.746207:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 23 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140885.746215:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16902 00010000:00010000:2.0:1746140885.746221:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 23 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140885.746222:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:32644:x1830960573707136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140885.746236:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5e00, rc 0) 00010000:00010000:1.0:1746140885.746237:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140885.746240:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45309c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746140885.746251:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1655 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.746257:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573706752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 93us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.746263:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16901 00010000:00010000:1.0:1746140885.746276:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.746284:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.746290:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 32 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.746295:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.746296:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.746299:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2351104->2781183] (req 2351104->2781183) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 32 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.746352:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 32 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.746354:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573707008 00000100:00100000:0.0:1746140885.746358:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573707008 00010000:00010000:1.0:1746140885.746363:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 32 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.746372:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576043904:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.746386:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10721 00000100:00100000:0.0:1746140885.746392:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:32646:x1830960573707008:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140885.746401:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.746413:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a164e expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.746506:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.746522:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 11 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.746528:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 16 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.746532:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.746553:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 16 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.746562:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 16 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.746570:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576044032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.746695:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.746717:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573707392 00000100:00100000:0.0:1746140885.746721:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573707392 00010000:00010000:1.0:1746140885.746743:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.746746:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4702 00010000:00010000:1.0:1746140885.746751:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 13 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.746751:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32640:x1830960573707392:12345-192.168.204.16@tcp:35:cat.0 00010000:00010000:2.0:1746140885.746753:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 11 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.746759:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576044160:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.746762:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 11 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.746771:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576044288:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140885.746788:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.746793:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00010000:00010000:1.0:1746140885.746796:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 23 pid: 24958 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.746803:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576044416:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.746823:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.746902:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32640:x1830960573707392:12345-192.168.204.16@tcp:35:cat.0 Request processed in 150us (206us total) trans 8589945018 rc 0/0 00000100:00100000:0.0:1746140885.746908:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4702 00000100:00100000:1.0:1746140885.748759:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576043904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.748843:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576043776:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140885.748872:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b800/0x8156357b7fdba173 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1640 expref: 22 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.748884:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b800/0x8156357b7fdba173 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1640 expref: 22 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.748895:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8b800, rc 0) 00000100:00100000:3.0:1746140885.749124:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573706624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3048us (3960us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140885.749131:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16900 00000100:00100000:3.0:1746140885.754815:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.754843:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573707648 00000100:00100000:3.0:1746140885.754852:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573707648 00010000:00010000:3.0:1746140885.754894:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 14 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.754929:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8752 00000100:00100000:3.0:1746140885.754936:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1982:x1830960573707648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.754948:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.754969:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 14 pid: 24958 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.754980:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 14 pid: 24958 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.755004:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.755042:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1982:x1830960573707648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.755048:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8752 00000100:00100000:3.0:1746140885.755080:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.755121:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573707520 00000100:00100000:3.0:1746140885.755124:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573707520 00010000:00010000:3.0:1746140885.755137:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 17 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.755159:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8753 00000100:00100000:3.0:1746140885.755164:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573707520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.755173:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.755178:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 17 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.755184:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 17 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.755198:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.755202:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.755214:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.755219:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.755234:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573707520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.755239:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8753 00010000:00010000:2.0:1746140885.755261:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36400/0x8156357b7fdba157 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1616 expref: 16 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.755276:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576044032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.755288:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.755289:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576044288:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.755299:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573707776 00000100:00100000:3.0:1746140885.755301:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573707776 00010000:00010000:2.0:1746140885.755325:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.755330:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 12 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.755345:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8754 00000100:00100000:3.0:1746140885.755349:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960573707776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.755355:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.755359:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 12 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.755366:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 12 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.755376:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4a00/0x8156357b7fdba118 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1601 expref: 12 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.755379:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140885.755385:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.755388:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140885.755392:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573707904 00010000:00010000:3.0:1746140885.755394:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140885.755394:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573707904 00010000:00010000:3.0:1746140885.755400:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.755416:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.755430:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573707776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.755435:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8754 00010000:00010000:0.0:1746140885.755458:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 33 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.755468:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140885.755468:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x8156357b7fdba16c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1632 expref: 13 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.755480:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573708032 00000100:00100000:0.0:1746140885.755483:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573708032 00000100:00100000:1.0:1746140885.755486:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576044160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.755488:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8755 00000100:00100000:3.0:1746140885.755493:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4909850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573707904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.755493:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 24 pid: 24958 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.755498:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576044416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.755500:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.755507:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 33 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.755507:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8756 00000100:00100000:0.0:1746140885.755511:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573708032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.755515:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 33 pid: 24958 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.755517:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.755523:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 24 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.755527:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801399b5200/0x8156357b7fdba0a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15d0 expref: 33 pid: 24958 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.755531:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 24 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.755551:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140885.755551:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2351104->2781183] (req 2351104->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 32 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.755557:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4e00/0x8156357b7fdb9ff2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a156e expref: 24 pid: 24958 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.755564:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4909850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573707904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140885.755565:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.755567:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140885.755569:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8755 00010000:00010000:0.0:1746140885.755572:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 32 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.755579:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 31 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.755589:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fc4e00, rc 0) 00010000:00010000:0.0:1746140885.755604:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 31 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.755616:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576044544:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140885.755632:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:32644:x1830960573707136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9410us (9562us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.755639:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16902 00000100:00100000:3.0:1746140885.755645:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.755653:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140885.755664:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573708160 00000100:00100000:1.0:1746140885.755668:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573708160 00000100:00100000:1.0:1746140885.755710:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16903 00000100:00100000:1.0:1746140885.755716:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32649:x1830960573708160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.755729:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.755740:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a165c expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.755762:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 36 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.755768:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140885.755769:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140885.755771:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.755791:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 36 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.755800:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 36 pid: 32376 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.755814:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576044672:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.755858:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6300 going to sleep for 11 seconds 00010000:00010000:2.0:1746140885.755874:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.755881:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:2.0:1746140885.755903:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140885.756030:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x8156357b7fdba188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.756042:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.756049:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.756051:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140885.756053:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36000, rc 0) 00000100:00100000:2.0:1746140885.756095:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:32646:x1830960573707008:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9702us (10056us total) trans 8589945019 rc 0/0 00000100:00100000:2.0:1746140885.756101:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10721 00000100:00100000:3.0:1746140885.757761:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.757815:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.757853:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576044672:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140885.757875:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.757888:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fc5c00, rc 0) 00000100:00100000:1.0:1746140885.757922:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32649:x1830960573708160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2205us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.757930:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16903 00000100:00100000:0.0:1746140885.757962:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576044544:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140885.757977:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.758003:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573708032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2490us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.758012:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8756 00000100:00100000:0.0:1746140885.758108:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573708416 00000100:00100000:0.0:1746140885.758113:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573708416 00002000:00100000:0.0:1746140885.758145:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2351104->2355199) req@ffff88009f123100 x1830960573708416/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.758155:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f123100 with x1830960573708416 ext(2351104->2355199) 00002000:00010000:0.0:1746140885.758158:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f123100 00000100:00100000:2.0:1746140885.758163:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573708544 00000100:00100000:2.0:1746140885.758166:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573708544 00000100:00100000:0.0:1746140885.758172:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8660 00000100:00100000:0.0:1746140885.758178:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573708416:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:2.0:1746140885.758184:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1982464->2097151) req@ffff88009f120000 x1830960573708544/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.758190:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f120000 with x1830960573708544 ext(1982464->2097151) 00010000:00010000:2.0:1746140885.758197:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 37 pid: 32376 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.758205:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140885.758208:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 37 pid: 32376 timeout: 964 lvb_type: 0 00002000:00010000:2.0:1746140885.758213:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f120000 00000100:00100000:2.0:1746140885.758234:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573708672 00000100:00100000:2.0:1746140885.758236:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573708672 00000100:00100000:2.0:1746140885.758272:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10722 00000100:00100000:2.0:1746140885.758277:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:32646:x1830960573708672:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140885.758289:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.758321:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4800/0x8156357b7fdba1a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1663 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.758334:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573708416:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 156us (579us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140885.758340:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8660 00002000:00100000:0.0:1746140885.758344:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2351104->2355199) req@ffff88009f123100 x1830960573708416/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.758350:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f123100 with x1830960573708416 ext(2351104->2355199) 00002000:00010000:0.0:1746140885.758353:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f123100 00000100:00100000:0.0:1746140885.758362:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1792 00000100:00100000:0.0:1746140885.758366:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573708544:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:2.0:1746140885.758396:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.758409:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.758415:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.758440:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.758450:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 12 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.758459:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576044800:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.758509:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.761842:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.761867:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573708800 00000100:00100000:0.0:1746140885.761873:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573708800 00010000:00010000:0.0:1746140885.761908:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.761932:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576044800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.761937:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8757 00000100:00100000:0.0:1746140885.761942:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1982:x1830960573708800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.761950:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.761953:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.761955:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.762024:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.762041:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x8156357b7fdba18f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a164e expref: 13 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.762055:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.762059:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.762068:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.762076:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.762118:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.762162:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960573708800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 218us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.762170:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8757 00010000:00010000:2.0:1746140885.762177:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.762188:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140885.762217:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00200000:2.0:1746140885.762236:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140885.762241:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746140885.762264:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140885.762283:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573709056 00000100:00100000:3.0:1746140885.762288:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573709056 00010000:00010000:2.0:1746140885.762301:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4800/0x8156357b7fdba1a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1663 expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.762339:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1663 expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140885.762344:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2777088->2781183) req@ffff88009abdc000 x1830960573709056/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746140885.762346:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.762349:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140885.762351:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5c00, rc 0) 00002000:00100000:3.0:1746140885.762353:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc000 with x1830960573709056 ext(2777088->2781183) 00002000:00010000:3.0:1746140885.762357:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdc000 00000100:00100000:3.0:1746140885.762371:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8661 00000100:00100000:2.0:1746140885.762377:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:32646:x1830960573708672:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4099us (4172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.762378:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573709056:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140885.762384:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10722 00000100:00100000:3.0:1746140885.762489:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573709056:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 109us (268us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140885.762495:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8661 00002000:00100000:3.0:1746140885.762500:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2777088->2781183) req@ffff88009abdc000 x1830960573709056/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.762507:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc000 with x1830960573709056 ext(2777088->2781183) 00002000:00010000:3.0:1746140885.762510:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdc000 00000100:00100000:1.0:1746140885.762878:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1983:x1830960573708544:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4506us (5058us total) trans 17179874099 rc 0/0 00000100:00100000:1.0:1746140885.762888:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1792 00002000:00100000:1.0:1746140885.762896:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1982464->2097151) req@ffff88009f120000 x1830960573708544/t17179874099(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.762904:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f120000 with x1830960573708544 ext(1982464->2097151) 00010000:00010000:1.0:1746140885.762911:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 39 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.762925:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 39 pid: 32376 timeout: 964 lvb_type: 0 00002000:00010000:1.0:1746140885.762936:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f120000 00000100:00100000:0.0:1746140885.765031:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.765069:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.765121:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.765145:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573709568 00000100:00100000:0.0:1746140885.765153:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573709568 00000100:00100000:3.0:1746140885.765182:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573709312 00010000:00010000:0.0:1746140885.765183:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 39 pid: 32376 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.765185:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573709312 00000100:00100000:2.0:1746140885.765363:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573709184 00000100:00100000:0.0:1746140885.765365:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8758 00000100:00100000:2.0:1746140885.765367:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573709184 00000100:00100000:0.0:1746140885.765372:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1982:x1830960573709568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.765384:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140885.765385:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16904 00000100:00100000:2.0:1746140885.765389:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573709312:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746140885.765402:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16905 00010000:00010000:2.0:1746140885.765403:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.765406:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 39 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.765417:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 39 pid: 32376 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.765420:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573709184:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140885.765436:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.765453:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a166a expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.765504:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67200/0x8156357b7fdba01c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a157c expref: 39 pid: 32376 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.765520:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801399b5000/0x8156357b7fdba1b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1671 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.765544:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.765554:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.765570:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140885.765572:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576044928:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140885.765580:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.765581:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.765586:0:4785:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 21 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.765594:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 21 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.765619:0:4785:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 21 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.765630:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576045056:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140885.765646:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.765685:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45303c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746140885.765691:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.765714:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573709568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 341us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.765721:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8758 00000100:00100000:0.0:1746140885.765843:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.765898:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573709824 00000100:00100000:0.0:1746140885.765902:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.765903:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573709824 00000100:00100000:3.0:1746140885.765927:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4703 00000100:00100000:3.0:1746140885.765932:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32644:x1830960573709824:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140885.766140:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:32644:x1830960573709824:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 206us (296us total) trans 8589945020 rc 0/0 00000100:00100000:3.0:1746140885.766146:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4703 00000100:00100000:2.0:1746140885.766327:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573709440 00000100:00100000:2.0:1746140885.766331:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573709440 00000100:00100000:2.0:1746140885.766352:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16906 00000100:00100000:2.0:1746140885.766356:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573709440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140885.766364:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.766374:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801399b4200/0x8156357b7fdba1c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1678 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.766399:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576045184:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140885.767216:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.767283:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576044928:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.767321:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801399b5000/0x8156357b7fdba1b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1671 expref: 15 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.767332:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5000/0x8156357b7fdba1b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1671 expref: 15 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.767342:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5000, rc 0) 00000100:00100000:2.0:1746140885.767363:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573709312:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1972us (2341us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140885.767369:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16904 00000100:00100000:3.0:1746140885.767475:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576045056:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140885.767485:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8ba00, rc 0) 00000100:00100000:3.0:1746140885.767507:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573709184:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2095us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.767513:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16905 00000100:00100000:2.0:1746140885.769111:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576045184:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140885.769136:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801399b4200/0x8156357b7fdba1c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1678 expref: 14 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.769149:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4200/0x8156357b7fdba1c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1678 expref: 14 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.769159:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4200, rc 0) 00000100:00100000:2.0:1746140885.769208:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573709440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2849us (3303us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140885.769214:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16906 00000100:00100000:0.0:1746140885.770663:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.771136:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573710080 00000100:00100000:2.0:1746140885.771144:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573710080 00000100:00100000:2.0:1746140885.771197:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10723 00000100:00100000:2.0:1746140885.771203:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:32646:x1830960573710080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140885.771219:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.771236:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba1c7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a167f expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.771372:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba1ce lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.771386:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba1ce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.771395:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba1ce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:2.0:1746140885.771407:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140885.771517:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5800/0x8156357b7fdba1c7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a167f expref: 14 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.771533:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba1ce lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a167f expref: 13 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.771540:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.771543:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140885.771546:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b4600, rc 0) 00000100:00100000:2.0:1746140885.771597:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+13:32646:x1830960573710080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 393us (938us total) trans 8589945021 rc 0/0 00000100:00100000:2.0:1746140885.771603:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10723 00000100:00100000:1.0:1746140885.772744:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.772789:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.772817:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.772848:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.772990:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573710720 00000100:00100000:3.0:1746140885.772993:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573710976 00000100:00100000:2.0:1746140885.772996:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573710720 00000100:00100000:3.0:1746140885.772997:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573710976 00000100:00100000:2.0:1746140885.773034:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16907 00000100:00100000:2.0:1746140885.773041:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573710720:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:3.0:1746140885.773052:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16908 00000100:00100000:3.0:1746140885.773058:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573710976:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746140885.773071:0:8459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.773079:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.773097:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 13 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.773099:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 21 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.773105:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.773105:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 30 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.773107:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140885.773109:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.773111:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 22 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.773116:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.773117:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.773119:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.773137:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 21 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.773137:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 22 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.773149:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 21 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.773149:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 22 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:3.0:1746140885.773161:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576045312:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.773161:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576045440:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.773222:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573710464 00000100:00100000:3.0:1746140885.773226:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573710464 00010000:00010000:2.0:1746140885.773245:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 30 pid: 32377 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746140885.773248:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880129e0ca80 x1830960573710464/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 504/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746140885.773254:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 30 pid: 32377 timeout: 964 lvb_type: 1 00002000:00100000:3.0:1746140885.773257:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0ca80 with x1830960573710464 ext(1048576->2097151) 00010000:00010000:3.0:1746140885.773262:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 22 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.773262:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576045568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.773271:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 22 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.773277:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129e0ca80 00010000:00010000:2.0:1746140885.773286:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 13 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140885.773291:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573710336 00000100:00100000:3.0:1746140885.773293:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573710336 00010000:00010000:2.0:1746140885.773293:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 13 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.773300:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b750e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576045696:192.168.204.16@tcp:104: 00002000:00100000:3.0:1746140885.773322:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880129e0df80 x1830960573710336/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.773329:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0df80 with x1830960573710336 ext(1048576->2097151) 00000100:00100000:2.0:1746140885.773338:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.773353:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1793 00000100:00100000:2.0:1746140885.773359:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573710464:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:3.0:1746140885.773622:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e0df80 00000100:00100000:3.0:1746140885.773643:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8662 00000100:00100000:3.0:1746140885.773648:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573710336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140885.773707:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140885.773788:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.773802:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.773802:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573711232 00000100:00100000:0.0:1746140885.773806:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573711232 00000100:00100000:1.0:1746140885.773813:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.773823:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573710848 00000100:00100000:0.0:1746140885.773824:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573710848 00000100:00100000:3.0:1746140885.773825:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573711104 00000100:00100000:3.0:1746140885.773827:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573711104 00000100:00100000:1.0:1746140885.773831:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.773836:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573711360 00000100:00100000:0.0:1746140885.773838:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573711360 00000100:00100000:3.0:1746140885.773851:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16909 00000100:00100000:0.0:1746140885.773855:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16910 00000100:00100000:3.0:1746140885.773856:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573711232:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:2.0:1746140885.773860:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16911 00000100:00100000:0.0:1746140885.773860:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573710848:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:1.0:1746140885.773865:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16912 00000100:00100000:2.0:1746140885.773866:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573711104:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:1.0:1746140885.773871:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573711360:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140885.773872:0:9872:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.773872:0:8458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.773881:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 30 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.773882:0:8460:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.773882:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.773884:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.773887:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140885.773888:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140885.773889:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 23 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.773890:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.773893:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.773893:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 37 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.773894:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.773895:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.773896:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.773899:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 23 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.773900:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.773905:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 30 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.773906:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 15 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.773907:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 30 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.773908:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 23 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.773911:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 30 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.773911:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.773911:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.773912:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.773912:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.773914:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.773915:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.773916:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 23 pid: 8458 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.773919:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576045824:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.773923:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576045952:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.773928:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 30 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.773928:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 15 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.773934:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 30 pid: 4785 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.773936:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 15 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.773942:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b750a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576046080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.773943:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576046208:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.773945:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746140885.773964:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 23 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.773965:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.773969:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.773971:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 23 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.773972:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 15 pid: 8458 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.773976:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.773979:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b753480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576046464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.773979:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576046336:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.773984:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576046592:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.773996:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.773996:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 37 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.774001:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746140885.774003:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.774003:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 37 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.774009:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b753800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576046720:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.774011:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576046848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.774027:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.774033:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.779217:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576045440:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.779224:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.779231:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576045568:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.779266:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.779293:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573711488 00000100:00100000:3.0:1746140885.779295:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576045312:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.779299:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573711488 00010000:00010000:3.0:1746140885.779337:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746140885.779356:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1064960->1339391) req@ffff88012d080700 x1830960573711488/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.779393:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080700 with x1830960573711488 ext(1064960->1339391) 00010000:00010000:0.0:1746140885.779401:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 26 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.779408:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573711744 00000100:00100000:1.0:1746140885.779411:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573711744 00010000:00010000:0.0:1746140885.779411:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 26 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:0.0:1746140885.779418:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d080700 00010000:00010000:1.0:1746140885.779432:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 23 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.779445:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1794 00000100:00100000:0.0:1746140885.779453:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573711488:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140885.779458:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8759 00000100:00100000:1.0:1746140885.779462:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573711744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.779472:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.779494:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 23 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.779502:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 23 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.779521:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e200/0x8156357b7fdb9ef6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14aa expref: 23 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.779537:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.779575:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573711744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.779580:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8759 00000100:00100000:1.0:1746140885.779608:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.779622:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573711616 00000100:00100000:1.0:1746140885.779624:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573711616 00010000:00010000:1.0:1746140885.779633:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 31 pid: 32377 timeout: 964 lvb_type: 1 00000100:00100000:1.0:1746140885.779653:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8760 00000100:00100000:1.0:1746140885.779658:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573711616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.779667:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.779673:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 31 pid: 32377 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.779681:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 31 pid: 32377 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.779743:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801354a8800/0x8156357b7fdb9f0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14cd expref: 31 pid: 32377 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.779751:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.779765:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573711616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.779771:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8760 00000100:00100000:2.0:1746140885.779987:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b750e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576045696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.780008:0:8459:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.781371:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573710464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8003us (8620us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746140885.781382:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1793 00002000:00100000:3.0:1746140885.781393:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880129e0ca80 x1830960573710464/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 504/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.781402:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0ca80 with x1830960573710464 ext(1048576->2097151) 00010000:00010000:3.0:1746140885.781411:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 26 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.781423:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 26 pid: 9872 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.781430:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129e0ca80 00000100:00100000:1.0:1746140885.781556:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.781647:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573711872 00000100:00100000:2.0:1746140885.781654:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573711872 00010000:00010000:2.0:1746140885.781679:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 16 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.781725:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8761 00000100:00100000:2.0:1746140885.781734:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573711872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.781744:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.781761:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 16 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.781770:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 16 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.781787:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec66a00/0x8156357b7fdb9e39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1472 expref: 16 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.781797:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.781798:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.781802:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.781809:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.781828:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.781859:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573711872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.781865:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8761 00010000:00010000:0.0:1746140885.782112:0:8459:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.782120:0:8459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.782141:0:8459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.782148:0:8459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.782155:0:8459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.782161:0:8459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801399b4400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140885.782165:0:8459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.782172:0:8459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.782187:0:8459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.782193:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4400/0x8156357b7fdba1dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.782530:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573710720:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 9488us (9709us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.782537:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16907 00000100:00100000:3.0:1746140885.782914:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576045824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.782930:0:9872:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.784284:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573710336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10630us (11487us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.784293:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8662 00002000:00100000:3.0:1746140885.784329:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880129e0df80 x1830960573710336/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.784346:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0df80 with x1830960573710336 ext(1048576->2097151) 00010000:00010000:3.0:1746140885.784354:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 24 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.784366:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 24 pid: 8458 timeout: 964 lvb_type: 0 00002000:00010000:3.0:1746140885.784372:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129e0df80 00000100:00100000:2.0:1746140885.786029:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.786100:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b750a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576046080:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.786129:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.786161:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b753480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576046464:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.786192:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b753800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576046720:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.786218:0:8460:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.786250:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.786270:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573712128 00000100:00100000:2.0:1746140885.786276:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573712128 00010000:00010000:2.0:1746140885.786323:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 16 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.786345:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573712384 00000100:00100000:2.0:1746140885.786348:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573712384 00010000:00010000:2.0:1746140885.786357:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 14 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.786371:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8762 00000100:00100000:2.0:1746140885.786376:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4909c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573712128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.786391:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.786415:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 16 pid: 24958 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.786426:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 16 pid: 24958 timeout: 964 lvb_type: 1 00010000:00010000:2.0:1746140885.786455:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.786612:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8763 00000100:00100000:3.0:1746140885.786620:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573712384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.786628:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.786642:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 14 pid: 8458 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.786650:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 14 pid: 8458 timeout: 964 lvb_type: 1 00010000:00010000:3.0:1746140885.786661:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fc5400/0x8156357b7fdba13b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a162b expref: 14 pid: 8458 timeout: 964 lvb_type: 1 00000100:00100000:2.0:1746140885.787905:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4909c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573712128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1521us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.787914:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8762 00000100:00100000:0.0:1746140885.788114:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576045952:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.788126:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576046592:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140885.788146:0:8458:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.788172:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x8156357b7fdba165 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1639 expref: 15 pid: 24958 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.788183:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576046208:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.788190:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576046336:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140885.788199:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576046848:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140885.788212:0:32377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.788342:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.788370:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.788383:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.788396:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573712768 00000100:00100000:0.0:1746140885.788399:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573712768 00010000:00010000:0.0:1746140885.788416:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.788431:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573712512 00000100:00100000:0.0:1746140885.788432:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573712512 00010000:00010000:0.0:1746140885.788440:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.788453:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573712256 00000100:00100000:0.0:1746140885.788455:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573712256 00010000:00010000:0.0:1746140885.788462:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 25 pid: 8459 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.788472:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8764 00000100:00100000:0.0:1746140885.788477:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573712768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140885.788484:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573711488:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9020us (9205us total) trans 17179874100 rc 0/0 00010000:00010000:0.0:1746140885.788487:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140885.788495:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1794 00010000:00010000:0.0:1746140885.788502:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 964 lvb_type: 0 00002000:00100000:1.0:1746140885.788506:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1064960->1339391) req@ffff88012d080700 x1830960573711488/t17179874100(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746140885.788511:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 964 lvb_type: 0 00002000:00100000:1.0:1746140885.788516:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080700 with x1830960573711488 ext(1064960->1339391) 00010000:00010000:1.0:1746140885.788523:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 25 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.788531:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801399b4c00/0x8156357b7fdb9feb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1567 expref: 22 pid: 24958 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.788534:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 25 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.788540:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746140885.788543:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d080700 00000100:00100000:0.0:1746140885.788554:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573712768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.788559:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8764 00000100:00100000:1.0:1746140885.788561:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573712000 00000100:00100000:1.0:1746140885.788565:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573712000 00000100:00100000:0.0:1746140885.788567:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8765 00000100:00100000:0.0:1746140885.788571:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573712512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.788577:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746140885.788585:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2351104->2781183) req@ffff88009b750e00 x1830960573712000/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746140885.788587:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 964 lvb_type: 1 00002000:00100000:1.0:1746140885.788592:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b750e00 with x1830960573712000 ext(2351104->2781183) 00010000:00010000:0.0:1746140885.788594:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.788597:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 30 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.788607:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8ba00/0x8156357b7fdba1b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a166a expref: 15 pid: 4785 timeout: 964 lvb_type: 1 00010000:00010000:1.0:1746140885.788608:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 30 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.788613:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746140885.788614:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b750e00 00000100:00100000:0.0:1746140885.788623:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573712512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.788628:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8765 00000100:00100000:1.0:1746140885.788629:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1795 00000100:00100000:1.0:1746140885.788634:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573712000:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140885.788635:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8766 00000100:00100000:0.0:1746140885.788640:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573712256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.788646:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.788652:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 24 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.788660:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 24 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.788669:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801399b5e00/0x8156357b7fdba17a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1647 expref: 24 pid: 8459 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.788676:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.788686:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573712256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.788691:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8766 00000100:00100000:0.0:1746140885.788714:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.788724:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573712640 00000100:00100000:0.0:1746140885.788726:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573712640 00010000:00010000:0.0:1746140885.788734:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 31 pid: 4785 timeout: 964 lvb_type: 1 00000100:00100000:0.0:1746140885.788746:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8767 00000100:00100000:0.0:1746140885.788750:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573712640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.788755:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.788761:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 31 pid: 4785 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.788774:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 31 pid: 4785 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.788784:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x8156357b7fdba093 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c9 expref: 31 pid: 4785 timeout: 964 lvb_type: 1 00010000:00010000:0.0:1746140885.788791:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.788793:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.788797:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.788806:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.788821:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.788832:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573712640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.788836:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8767 00000100:00100000:0.0:1746140885.788884:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.788893:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573712896 00000100:00100000:0.0:1746140885.788895:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573712896 00010000:00010000:0.0:1746140885.788904:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 38 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.788916:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8768 00000100:00100000:0.0:1746140885.788920:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573712896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.788928:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.788934:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 38 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.788942:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 38 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.788952:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f3200/0x8156357b7fdba0a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15de expref: 38 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.788960:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.788962:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.788964:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.788970:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.788982:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.788995:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573712896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 74us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.789000:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8768 00010000:00010000:1.0:1746140885.789005:0:32377:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.789012:0:32377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.789035:0:32377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.789042:0:32377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.789050:0:32377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.789056:0:32377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fc5000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140885.789059:0:32377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.789066:0:32377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.789075:0:32377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.789092:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fc5000/0x8156357b7fdba1ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.789118:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.789137:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+13:1983:x1830960573712384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2518us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.789137:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573711360:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 15266us (15304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.789144:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8763 00000100:00100000:1.0:1746140885.789145:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16912 00010000:00010000:2.0:1746140885.789216:0:8460:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.789224:0:8460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.789237:0:8460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.789243:0:8460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.789250:0:8460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.789254:0:8460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f081400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140885.789257:0:8460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.789262:0:8460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.789276:0:8460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.789282:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f081400/0x8156357b7fdba1f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.789324:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573711104:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 15458us (15509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.789329:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16911 00000100:00100000:0.0:1746140885.789801:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.791891:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573713024 00000100:00100000:2.0:1746140885.791903:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573713024 00000100:00100000:2.0:1746140885.791944:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16913 00000100:00100000:2.0:1746140885.791950:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:32649:x1830960573713024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.791968:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.791984:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1686 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.792008:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140885.792012:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.792018:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140885.792021:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 24 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.792034:0:8460:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.792046:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 24 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.792054:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f081a00, rc 0) 00000100:00100000:2.0:1746140885.792779:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:32649:x1830960573713024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 828us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.792785:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16913 00000100:00100000:2.0:1746140885.792835:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.792918:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573713152 00000100:00100000:3.0:1746140885.792922:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573713152 00010000:00010000:3.0:1746140885.792942:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 24 pid: 8458 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.792964:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8769 00000100:00100000:3.0:1746140885.792969:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4909450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573713152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.792976:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.792998:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 24 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.793007:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 24 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.793023:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fc5c00/0x8156357b7fdba196 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a165c expref: 24 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.793033:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.793034:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.793038:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793045:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793073:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.793103:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4909450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573713152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (267us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140885.793104:0:8458:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.793109:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8769 00010000:00010000:0.0:1746140885.793114:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.793141:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.793148:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.793155:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.793161:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131c26400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140885.793164:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.793170:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.793180:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.793186:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c26400/0x8156357b7fdba1ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.793449:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573710848:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 19587us (19643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.793457:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16910 00000100:00100000:2.0:1746140885.793641:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.793710:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573713280 00000100:00100000:3.0:1746140885.793713:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573713280 00010000:00010000:3.0:1746140885.793725:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 23 pid: 9872 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.793750:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8770 00000100:00100000:3.0:1746140885.793754:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573713280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.793760:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.793772:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 23 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.793779:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 23 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.793789:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f080e00/0x8156357b7fdba0d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1339391) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15ec expref: 23 pid: 9872 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.793796:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.793797:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.793800:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793805:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793817:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.793839:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573713280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.793847:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8770 00010000:00010000:3.0:1746140885.793863:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793869:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793883:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793888:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793894:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793899:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8b600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.793902:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793908:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793964:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.793965:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.793969:0:4785:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 21 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.793980:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 21 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.794002:0:4785:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 21 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.794013:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576046976:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140885.794258:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140885.795827:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573712000:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7188us (9802us total) trans 21474841380 rc 0/0 00000100:00100000:2.0:1746140885.795837:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1795 00002000:00100000:2.0:1746140885.795846:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2351104->2781183) req@ffff88009b750e00 x1830960573712000/t21474841380(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/448 e 0 to 0 dl 1746140896 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.795855:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b750e00 with x1830960573712000 ext(2351104->2781183) 00010000:00010000:2.0:1746140885.795864:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 31 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.795876:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 31 pid: 8458 timeout: 964 lvb_type: 0 00002000:00010000:2.0:1746140885.795882:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b750e00 00000100:00100000:3.0:1746140885.797869:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576046976:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140885.797894:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.797904:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b600/0x8156357b7fdba1e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.798023:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.798181:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573713408 00000100:00100000:2.0:1746140885.798187:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573713408 00010000:00010000:2.0:1746140885.798211:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 31 pid: 8458 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.798233:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8771 00000100:00100000:2.0:1746140885.798238:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573713408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.798248:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.798266:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 31 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.798276:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 31 pid: 8458 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.798420:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573710976:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 25360us (25569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.798428:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16908 00010000:00010000:2.0:1746140885.798671:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fc4e00/0x8156357b7fdba181 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->2781183) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1655 expref: 31 pid: 8458 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.798681:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.798683:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.798688:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.798695:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.798714:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.798731:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573713408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 493us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.798737:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8771 00000100:00100000:0.0:1746140885.799358:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140885.799414:0:9872:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.799422:0:9872:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.799442:0:9872:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.799449:0:9872:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.799455:0:9872:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.799461:0:9872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8a800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.799463:0:9872:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.799469:0:9872:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.799478:0:9872:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.799483:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8a800/0x8156357b7fdba1f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.799525:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573711232:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 25668us (25737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.799531:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16909 00000100:00100000:2.0:1746140885.799583:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573713664 00000100:00100000:2.0:1746140885.799590:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573713664 00002000:00100000:2.0:1746140885.799614:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012d081f80 x1830960573713664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.799623:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d081f80 with x1830960573713664 ext(1048576->2097151) 00002000:00010000:2.0:1746140885.799627:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d081f80 00000100:00100000:2.0:1746140885.799639:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8663 00000100:00100000:2.0:1746140885.799644:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573713664:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140885.803327:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.803642:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573713920 00000100:00100000:2.0:1746140885.803651:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573713920 00000100:00100000:2.0:1746140885.803714:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10724 00000100:00100000:2.0:1746140885.803721:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+13:32646:x1830960573713920:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746140885.803773:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746140885.803800:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5c00/0x8156357b7fdba1ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1663 expref: 13 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.803818:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdb9f4a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14fe expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.803828:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.803832:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140885.803862:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.803873:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 15 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.803881:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 276 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.803888:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 276 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.803894:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.803900:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 7/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.803930:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.803943:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 15 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.803961:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b750a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576047104:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.804716:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 276 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.804726:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 276 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.804739:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b751880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576047232:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.805216:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 276 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.805224:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 276 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.805231:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b752d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576047360:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.805261:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 15 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.805268:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 15 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.805276:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b751f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576047488:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.805292:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140885.808993:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.809024:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.809046:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.809070:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.809103:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573714048 00000100:00100000:1.0:1746140885.809110:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573714048 00010000:00010000:1.0:1746140885.809152:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 16 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.809179:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573714176 00000100:00100000:1.0:1746140885.809181:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573714176 00010000:00010000:1.0:1746140885.809193:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 277 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.809205:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573714304 00000100:00100000:1.0:1746140885.809206:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573714304 00010000:00010000:1.0:1746140885.809214:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 278 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.809221:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b750a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576047104:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.809221:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573714432 00000100:00100000:1.0:1746140885.809223:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573714432 00010000:00010000:1.0:1746140885.809230:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 17 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.809232:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b751880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576047232:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.809240:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b752d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576047360:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140885.809240:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8772 00000100:00100000:1.0:1746140885.809246:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573714048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140885.809247:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b751f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576047488:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140885.809258:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.809264:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 17 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.809273:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 17 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.809349:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8773 00000100:00100000:3.0:1746140885.809356:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1985:x1830960573714176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140885.809363:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140885.809372:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 278 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:0.0:1746140885.809409:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8774 00000100:00100000:0.0:1746140885.809416:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1982:x1830960573714304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.809424:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.809428:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 278 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.809861:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.809911:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 278 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.809934:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 278 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.809946:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37000/0x8156357b7fdba085 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15c2 expref: 278 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.809964:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.809968:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.809976:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.810016:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:1982:x1830960573714304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 601us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.810023:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8774 00000100:00100000:0.0:1746140885.810040:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8775 00000100:00100000:0.0:1746140885.810046:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573714432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.810053:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.810057:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 17 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.810075:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 17 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.810095:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdb9f43 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a14f7 expref: 17 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.810104:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.810107:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.810110:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b5600/0x8156357b7fdba0c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a15e5 expref: 16 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:0.0:1746140885.810112:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.810127:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573714432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.810132:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8775 00010000:00010000:1.0:1746140885.810160:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.810167:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.810263:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.810347:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573714048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1099us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.810356:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8772 00010000:00010000:3.0:1746140885.810380:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f800/0x8156357b7fdb9f51 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1505 expref: 276 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.810391:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.810394:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.810402:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.810409:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.810426:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.810447:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:1985:x1830960573714176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1092us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.810453:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8773 00010000:00010000:2.0:1746140885.810585:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.810593:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140885.811135:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573713664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11489us (11782us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.811144:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8663 00002000:00100000:3.0:1746140885.811151:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012d081f80 x1830960573713664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.811161:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d081f80 with x1830960573713664 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.811166:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d081f80 00000040:00080000:2.0:1746140885.811179:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3421, 88 off289712 00000004:00080000:2.0:1746140885.811185:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864886879932ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811236:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3450, 88 off292440 00000004:00080000:2.0:1746140885.811241:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864886935702ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.811253:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3451, 88 off292528 00000004:00080000:2.0:1746140885.811255:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864886950343ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.811262:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3422, 88 off289800 00000004:00080000:2.0:1746140885.811264:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864886959627ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811270:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3423, 88 off289888 00000004:00080000:2.0:1746140885.811272:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864886967406ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811278:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3452, 88 off292616 00000004:00080000:2.0:1746140885.811280:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864886975742ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.811286:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3453, 88 off292704 00000004:00080000:2.0:1746140885.811289:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864886984210ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.811295:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3454, 88 off292792 00000004:00080000:2.0:1746140885.811297:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864886992015ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.811330:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3424, 88 off289976 00000004:00080000:2.0:1746140885.811333:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864887028450ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811342:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3455, 88 off292880 00000004:00080000:2.0:1746140885.811345:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864887039993ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.811351:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3425, 88 off290064 00000004:00080000:2.0:1746140885.811353:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864887048381ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811359:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3456, 88 off292968 00000004:00080000:2.0:1746140885.811361:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864887056515ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.811367:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3426, 88 off290152 00000004:00080000:2.0:1746140885.811369:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864887064030ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811374:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3427, 88 off290240 00000004:00080000:2.0:1746140885.811377:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864887071886ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811382:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3428, 88 off290328 00000004:00080000:2.0:1746140885.811385:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864887079933ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811391:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3429, 88 off290416 00000004:00080000:2.0:1746140885.811393:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864887088391ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.811399:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3457, 88 off293056 00000004:00080000:2.0:1746140885.811402:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864887096945ns, next at 809142599738ns, rc = 0 00000100:00100000:0.0:1746140885.815264:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.815406:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573714560 00000100:00100000:1.0:1746140885.815414:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573714560 00000100:00100000:1.0:1746140885.815457:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16914 00000100:00100000:1.0:1746140885.815465:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32649:x1830960573714560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.815482:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.815499:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a168d expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140885.815521:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed6, atime: 0x6813fed5, ctime: 0x6813fed6, blocks: 0x821 00010000:00010000:1.0:1746140885.815538:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.815540:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.815547:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 22 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.815560:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 22 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.815568:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5a00, rc 0) 00000100:00100000:1.0:1746140885.815615:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32649:x1830960573714560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 151us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.815621:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16914 00000100:00100000:1.0:1746140885.817981:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.818180:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573714688 00000100:00100000:0.0:1746140885.818190:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573714688 00000100:00100000:0.0:1746140885.818249:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10725 00000100:00100000:0.0:1746140885.818257:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32649:x1830960573714688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140885.818278:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.818295:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1694 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.818391:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.818400:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.818422:0:14742:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.818432:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.818444:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.818446:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140885.818450:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.818455:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36e00, rc 0) 00000100:00100000:0.0:1746140885.818506:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32649:x1830960573714688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 250us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.818512:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10725 00000001:00080000:1.0:1746140885.831327:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945018 is committed 00000001:00080000:1.0:1746140885.831339:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945017 is committed 00000001:00080000:1.0:1746140885.831354:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945022 is committed 00000004:00080000:1.0:1746140885.831357:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2700 committed 00000004:00010000:0.0:1746140885.831358:0:27790:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d082300 reply state ffff8800935afc00 transno 8589945022 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00000004:00080000:1.0:1746140885.831364:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2675 committed 00000100:00100000:0.0:1746140885.831367:0:27790:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1746140885.831368:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2674 committed 00000004:00080000:1.0:1746140885.831369:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2673 committed 00000004:00080000:1.0:1746140885.831370:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2672 committed 00000004:00080000:1.0:1746140885.831372:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2699 committed 00000004:00080000:1.0:1746140885.831373:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2671 committed 00000004:00080000:1.0:1746140885.831374:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2698 committed 00000004:00080000:1.0:1746140885.831375:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2670 committed 00000004:00080000:1.0:1746140885.831376:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2697 committed 00000004:00080000:1.0:1746140885.831377:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2696 committed 00000004:00080000:1.0:1746140885.831378:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2695 committed 00000004:00080000:1.0:1746140885.831379:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2669 committed 00000004:00080000:1.0:1746140885.831380:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2668 committed 00000004:00080000:1.0:1746140885.831381:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2694 committed 00000004:00080000:1.0:1746140885.831382:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2693 committed 00000004:00080000:1.0:1746140885.831384:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2667 committed 00000001:00080000:1.0:1746140885.831405:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945020 is committed 00010000:00080000:0.0:1746140885.831451:0:27790:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746140885.831465:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:32646:x1830960573713920:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 27740us (28166us total) trans 8589945022 rc 0/0 00000100:00100000:0.0:1746140885.831473:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10724 00010000:00010000:1.0:1746140885.831544:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.831551:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.831557:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.831562:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f080c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140885.831566:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.831572:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.831587:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.831594:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140885.831598:0:3296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 6 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.831608:0:3296:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 6 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.831614:0:3296:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 6 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.831903:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576047616:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746140885.831937:0:3296:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 6 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.831945:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.831946:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3296:1830960576049664:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140885.831969:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576048128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.831983:0:3296:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.831984:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.831996:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576048000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.831997:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576048640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.832015:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.832018:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576047872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832035:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576048512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.832048:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.832052:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576047744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.832063:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576048384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832067:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.832076:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.832079:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576048256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.832099:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576048896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.832105:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.832121:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576048768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.832134:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.832143:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576049280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.832153:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.832174:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576048128 00000100:00100000:1.0:1746140885.832181:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576048128 00000100:00100000:2.0:1746140885.832189:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576048000 00000100:00100000:2.0:1746140885.832194:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576048000 00000100:00100000:1.0:1746140885.832203:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576047872 00000100:00100000:1.0:1746140885.832204:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576047872 00000100:00100000:3.0:1746140885.832281:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576047616 00000100:00100000:3.0:1746140885.832285:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576047616 00000100:00100000:1.0:1746140885.832321:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576047744 00000100:00100000:2.0:1746140885.832322:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576048384 00000100:00100000:1.0:1746140885.832324:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576047744 00000100:00100000:3.0:1746140885.832326:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576048256 00000100:00100000:2.0:1746140885.832326:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576048384 00000100:00100000:0.0:1746140885.832327:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576048768 00000100:00100000:3.0:1746140885.832329:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576048256 00000100:00100000:0.0:1746140885.832329:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576048768 00000100:00100000:1.0:1746140885.832333:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576049280 00000100:00100000:1.0:1746140885.832334:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576049280 00000100:00100000:3.0:1746140885.832339:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16915 00000100:00100000:3.0:1746140885.832344:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3311:x1830960576048128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.832347:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16916 00000100:00100000:0.0:1746140885.832352:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16917 00000100:00100000:2.0:1746140885.832353:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3310:x1830960576048000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832355:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16918 00000100:00100000:0.0:1746140885.832357:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3313:x1830960576047872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832359:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3311:x1830960576047616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.832371:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16919 00000100:00100000:0.0:1746140885.832374:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+67:3312:x1830960576047744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.832390:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16920 00000100:00100000:2.0:1746140885.832394:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3313:x1830960576048384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832395:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16921 00000100:00100000:1.0:1746140885.832400:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3312:x1830960576048256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.832402:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16922 00000100:00100000:0.0:1746140885.832405:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3312:x1830960576048768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.832469:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16923 00000100:00100000:3.0:1746140885.832473:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3312:x1830960576049280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140885.832493:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746140885.832496:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3312:x1830960576048256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (389us total) trans 17179874101 rc 0/0 00002000:00010000:0.0:1746140885.832496:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.832498:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140885 -> 1746140885 00002000:00010000:0.0:1746140885.832500:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00000100:00100000:1.0:1746140885.832501:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16921 00002000:00010000:0.0:1746140885.832502:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140885.832517:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:3312:x1830960576048768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (382us total) trans 21474841381 rc 0/0 00000100:00100000:1.0:1746140885.832521:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140885.832521:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16922 00000100:00100000:0.0:1746140885.832530:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576048512 00000100:00100000:1.0:1746140885.832532:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576049024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.832532:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576048512 00000100:00100000:2.0:1746140885.832536:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:3310:x1830960576048000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (519us total) trans 17179874103 rc 0/0 00000100:00100000:2.0:1746140885.832541:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16916 00000100:00100000:0.0:1746140885.832544:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16924 00000100:00100000:0.0:1746140885.832548:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3310:x1830960576048512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832550:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.832554:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3312:x1830960576049280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (399us total) trans 21474841382 rc 0/0 00000100:00100000:3.0:1746140885.832559:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16923 00000100:00100000:1.0:1746140885.832561:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576049536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.832567:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576049024 00000100:00100000:3.0:1746140885.832569:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576049024 00000100:00100000:1.0:1746140885.832572:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746140885.832598:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0f800/2, rc 0, transno 17179874103 00000100:00100000:1.0:1746140885.832602:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576048000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832613:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576049536 00000100:00100000:1.0:1746140885.832615:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576049536 00000100:00100000:2.0:1746140885.832620:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+71:3311:x1830960576047616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (674us total) trans 17179874104 rc 0/0 00000100:00100000:2.0:1746140885.832625:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16918 00000100:00100000:1.0:1746140885.832628:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16925 00000100:00100000:1.0:1746140885.832632:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+71:3310:x1830960576049024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.832635:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16926 00000100:00100000:2.0:1746140885.832639:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+71:3310:x1830960576049536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140885.832647:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140885.832650:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00000100:00100000:3.0:1746140885.832651:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746140885.832652:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.832653:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.832655:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140885.832665:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576049408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.832672:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+71:3312:x1830960576047744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 297us (604us total) trans 17179874106 rc 0/0 00000100:00100000:0.0:1746140885.832677:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16919 00000100:00100000:3.0:1746140885.832679:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140885.832686:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576048896 00000100:00100000:0.0:1746140885.832688:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576048896 00000100:00100000:3.0:1746140885.832695:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576049408 00000100:00100000:3.0:1746140885.832697:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576049408 00000100:00100000:0.0:1746140885.832701:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16927 00000100:00100000:0.0:1746140885.832705:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960576048896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.832707:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16928 00000100:00100000:1.0:1746140885.832710:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3310:x1830960576049024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (158us total) trans 21474841383 rc 0/0 00000100:00100000:3.0:1746140885.832711:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960576049408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.832715:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16925 00000100:00100000:2.0:1746140885.832716:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3310:x1830960576049536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (142us total) trans 21474841384 rc 0/0 00000100:00100000:2.0:1746140885.832721:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16926 00000004:00080000:1.0:1746140885.832734:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0d180/2, rc 0, transno 17179874106 00000100:00100000:1.0:1746140885.832737:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576047744:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.832744:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cd500/2, rc 0, transno 17179874101 00000100:00100000:1.0:1746140885.832746:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576048256:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.832752:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cca80/2, rc 0, transno 21474841381 00000100:00100000:1.0:1746140885.832757:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576048768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140885.832762:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094add180/2, rc 0, transno 21474841382 00000100:00100000:1.0:1746140885.832765:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576049280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.832780:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960576048896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (129us total) trans 21474841385 rc 0/0 00000100:00100000:0.0:1746140885.832785:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16927 00000100:00100000:3.0:1746140885.832789:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960576049408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (109us total) trans 21474841386 rc 0/0 00000100:00100000:2.0:1746140885.832793:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+71:3313:x1830960576048384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 398us (716us total) trans 17179874107 rc 0/0 00000100:00100000:3.0:1746140885.832794:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16928 00000004:00080000:1.0:1746140885.832795:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adc000/2, rc 0, transno 21474841383 00000100:00100000:1.0:1746140885.832798:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576049024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.832799:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16920 00000004:00080000:1.0:1746140885.832816:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3b5c00/2, rc 0, transno 21474841384 00000100:00100000:1.0:1746140885.832819:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576049536:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140885.832822:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ced80/2, rc 0, transno 17179874107 00000100:00100000:1.0:1746140885.832822:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746140885.832826:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576048384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832828:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576049792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140885.832832:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adc700/2, rc 0, transno 21474841385 00000100:00100000:3.0:1746140885.832834:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576048896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140885.832839:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adca80/2, rc 0, transno 21474841386 00000100:00100000:3.0:1746140885.832842:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576049408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.832844:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.832850:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576049792 00000100:00100000:3.0:1746140885.832852:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576049792 00000100:00100000:3.0:1746140885.832862:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16929 00000100:00100000:3.0:1746140885.832865:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+74:3310:x1830960576049792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.832896:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3313:x1830960576047872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 539us (847us total) trans 17179874108 rc 0/0 00000100:00100000:0.0:1746140885.832901:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16917 00000004:00080000:2.0:1746140885.832907:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0fb80/2, rc 0, transno 17179874108 00000100:00100000:2.0:1746140885.832911:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576047872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.832932:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:3310:x1830960576049792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (88us total) trans 21474841387 rc 0/0 00000100:00100000:3.0:1746140885.832937:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16929 00000004:00080000:1.0:1746140885.832943:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c3800/2, rc 0, transno 21474841387 00000100:00100000:1.0:1746140885.832946:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576049792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.832948:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.832958:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576049152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.832962:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576048640 00000100:00100000:2.0:1746140885.832965:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576048640 00000100:00100000:3.0:1746140885.832970:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.832979:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576049152 00000100:00100000:2.0:1746140885.832981:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576049152 00000100:00100000:1.0:1746140885.832983:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16930 00000004:00080000:3.0:1746140885.832985:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0ce00/2, rc 0, transno 17179874104 00000100:00100000:3.0:1746140885.832987:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576047616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.832988:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960576048640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.832991:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16931 00000100:00100000:2.0:1746140885.832994:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960576049152:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140885.832997:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cf800/2, rc 0, transno 17179874102 00000100:00100000:0.0:1746140885.832997:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+70:3311:x1830960576048128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 653us (1012us total) trans 17179874102 rc 0/0 00000100:00100000:3.0:1746140885.833000:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576048128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.833001:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16915 00000100:00100000:1.0:1746140885.833064:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+78:3311:x1830960576048640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (114us total) trans 21474841388 rc 0/0 00000100:00100000:1.0:1746140885.833068:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16930 00000004:00080000:3.0:1746140885.833069:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ce680/2, rc 0, transno 21474841388 00000100:00100000:3.0:1746140885.833072:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576048640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.833075:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3311:x1830960576049152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (103us total) trans 21474841389 rc 0/0 00000004:00080000:3.0:1746140885.833078:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adf100/2, rc 0, transno 21474841389 00000100:00100000:3.0:1746140885.833091:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576049152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.833091:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16931 00000100:00100000:1.0:1746140885.833115:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3310:x1830960576048512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 566us (592us total) trans 17179874105 rc 0/0 00000100:00100000:1.0:1746140885.833120:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16924 00000004:00080000:0.0:1746140885.833128:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cdc00/2, rc 0, transno 17179874105 00000100:00100000:0.0:1746140885.833131:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576048512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.834028:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.834109:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573714816 00000100:00100000:2.0:1746140885.834113:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573714816 00000100:00100000:2.0:1746140885.834148:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10726 00000100:00100000:2.0:1746140885.834154:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:32646:x1830960573714816:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140885.834169:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.834182:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a169b expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.834221:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.834231:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.834245:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.834248:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140885.834251:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66000, rc 0) 00000100:00100000:2.0:1746140885.834291:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:32646:x1830960573714816:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 136us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.834296:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10726 00000100:00100000:0.0:1746140885.834747:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.834751:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3296:1830960576049664:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140885.834767:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140885.834773:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x8156357b7fdba20d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.834797:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573714944 00000100:00100000:2.0:1746140885.834801:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573714944 00000100:00100000:2.0:1746140885.834831:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4704 00000100:00100000:2.0:1746140885.834836:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32649:x1830960573714944:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:2.0:1746140885.834902:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32649:x1830960573714944:12345-192.168.204.16@tcp:49:cat.0 Request processed in 65us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.834907:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4704 00000100:00100000:0.0:1746140885.836595:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.836741:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573715072 00000100:00100000:2.0:1746140885.836750:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573715072 00000100:00100000:2.0:1746140885.836788:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10727 00000100:00100000:2.0:1746140885.836793:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5189050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:32646:x1830960573715072:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140885.836804:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.836815:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba229 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16a2 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.836861:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67800/0x8156357b7fdba230 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.836869:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67800/0x8156357b7fdba230 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.836876:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67800/0x8156357b7fdba230 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:2.0:1746140885.836892:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140885.836895:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746140885.836903:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67800/0x8156357b7fdba230 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.836917:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba229 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a2 expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.836925:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67800/0x8156357b7fdba230 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a2 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.836929:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.836931:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140885.836933:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67800, rc 0) 00000100:00100000:2.0:1746140885.836963:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5189050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:32646:x1830960573715072:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 169us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.836968:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10727 00000100:00100000:0.0:1746140885.843585:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.843619:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.843651:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573715200 00000100:00100000:0.0:1746140885.843652:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.843660:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573715200 00000100:00100000:0.0:1746140885.843679:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.843692:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.843698:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573715328 00000100:00100000:2.0:1746140885.843700:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573715328 00000100:00100000:2.0:1746140885.843712:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573715584 00000100:00100000:2.0:1746140885.843713:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573715584 00000100:00100000:2.0:1746140885.843723:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573715840 00000100:00100000:2.0:1746140885.843724:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573715840 00000100:00100000:2.0:1746140885.843733:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573715456 00000100:00100000:2.0:1746140885.843735:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573715456 00000100:00100000:2.0:1746140885.843748:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16932 00000100:00100000:2.0:1746140885.843755:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573715200:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:0.0:1746140885.843756:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140885.843771:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140885.843774:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573715712 00000100:00100000:0.0:1746140885.843778:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573715712 00010000:00010000:2.0:1746140885.843790:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16a9 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.843797:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16933 00000100:00100000:0.0:1746140885.843802:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573715328:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140885.843811:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746140885.843815:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fed5, atime: 0x6813fed5, ctime: 0x6813fed5, blocks: 0x821 00010000:00010000:0.0:1746140885.843822:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16b0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.843832:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.843833:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746140885.843837:0:8458:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed6, atime: 0x6813fed6, ctime: 0x6813fed6, blocks: 0x821 00010000:00010000:2.0:1746140885.843842:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 14 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.843846:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.843847:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.843852:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 14 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.843856:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 14 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.843863:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 14 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.843865:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547ce00, rc 0) 00010000:00010000:0.0:1746140885.843870:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37800, rc 0) 00000100:00100000:0.0:1746140885.843902:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573715328:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 100us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.843907:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16933 00000100:00100000:0.0:1746140885.843922:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16934 00000100:00100000:0.0:1746140885.843926:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573715584:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746140885.843928:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16935 00010000:00010000:0.0:1746140885.843931:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140885.843937:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573715840:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140885.843938:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16be expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.843943:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.843947:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.843948:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.843951:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16cc expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.843952:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746140885.843963:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fed6, atime: 0x6813fed5, ctime: 0x6813fed6, blocks: 0x1029 00010000:00010000:0.0:1746140885.843963:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.843970:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36600, rc 0) 00010000:00010000:1.0:1746140885.843983:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.843985:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.843989:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 14 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.844003:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 14 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.844010:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a62c600, rc 0) 00000100:00100000:3.0:1746140885.844031:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16936 00000100:00100000:3.0:1746140885.844038:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573715456:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140885.844045:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.844053:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16b7 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.844063:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.844064:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.844069:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 15 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.844077:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 15 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.844097:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8b200, rc 0) 00000100:00100000:2.0:1746140885.844341:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573715200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 585us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.844346:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16932 00000100:00100000:2.0:1746140885.844358:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16937 00000100:00100000:2.0:1746140885.844363:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573715712:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140885.844369:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.844376:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16c5 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140885.844387:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fed6, atime: 0x6813fed6, ctime: 0x6813fed6, blocks: 0x1589 00010000:00010000:2.0:1746140885.844395:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.844396:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.844400:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 15 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.844408:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 15 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140885.844415:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f080c00, rc 0) 00000100:00100000:2.0:1746140885.844431:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573715712:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 68us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.844435:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16937 00000100:00100000:0.0:1746140885.844585:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573715584:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 656us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.844590:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573715840:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 654us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.844590:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16934 00000100:00100000:1.0:1746140885.844596:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16935 00000100:00100000:0.0:1746140885.844627:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.844656:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573716096 00000100:00100000:2.0:1746140885.844660:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573716096 00002000:00100000:2.0:1746140885.844683:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012d080000 x1830960573716096/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.844691:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080000 with x1830960573716096 ext(1048576->2097151) 00002000:00010000:2.0:1746140885.844695:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d080000 00000100:00100000:2.0:1746140885.844708:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8664 00000100:00100000:2.0:1746140885.844713:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573716096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140885.844743:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573715456:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 704us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.844748:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16936 00000100:00100000:0.0:1746140885.853072:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.853220:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573716352 00000100:00100000:2.0:1746140885.853231:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573716352 00000100:00100000:2.0:1746140885.853295:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8665 00000100:00100000:2.0:1746140885.853357:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:1982:x1830960573716352:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746140885.853394:0:21376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.853407:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.853409:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.853413:0:21376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.853424:0:21376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.858655:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.858685:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.858710:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.858731:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.858745:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.858765:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573716864 00000100:00100000:3.0:1746140885.858774:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573716864 00000100:00100000:2.0:1746140885.858789:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573716736 00000100:00100000:2.0:1746140885.858793:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573716736 00000100:00100000:3.0:1746140885.858821:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573717120 00000100:00100000:3.0:1746140885.858823:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573717120 00000100:00100000:3.0:1746140885.858836:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573717376 00000100:00100000:3.0:1746140885.858837:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573717376 00000100:00100000:3.0:1746140885.858849:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573717248 00000100:00100000:3.0:1746140885.858850:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573717248 00000100:00100000:2.0:1746140885.858864:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8666 00000100:00100000:2.0:1746140885.858871:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+17:1983:x1830960573716864:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:3.0:1746140885.858875:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8667 00000100:00100000:3.0:1746140885.858880:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573717120:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140885.858903:0:21692:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.858903:0:8463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.858915:0:21692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.858915:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.858917:0:21692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.858917:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.858921:0:21692:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.858921:0:8463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.858932:0:21692:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.858932:0:8463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.859280:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8668 00000100:00100000:1.0:1746140885.859296:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573717376:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140885.859361:0:32428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.859371:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.859373:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.859377:0:32428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.859609:0:32428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.860162:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8669 00000100:00100000:0.0:1746140885.860172:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+18:1983:x1830960573716736:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140885.860193:0:32429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.860202:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.860204:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.860207:0:32429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.860216:0:32429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.860235:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8670 00000100:00100000:2.0:1746140885.860242:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573717248:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746140885.860260:0:21691:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.860267:0:21691:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.860269:0:21691:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140885.860271:0:21691:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.860280:0:21691:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.862718:0:21376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.862735:0:21376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.862743:0:21376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.862750:0:21376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f081800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.862755:0:21376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.862763:0:21376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.862781:0:21376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.862786:0:21376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f081800/0x8156357b7fdba261 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.863033:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+18:1982:x1830960573716352:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 9725us (9968us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.863043:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8665 00000100:00100000:1.0:1746140885.863197:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.863262:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.863281:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573717760 00000100:00100000:1.0:1746140885.863289:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573717760 00000100:00100000:3.0:1746140885.863326:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573718016 00000100:00100000:3.0:1746140885.863329:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573718016 00000100:00100000:1.0:1746140885.863353:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8671 00000100:00100000:3.0:1746140885.863359:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8672 00000100:00100000:1.0:1746140885.863360:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:28b972ba-4133-49d1-b679-ce80456803d9+18:1983:x1830960573717760:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:3.0:1746140885.863363:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28b972ba-4133-49d1-b679-ce80456803d9+20:1983:x1830960573718016:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140885.863388:0:8465:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.863388:0:21689:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.863398:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.863398:0:21689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.863400:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.863400:0:21689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.863405:0:8465:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.863405:0:21689:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.863414:0:8465:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.863415:0:21689:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.863728:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573716096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19013us (19098us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.863735:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8664 00002000:00100000:2.0:1746140885.863743:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012d080000 x1830960573716096/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.863752:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080000 with x1830960573716096 ext(1048576->2097151) 00002000:00010000:2.0:1746140885.863756:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d080000 00000100:00100000:0.0:1746140885.870247:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.870300:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573718272 00000100:00100000:3.0:1746140885.870321:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573718272 00000100:00100000:3.0:1746140885.870367:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10728 00000100:00100000:3.0:1746140885.870375:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:32654:x1830960573718272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.870395:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.870413:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16d3 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.870532:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870545:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870555:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870567:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870572:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870577:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870672:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870678:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870687:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140885.870696:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140885.870749:0:8463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.870759:0:8463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.870766:0:8463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.870772:0:8463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f081600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140885.870776:0:8463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.870782:0:8463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.870798:0:8463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.870809:0:8463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x8156357b7fdba268 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.870818:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870823:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870827:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870831:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8bc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.870834:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870838:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870845:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.870848:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140885.870851:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870856:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8bc00/0x8156357b7fdba2ae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870870:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.870873:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+18:1983:x1830960573716864:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 12002us (12227us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746140885.870874:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.870881:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8666 00010000:00010000:3.0:1746140885.870882:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870886:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8aa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.870888:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870894:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870900:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140885.870902:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.870905:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870909:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8aa00/0x8156357b7fdba2a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870916:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870921:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.870926:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.871343:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8be00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.871347:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.871352:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.871362:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388200) 00010000:00010000:3.0:1746140885.871364:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.871366:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.871370:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba2a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.871404:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba299 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16d3 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.871410:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16d3 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.871416:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8ba00, rc 0) 00000100:00100000:3.0:1746140885.871434:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32654:x1830960573718272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1061us (1201us total) trans 8589945023 rc 301/301 00000100:00100000:3.0:1746140885.871440:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10728 00010000:00010000:3.0:1746140885.873901:0:21692:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.873917:0:21692:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.873926:0:21692:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.873933:0:21692:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8b000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.873938:0:21692:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.873945:0:21692:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.873962:0:21692:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.873968:0:21692:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b000/0x8156357b7fdba26f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.874044:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:28b972ba-4133-49d1-b679-ce80456803d9+20:1983:x1830960573717120:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 15159us (15328us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.874054:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8667 00000100:00100000:0.0:1746140885.874536:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.874560:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.874583:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.874617:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.874645:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573718400 00000100:00100000:1.0:1746140885.874652:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573718400 00000100:00100000:3.0:1746140885.874670:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573718528 00000100:00100000:3.0:1746140885.874674:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573718528 00000100:00100000:1.0:1746140885.874679:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573718784 00000100:00100000:1.0:1746140885.874681:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573718784 00000100:00100000:3.0:1746140885.874734:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573718656 00000100:00100000:3.0:1746140885.874736:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573718656 00000100:00100000:1.0:1746140885.874739:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16938 00000100:00100000:1.0:1746140885.874746:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573718400:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140885.874754:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16939 00000100:00100000:3.0:1746140885.874759:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573718528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.874760:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140885.874763:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16940 00010000:00010000:3.0:1746140885.874767:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140885.874770:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573718784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.874775:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16e1 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.874776:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16da expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.874778:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.874785:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16ef expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.874791:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.874791:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.874792:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.874793:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.874796:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.874797:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.874799:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.874800:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 25 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.874802:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 25 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.874812:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.874812:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 25 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.874814:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 25 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.874820:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82400, rc 0) 00010000:00010000:3.0:1746140885.874822:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ee00, rc 0) 00010000:00010000:1.0:1746140885.874823:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5216400, rc 0) 00000100:00100000:0.0:1746140885.874840:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573718784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 72us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.874841:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573718528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.874845:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16939 00000100:00100000:1.0:1746140885.874846:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573718400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.874853:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16940 00000100:00100000:1.0:1746140885.874856:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16938 00000100:00100000:3.0:1746140885.874858:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16941 00000100:00100000:3.0:1746140885.874863:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573718656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.874869:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.874877:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16e8 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.874886:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.874887:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.874891:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 24 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.874899:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 24 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.874905:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ea00, rc 0) 00000100:00100000:3.0:1746140885.875034:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573718656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 169us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.875040:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16941 00010000:00010000:0.0:1746140885.880701:0:32429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.880724:0:32429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.880732:0:32429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.880738:0:32429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec67000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140885.880743:0:32429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.880750:0:32429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.880767:0:32429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.880773:0:32429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec67000/0x8156357b7fdba27d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.880867:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573716736:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 20693us (22176us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.880877:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8669 00010000:00010000:1.0:1746140885.883453:0:32428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.883469:0:32428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.883477:0:32428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.883483:0:32428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092ec6400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140885.883487:0:32428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.883493:0:32428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.883511:0:32428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.883516:0:32428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ec6400/0x8156357b7fdba276 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.883620:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+18:1983:x1830960573717376:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 24324us (24880us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.883629:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8668 00000100:00100000:2.0:1746140885.887573:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.887845:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.887873:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.888170:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.888597:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573719040 00000100:00100000:3.0:1746140885.888605:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573719040 00002000:00100000:3.0:1746140885.888654:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b750000 x1830960573719040/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.888664:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b750000 with x1830960573719040 ext(2097152->3145727) 00002000:00010000:3.0:1746140885.888669:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b750000 00000100:00100000:0.0:1746140885.888670:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573719552 00000100:00100000:1.0:1746140885.888672:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573719296 00000100:00100000:0.0:1746140885.888675:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573719552 00000100:00100000:1.0:1746140885.888689:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573719296 00000100:00100000:3.0:1746140885.888692:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573719808 00000100:00100000:3.0:1746140885.888694:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573719808 00002000:00100000:0.0:1746140885.888694:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b751500 x1830960573719552/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.888704:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009b751f80 x1830960573719808/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.888707:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b751500 with x1830960573719552 ext(2097152->3145727) 00002000:00010000:0.0:1746140885.888710:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b751500 00002000:00100000:3.0:1746140885.888711:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b751f80 with x1830960573719808 ext(3145728->4194303) 00002000:00010000:3.0:1746140885.888713:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b751f80 00000100:00100000:1.0:1746140885.888728:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8673 00000100:00100000:0.0:1746140885.888744:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8674 00000100:00100000:3.0:1746140885.888750:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8675 00000100:00100000:0.0:1746140885.888752:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573719552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140885.888753:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573719040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140885.888757:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573719808:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140885.889184:0:21691:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.889196:0:21691:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.889203:0:21691:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.889210:0:21691:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f081200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140885.889214:0:21691:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.889219:0:21691:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.889234:0:21691:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.889239:0:21691:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f081200/0x8156357b7fdba284 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.889337:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573717248:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 29064us (30557us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.889344:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8670 00010000:00010000:3.0:1746140885.890238:0:8465:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.890250:0:8465:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.890258:0:8465:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.890265:0:8465:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8a800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140885.890269:0:8465:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.890282:0:8465:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.890298:0:8465:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.890323:0:8465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8a800/0x8156357b7fdba292 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.890383:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573718016:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 27016us (27117us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.890392:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8672 00010000:00010000:1.0:1746140885.890658:0:21689:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.890671:0:21689:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.890678:0:21689:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.890683:0:21689:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092ec7e00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140885.890685:0:21689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.890691:0:21689:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.890702:0:21689:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.890711:0:21689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ec7e00/0x8156357b7fdba28b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.890749:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573717760:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 27389us (27551us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.890756:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8671 00002000:00100000:1.0:1746140885.890795:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009b750700 x1830960573719296/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.890803:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b750700 with x1830960573719296 ext(3145728->4194303) 00002000:00010000:1.0:1746140885.890806:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b750700 00000100:00100000:0.0:1746140885.891851:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8676 00000100:00100000:0.0:1746140885.891862:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573719296:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.891892:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.891933:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573719936 00000100:00100000:3.0:1746140885.891941:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573719936 00000100:00100000:3.0:1746140885.891978:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10729 00000100:00100000:3.0:1746140885.891983:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32654:x1830960573719936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.891999:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.892017:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba2d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16f6 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.892105:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.892118:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.892127:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140885.892157:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140885.892162:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140885.892178:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.892198:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba2d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 269 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.892212:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.892219:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.892221:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140885.892224:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f600, rc 0) 00000100:00100000:3.0:1746140885.892248:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32654:x1830960573719936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 265us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.892254:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10729 00000100:00100000:0.0:1746140885.899290:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573719040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10533us (11715us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.899293:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573719552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10535us (11411us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.899302:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8673 00000100:00100000:1.0:1746140885.899338:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8674 00002000:00100000:0.0:1746140885.899341:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b750000 x1830960573719040/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.899348:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b751500 x1830960573719552/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.899350:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b750000 with x1830960573719040 ext(2097152->3145727) 00002000:00100000:1.0:1746140885.899356:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b751500 with x1830960573719552 ext(2097152->3145727) 00002000:00010000:0.0:1746140885.899356:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b750000 00002000:00010000:1.0:1746140885.899361:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b751500 00000100:00100000:0.0:1746140885.903589:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.904175:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573719808:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15417us (16003us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.904188:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8675 00002000:00100000:3.0:1746140885.904201:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009b751f80 x1830960573719808/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.904209:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b751f80 with x1830960573719808 ext(3145728->4194303) 00002000:00010000:3.0:1746140885.904215:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b751f80 00000100:00100000:2.0:1746140885.904336:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573720192 00000100:00100000:2.0:1746140885.904344:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573720192 00000100:00100000:2.0:1746140885.904378:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10730 00000100:00100000:2.0:1746140885.904385:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32646:x1830960573720192:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746140885.904433:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.904458:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67800/0x8156357b7fdba230 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a2 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.904483:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.904488:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140885.904523:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.904536:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 267 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.904542:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.904572:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 267 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.904584:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 267 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.904596:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b751880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576049920:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.904653:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.907135:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.907161:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.907175:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.907188:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.907206:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.907217:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.907234:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573720320 00000100:00100000:0.0:1746140885.907241:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573720320 00000100:00100000:0.0:1746140885.907274:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573720448 00000100:00100000:0.0:1746140885.907277:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573720448 00000100:00100000:3.0:1746140885.907398:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573720576 00000100:00100000:3.0:1746140885.907402:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573720576 00000100:00100000:0.0:1746140885.907407:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573720704 00000100:00100000:0.0:1746140885.907409:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573720704 00000100:00100000:3.0:1746140885.907420:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573720960 00000100:00100000:3.0:1746140885.907421:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573720960 00000100:00100000:1.0:1746140885.907427:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573720832 00000100:00100000:0.0:1746140885.907431:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16942 00000100:00100000:3.0:1746140885.907435:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16943 00000100:00100000:0.0:1746140885.907437:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573720320:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140885.907439:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573720448:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140885.907439:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573720832 00010000:00010000:3.0:1746140885.907450:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.907450:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.907465:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1704 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.907465:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a16fd expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.907483:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.907483:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.907485:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.907485:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140885.907487:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16944 00010000:00010000:3.0:1746140885.907492:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 40 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.907492:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 33 pid: 4785 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140885.907496:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573720576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.907506:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 40 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140885.907506:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 33 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.907512:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.907515:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f800, rc 0) 00010000:00010000:0.0:1746140885.907515:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82a00, rc 0) 00010000:00010000:1.0:1746140885.907526:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a170b expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.907548:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140885.907550:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573720448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 110us (387us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140885.907550:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140885.907550:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573720320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 113us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.907555:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16942 00000100:00100000:3.0:1746140885.907558:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16943 00010000:00010000:1.0:1746140885.907558:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 41 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140885.907569:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16945 00010000:00010000:1.0:1746140885.907571:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 40 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.907573:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16946 00000100:00100000:3.0:1746140885.907574:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573720704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.907579:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.907580:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5216c00, rc 0) 00010000:00010000:3.0:1746140885.907585:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1712 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.907595:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.907597:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.907601:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 33 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.907610:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 33 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.907617:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8fa00, rc 0) 00000100:00100000:1.0:1746140885.907620:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573720576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.907626:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16944 00000100:00100000:0.0:1746140885.907630:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573720960:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140885.907633:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573720704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 59us (445us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140885.907636:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140885.907638:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16945 00000100:00100000:1.0:1746140885.907642:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16947 00010000:00010000:0.0:1746140885.907643:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1720 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.907647:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573720832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140885.907653:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140885.907653:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.907655:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.907658:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 40 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.907661:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1719 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140885.907666:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 40 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.907671:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.907672:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140885.907673:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82800, rc 0) 00010000:00010000:1.0:1746140885.907676:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 33 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140885.907685:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 33 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140885.907691:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573720960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 114us (484us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140885.907696:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5216600, rc 0) 00000100:00100000:0.0:1746140885.907696:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16946 00000100:00100000:1.0:1746140885.907712:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573720832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.907717:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16947 00000100:00100000:2.0:1746140885.907766:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573719296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15901us (19915us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140885.907774:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8676 00002000:00100000:2.0:1746140885.907782:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009b750700 x1830960573719296/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746140885.907786:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140885.907791:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b750700 with x1830960573719296 ext(3145728->4194303) 00002000:00010000:2.0:1746140885.907795:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b750700 00000100:00100000:2.0:1746140885.907821:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573721088 00000100:00100000:2.0:1746140885.907824:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573721088 00010000:00010000:2.0:1746140885.907841:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 268 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:2.0:1746140885.907857:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8776 00000100:00100000:2.0:1746140885.907862:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4909050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1984:x1830960573721088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.907871:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.907876:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 268 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.907886:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 268 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.907906:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.907911:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.907918:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.907924:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.907936:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f600/0x8156357b7fdba2df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16f6 expref: 268 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.907936:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140885.907959:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b751880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576049920:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.907959:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4909050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:1984:x1830960573721088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 98us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.907965:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8776 00010000:00010000:3.0:1746140885.907976:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.907982:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.907987:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00010000:3.0:1746140885.908160:0:14785:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009eea9880 reply state ffff88009ee06000 transno 8589945024 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140885.908167:0:14785:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746140885.908236:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:32646:x1830960573720192:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 3850us (4656us total) trans 8589945024 rc 0/0 00000100:00100000:3.0:1746140885.908245:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10730 00010000:00010000:1.0:1746140885.909293:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140885.909326:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140885.909334:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140885.909340:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3a7000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140885.909344:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140885.909355:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140885.909365:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.909368:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140885.909372:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140885.909377:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3a7000/0x8156357b7fdba2e6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140885.909827:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.909849:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.909866:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.909919:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.909921:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573721344 00000100:00100000:2.0:1746140885.909927:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573721344 00000100:00100000:0.0:1746140885.909932:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.909948:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.909952:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573721600 00000100:00100000:2.0:1746140885.909954:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573721600 00000100:00100000:2.0:1746140885.909964:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573721856 00000100:00100000:2.0:1746140885.909966:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573721856 00000100:00100000:0.0:1746140885.909970:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573721216 00000100:00100000:0.0:1746140885.909973:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573721216 00000100:00100000:2.0:1746140885.909974:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573721472 00000100:00100000:2.0:1746140885.909976:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573721472 00000100:00100000:3.0:1746140885.909978:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573721728 00000100:00100000:3.0:1746140885.909981:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573721728 00000100:00100000:0.0:1746140885.909988:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16948 00000100:00100000:2.0:1746140885.909993:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16949 00000100:00100000:0.0:1746140885.909993:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573721344:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:2.0:1746140885.909998:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573721600:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746140885.910022:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16950 00000100:00100000:1.0:1746140885.910026:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573721856:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:3.0:1746140885.910119:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16951 00000100:00100000:3.0:1746140885.910127:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573721216:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140885.910147:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140885.910150:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.910152:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140885 -> 1746140886 00002000:00010000:2.0:1746140885.910154:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.910156:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140885.910185:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+18:1985:x1830960573721600:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 187us (334us total) trans 21474841390 rc 0/0 00000100:00100000:2.0:1746140885.910191:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16949 00002000:00010000:0.0:1746140885.910198:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140885.910200:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.910202:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1746140885.910202:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16952 00002000:00010000:0.0:1746140885.910202:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.910203:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.910204:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140885 -> 1746140886 00002000:00010000:0.0:1746140885.910204:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746140885.910206:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140885 -> 1746140886 00000100:00100000:2.0:1746140885.910206:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+18:1984:x1830960573721472:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746140885.910208:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140885 -> 1746140886 00002000:00010000:3.0:1746140885.910210:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746140885.910214:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746140885.910219:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+18:1985:x1830960573721344:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 226us (393us total) trans 17179874110 rc 0/0 00002000:00010000:1.0:1746140885.910221:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:1.0:1746140885.910223:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140885 -> 1746140886 00000100:00100000:0.0:1746140885.910223:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16948 00002000:00010000:1.0:1746140885.910225:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:1.0:1746140885.910226:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746140885.910228:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573721216:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 102us (307us total) trans 21474841391 rc 0/0 00000100:00100000:3.0:1746140885.910233:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16951 00000100:00100000:3.0:1746140885.910245:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16953 00000100:00100000:3.0:1746140885.910249:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573721728:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140885.910263:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140885.910265:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.910267:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.910269:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00000100:00100000:1.0:1746140885.910269:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+18:1985:x1830960573721856:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 239us (398us total) trans 17179874109 rc 0/0 00002000:00010000:2.0:1746140885.910271:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140885.910278:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16950 00000100:00100000:2.0:1746140885.910289:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+18:1984:x1830960573721472:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 82us (355us total) trans 17179874111 rc 0/0 00000100:00100000:2.0:1746140885.910295:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16952 00002000:00010000:3.0:1746140885.910299:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:3.0:1746140885.910301:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.910302:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.910323:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.910324:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00000100:00100000:3.0:1746140885.910342:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573721728:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 93us (392us total) trans 21474841392 rc 0/0 00000100:00100000:3.0:1746140885.910347:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16953 00000100:00100000:0.0:1746140885.910562:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.911099:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573721984 00000100:00100000:3.0:1746140885.911104:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573721984 00000100:00100000:3.0:1746140885.911138:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10731 00000100:00100000:3.0:1746140885.911143:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32654:x1830960573721984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.911154:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.911167:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1727 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.911332:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.911344:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.911359:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.911362:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140885.911365:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f000, rc 0) 00000100:00100000:3.0:1746140885.911385:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32654:x1830960573721984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 242us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.911390:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10731 00000100:00100000:0.0:1746140885.912813:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.912935:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573722240 00000100:00100000:3.0:1746140885.912942:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573722240 00000100:00100000:3.0:1746140885.912983:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4705 00000100:00100000:3.0:1746140885.912989:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a841050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:32646:x1830960573722240:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:3.0:1746140885.913033:0:14744:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x31d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba1ce lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a167f expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.913430:0:14744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 00010000:00010000:3.0:1746140885.913446:0:14744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 6 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.913452:0:14744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.913458:0:14744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 267 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.913464:0:14744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 6/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 00010000:00010000:3.0:1746140885.913497:0:14744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 267 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.913508:0:14744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 267 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.913521:0:14744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14744:1830960576050048:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.913614:0:14744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.913621:0:14744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 9 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.913628:0:14744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14744:1830960576050176:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.913654:0:14744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 6 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.913663:0:14744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 6 pid: 14742 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.913671:0:14744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14744:1830960576050304:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.913688:0:14744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4530780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.915397:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.915507:0:14744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14744:1830960576050048:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.915518:0:14744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14744:1830960576050176:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.915525:0:14744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14744:1830960576050304:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.915549:0:14744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 00000100:00100000:0.0:1746140885.915743:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.915758:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.915800:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.915823:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573722624 00000100:00100000:3.0:1746140885.915832:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573722880 00000100:00100000:1.0:1746140885.915834:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573722624 00000100:00100000:3.0:1746140885.915837:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573722880 00010000:00010000:3.0:1746140885.915863:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 7 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.915871:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 10 pid: 27790 timeout: 964 lvb_type: 0 00000100:00100000:3.0:1746140885.915892:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573722496 00000100:00100000:3.0:1746140885.915894:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573722496 00010000:00010000:3.0:1746140885.915905:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 268 pid: 14785 timeout: 964 lvb_type: 0 00000100:00100000:1.0:1746140885.915905:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8777 00000100:00100000:1.0:1746140885.915912:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573722880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140885.915921:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8778 00010000:00010000:1.0:1746140885.915925:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140885.915926:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573722624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.915931:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 7 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.915936:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140885.915941:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 7 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.915942:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 10 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.915951:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 10 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.915974:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36e00/0x8156357b7fdba21b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1694 expref: 7 pid: 14742 timeout: 964 lvb_type: 0 00010000:00010000:1.0:1746140885.915989:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.915993:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 00010000:00010000:1.0:1746140885.916001:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140885.916043:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba222 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a169b expref: 10 pid: 27790 timeout: 964 lvb_type: 0 00010000:00010000:3.0:1746140885.916055:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.916059:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 00010000:00010000:3.0:1746140885.916065:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.916100:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8779 00000100:00100000:2.0:1746140885.916108:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1985:x1830960573722496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.916120:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.916125:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 268 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.916134:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 268 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.916150:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f000/0x8156357b7fdba317 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1727 expref: 268 pid: 14785 timeout: 964 lvb_type: 0 00010000:00010000:2.0:1746140885.916164:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.916168:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 00010000:00010000:2.0:1746140885.916175:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14744 initiator: MDT0 00010000:00010000:2.0:1746140885.916181:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14744 initiator: MDT0 00010000:00010000:2.0:1746140885.916322:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.916404:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1984:x1830960573722880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 490us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.916411:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8777 00000100:00100000:3.0:1746140885.916438:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573722624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 510us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.916445:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8778 00010000:00010000:3.0:1746140885.916468:0:14744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 00010000:00010000:3.0:1746140885.916473:0:14744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 00000100:00100000:2.0:1746140885.916513:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:1985:x1830960573722496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 405us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.916519:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8779 00000100:00100000:2.0:1746140885.916541:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573722752 00000100:00100000:2.0:1746140885.916544:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573722752 00002000:00100000:2.0:1746140885.916569:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009eeab480 x1830960573722752/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140885.916578:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eeab480 with x1830960573722752 ext(4194304->4886527) 00002000:00010000:2.0:1746140885.916582:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eeab480 00000100:00100000:2.0:1746140885.916595:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8677 00000100:00100000:2.0:1746140885.916599:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573722752:12345-192.168.204.16@tcp:3:cat.0 00000040:00080000:3.0:1746140885.917032:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3430, 88 off290504 00000004:00080000:3.0:1746140885.917038:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864992733012ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917096:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3458, 88 off293144 00000004:00080000:3.0:1746140885.917100:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864992795073ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.917112:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3459, 88 off293232 00000004:00080000:3.0:1746140885.917115:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864992809820ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.917363:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3431, 88 off290592 00000004:00080000:3.0:1746140885.917368:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864993063611ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917398:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3432, 88 off290680 00000004:00080000:3.0:1746140885.917401:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864993095880ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917410:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3460, 88 off293320 00000004:00080000:3.0:1746140885.917413:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864993108107ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.917423:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3461, 88 off293408 00000004:00080000:3.0:1746140885.917425:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864993120480ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.917431:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3462, 88 off293496 00000004:00080000:3.0:1746140885.917434:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864993128997ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.917440:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3433, 88 off290768 00000004:00080000:3.0:1746140885.917443:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864993137896ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917449:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3463, 88 off293584 00000004:00080000:3.0:1746140885.917451:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864993146455ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.917458:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3434, 88 off290856 00000004:00080000:3.0:1746140885.917460:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864993155615ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917466:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3464, 88 off293672 00000004:00080000:3.0:1746140885.917474:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864993169103ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140885.917481:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3435, 88 off290944 00000004:00080000:3.0:1746140885.917484:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864993179512ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917491:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3436, 88 off291032 00000004:00080000:3.0:1746140885.917493:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864993188366ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917499:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3437, 88 off291120 00000004:00080000:3.0:1746140885.917502:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864993196866ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917507:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3438, 88 off291208 00000004:00080000:3.0:1746140885.917509:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864993204477ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140885.917515:0:14744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3465, 88 off293760 00000004:00080000:3.0:1746140885.917517:0:14744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 864993212543ns, next at 809142599738ns, rc = 0 00000100:00100000:1.0:1746140885.921987:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.922023:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573723136 00000100:00100000:0.0:1746140885.922032:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573723136 00002000:00100000:0.0:1746140885.922070:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009b891500 x1830960573723136/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.922090:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891500 with x1830960573723136 ext(0->1048575) 00002000:00010000:0.0:1746140885.922095:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891500 00000100:00100000:0.0:1746140885.922112:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8678 00000100:00100000:0.0:1746140885.922118:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1983:x1830960573723136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.922651:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.922784:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573723392 00000100:00100000:1.0:1746140885.922788:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573723392 00002000:00100000:1.0:1746140885.922806:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b753480 x1830960573723392/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.922813:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b753480 with x1830960573723392 ext(1048576->2097151) 00002000:00010000:1.0:1746140885.922816:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b753480 00000100:00100000:1.0:1746140885.922834:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8679 00000100:00100000:1.0:1746140885.922839:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1983:x1830960573723392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.923094:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.923118:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.923181:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573723648 00000100:00100000:3.0:1746140885.923185:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573723648 00002000:00100000:3.0:1746140885.923200:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b750a80 x1830960573723648/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.923207:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b750a80 with x1830960573723648 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.923210:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b750a80 00000100:00100000:3.0:1746140885.923218:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573723904 00000100:00100000:3.0:1746140885.923220:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573723904 00002000:00100000:3.0:1746140885.923228:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009b751c00 x1830960573723904/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.923233:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b751c00 with x1830960573723904 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.923236:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b751c00 00000100:00100000:3.0:1746140885.923245:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8680 00000100:00100000:3.0:1746140885.923249:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1983:x1830960573723648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140885.924887:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8681 00000100:00100000:2.0:1746140885.924899:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573723904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140885.927900:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573722752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11291us (12091us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140885.927911:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8677 00002000:00100000:3.0:1746140885.927922:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009eeab480 x1830960573722752/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.927932:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eeab480 with x1830960573722752 ext(4194304->4886527) 00002000:00010000:3.0:1746140885.927937:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eeab480 00000100:00100000:0.0:1746140885.932621:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.932706:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573724160 00000100:00100000:2.0:1746140885.932715:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573724160 00000100:00100000:2.0:1746140885.932762:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10732 00000100:00100000:2.0:1746140885.932770:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32656:x1830960573724160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140885.932787:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.932804:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a172e expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.932983:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.932995:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.933145:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.933236:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.933243:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140885.933249:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140885.934444:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.934495:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573724288 00000100:00100000:2.0:1746140885.934502:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573724288 00000100:00100000:2.0:1746140885.934563:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10733 00000100:00100000:2.0:1746140885.934569:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32649:x1830960573724288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.934580:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.934591:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1735 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.934664:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 00010000:00010000:2.0:1746140885.934672:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1735 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.934690:0:27790:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14744 initiator: MDT0 00010000:00010000:2.0:1746140885.934700:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1735 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.934710:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.934713:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140885.934715:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1735 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.934721:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8a000, rc 0) 00000100:00100000:2.0:1746140885.934774:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32649:x1830960573724288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 205us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.934779:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10733 00000100:00100000:1.0:1746140885.936657:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573723392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13810us (13999us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140885.936668:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8679 00002000:00100000:1.0:1746140885.936676:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b753480 x1830960573723392/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.936686:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b753480 with x1830960573723392 ext(1048576->2097151) 00002000:00010000:1.0:1746140885.936691:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b753480 00000100:00100000:3.0:1746140885.938037:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1983:x1830960573723648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14784us (14939us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.938046:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8680 00002000:00100000:3.0:1746140885.938053:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009b750a80 x1830960573723648/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.938069:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b750a80 with x1830960573723648 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.938073:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b750a80 00000004:00010000:0.0:1746140885.939367:0:14744:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a841050 reply state ffff880093d92400 transno 8589945025 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14744 initiator: MDT0 00000100:00100000:0.0:1746140885.939381:0:14744:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746140885.939433:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945025 is committed 00000004:00080000:1.0:1746140885.939440:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2708 committed 00000004:00080000:1.0:1746140885.939448:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2684 committed 00000004:00080000:1.0:1746140885.939454:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2683 committed 00000004:00080000:1.0:1746140885.939456:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2682 committed 00010000:00010000:0.0:1746140885.939457:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00000004:00080000:1.0:1746140885.939458:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2681 committed 00000004:00080000:1.0:1746140885.939459:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2707 committed 00010000:00010000:0.0:1746140885.939460:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1746140885.939461:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2680 committed 00000004:00080000:1.0:1746140885.939463:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2706 committed 00000004:00080000:1.0:1746140885.939464:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2679 committed 00000004:00080000:1.0:1746140885.939466:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2705 committed 00000004:00080000:1.0:1746140885.939467:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2704 committed 00010000:00010000:0.0:1746140885.939467:0:14744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801399b4600/0x8156357b7fdba1ce lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a167f expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746140885.939469:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2703 committed 00000004:00080000:1.0:1746140885.939471:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2678 committed 00000004:00080000:1.0:1746140885.939473:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2677 committed 00000004:00080000:1.0:1746140885.939474:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2702 committed 00000004:00080000:1.0:1746140885.939476:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2701 committed 00000004:00080000:1.0:1746140885.939477:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2676 committed 00000001:00080000:1.0:1746140885.939487:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945023 is committed 00010000:00080000:0.0:1746140885.939551:0:14744:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746140885.939561:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a841050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:32646:x1830960573722240:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 26572us (26753us total) trans 8589945025 rc 0/0 00000100:00100000:0.0:1746140885.939571:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4705 00000100:00100000:1.0:1746140885.939628:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576050432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.939669:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.939696:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576050944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.939710:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.939724:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746140885.939728:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576050560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.939742:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.939752:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576051072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.939765:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746140885.939785:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 14744 initiator: MDT0 00010000:00010000:1.0:1746140885.939793:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 14744 initiator: MDT0 00010000:00010000:1.0:1746140885.939803:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14744 initiator: MDT0 00010000:00010000:1.0:1746140885.939808:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8f400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140885.939813:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14744 initiator: MDT0 00010000:00010000:1.0:1746140885.939819:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 14744 initiator: MDT0 00010000:00010000:1.0:1746140885.939832:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140885.939834:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140885.939839:0:3296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1735 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.939848:0:3296:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1735 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.939856:0:3296:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1735 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.939874:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576050688:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746140885.939878:0:3296:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1735 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.939887:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3296:1830960576051456:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140885.939893:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140885.939915:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576051200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.939922:0:3296:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.939927:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.939938:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576050432 00000100:00100000:0.0:1746140885.939938:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746140885.939941:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576050816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.939945:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576050432 00010000:00010000:3.0:1746140885.939946:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6c00/0x8156357b7fdba341 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140885.939954:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746140885.939957:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6c00/0x8156357b7fdba341 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140885.939963:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576051328:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746140885.939965:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6c00/0x8156357b7fdba341 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140885.939970:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576050944 00000100:00100000:1.0:1746140885.939972:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576050944 00000100:00100000:0.0:1746140885.939975:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:3.0:1746140885.939977:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:1.0:1746140885.939984:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576050560 00000100:00100000:1.0:1746140885.939985:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576050560 00000100:00100000:0.0:1746140885.939991:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576051072 00000100:00100000:0.0:1746140885.939993:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576051072 00000100:00100000:1.0:1746140885.939995:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16954 00000100:00100000:1.0:1746140885.940000:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+80:3312:x1830960576050432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.940006:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576050688 00000100:00100000:0.0:1746140885.940007:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576050688 00000100:00100000:0.0:1746140885.940015:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576051200 00000100:00100000:0.0:1746140885.940017:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576051200 00000100:00100000:0.0:1746140885.940022:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576050816 00000100:00100000:0.0:1746140885.940023:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576050816 00000100:00100000:0.0:1746140885.940029:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576051328 00000100:00100000:0.0:1746140885.940030:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576051328 00000100:00100000:0.0:1746140885.940037:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16955 00000100:00100000:0.0:1746140885.940041:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3312:x1830960576050944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.940099:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16956 00000100:00100000:0.0:1746140885.940104:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+84:3312:x1830960576050560:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746140885.940127:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.940131:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.940134:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.940137:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8ba00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.940138:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.940141:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140885.940143:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16957 00010000:00010000:3.0:1746140885.940146:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140885.940147:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746140885.940147:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960576051072:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746140885.940149:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.940155:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ba00/0x8156357b7fdba32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.940161:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00002000:00010000:1.0:1746140885.940162:0:4785:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00010000:00010000:3.0:1746140885.940163:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00002000:00010000:1.0:1746140885.940165:0:4785:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00010000:00010000:3.0:1746140885.940167:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00002000:00010000:1.0:1746140885.940168:0:4785:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:1.0:1746140885.940169:0:4785:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00010000:00010000:3.0:1746140885.940170:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8b000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.940171:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00002000:00010000:1.0:1746140885.940171:0:4785:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00010000:00010000:3.0:1746140885.940173:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.940176:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152a00) 00010000:00010000:3.0:1746140885.940177:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.940178:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.940180:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8b000/0x8156357b7fdba333 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140885.940180:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16958 00000100:00100000:0.0:1746140885.940184:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3310:x1830960576050688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.940193:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960576050432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (525us total) trans 21474841393 rc 0/0 00000100:00100000:1.0:1746140885.940198:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16954 00000100:00100000:1.0:1746140885.940207:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16959 00000100:00100000:1.0:1746140885.940211:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3310:x1830960576051200:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746140885.940215:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8be00/0x8156357b7fdba325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a172e expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.940222:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16960 00010000:00010000:3.0:1746140885.940226:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6c00/0x8156357b7fdba341 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a172e expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140885.940226:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3310:x1830960576050816:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746140885.940237:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.940239:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140885.940240:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce6c00, rc 0) 00000100:00100000:3.0:1746140885.940262:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32656:x1830960573724160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7494us (7649us total) trans 8589945026 rc 0/0 00000100:00100000:3.0:1746140885.940268:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10732 00000100:00100000:1.0:1746140885.940288:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3310:x1830960576051200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (359us total) trans 21474841394 rc 0/0 00000100:00100000:3.0:1746140885.940294:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16961 00000100:00100000:0.0:1746140885.940295:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3312:x1830960576050944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (584us total) trans 21474841395 rc 0/0 00000100:00100000:3.0:1746140885.940300:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+86:3310:x1830960576051328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.940401:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576051712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.940409:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+87:3310:x1830960576051328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (431us total) trans 21474841396 rc 0/0 00000100:00100000:2.0:1746140885.940428:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.940440:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576052224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.940452:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.940459:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746140885.940462:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576051584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.940472:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.940477:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576052096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.940487:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.940535:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576051712 00000100:00100000:2.0:1746140885.940538:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576051712 00000100:00100000:1.0:1746140885.940868:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16959 00000100:00100000:1.0:1746140885.940886:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576052224 00000100:00100000:0.0:1746140885.940888:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16955 00000100:00100000:1.0:1746140885.940889:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576052224 00000100:00100000:1.0:1746140885.940897:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576051584 00000100:00100000:1.0:1746140885.940898:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576051584 00000100:00100000:0.0:1746140885.940901:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576052096 00000100:00100000:0.0:1746140885.940903:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576052096 00000100:00100000:3.0:1746140885.940907:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16961 00000100:00100000:1.0:1746140885.940911:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16962 00000100:00100000:0.0:1746140885.940917:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16963 00000100:00100000:0.0:1746140885.940921:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+72:3313:x1830960576051584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.940928:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16964 00000100:00100000:3.0:1746140885.940933:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+72:3313:x1830960576052096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.940939:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16965 00000100:00100000:2.0:1746140885.940944:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3313:x1830960576051712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.940972:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576051968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.940995:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746140885.941003:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746140885.941006:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576052480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.941020:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.941028:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746140885.941032:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576051840:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140885.941032:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140885.941035:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.941036:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.941038:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.941040:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140885.941046:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.941053:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576052352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.941064:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3313:x1830960576051712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (635us total) trans 17179874112 rc 0/0 00000100:00100000:3.0:1746140885.941067:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.941069:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16965 00000100:00100000:3.0:1746140885.941092:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576051968 00000100:00100000:2.0:1746140885.941092:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576052480 00000100:00100000:3.0:1746140885.941095:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576051968 00000100:00100000:2.0:1746140885.941095:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576052480 00000100:00100000:2.0:1746140885.941105:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576051840 00000100:00100000:2.0:1746140885.941107:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576051840 00000100:00100000:3.0:1746140885.941112:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576052352 00000100:00100000:3.0:1746140885.941113:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576052352 00000100:00100000:2.0:1746140885.941114:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16966 00000100:00100000:2.0:1746140885.941118:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960576052480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140885.941119:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.941121:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00000100:00100000:3.0:1746140885.941122:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16967 00002000:00010000:0.0:1746140885.941122:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.941124:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140885.941127:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960576051968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.941144:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960576050560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1040us (1402us total) trans 21474841397 rc 0/0 00000100:00100000:0.0:1746140885.941150:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16956 00000100:00100000:0.0:1746140885.941160:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16968 00000100:00100000:0.0:1746140885.941164:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960576051840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.941194:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+78:3311:x1830960576052480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (173us total) trans 17179874113 rc 0/0 00000100:00100000:2.0:1746140885.941199:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16966 00000100:00100000:2.0:1746140885.941208:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16969 00000100:00100000:2.0:1746140885.941212:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3311:x1830960576052352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.941220:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3311:x1830960576051968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (224us total) trans 17179874114 rc 0/0 00000100:00100000:3.0:1746140885.941227:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16967 00002000:00010000:0.0:1746140885.941235:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140885.941238:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.941239:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.941242:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.941243:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000004:00080000:3.0:1746140885.941258:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b753800/2, rc 0, transno 17179874114 00000100:00100000:0.0:1746140885.941260:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+78:3311:x1830960576051840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (214us total) trans 17179874115 rc 0/0 00000100:00100000:3.0:1746140885.941263:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576051968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.941265:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16968 00000004:00080000:3.0:1746140885.941271:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d082680/2, rc 0, transno 17179874113 00000100:00100000:3.0:1746140885.941273:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576052480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.941275:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3311:x1830960576052352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (207us total) trans 17179874116 rc 0/0 00000004:00080000:3.0:1746140885.941280:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b752a00/2, rc 0, transno 17179874115 00000100:00100000:2.0:1746140885.941280:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16969 00000100:00100000:3.0:1746140885.941283:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576051840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140885.941288:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d081880/2, rc 0, transno 17179874116 00000100:00100000:3.0:1746140885.941290:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576052352:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140885.941297:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b753100/2, rc 0, transno 17179874112 00000100:00100000:2.0:1746140885.941301:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576051712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.941345:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960576051072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1197us (1578us total) trans 21474841398 rc 0/0 00000100:00100000:0.0:1746140885.941350:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16957 00002000:00010000:0.0:1746140885.941408:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:0.0:1746140885.941410:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.941412:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.941413:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.941415:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00000100:00100000:0.0:1746140885.941434:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3310:x1830960576050688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1249us (1539us total) trans 21474841399 rc 0/0 00000100:00100000:0.0:1746140885.941438:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16958 00000100:00100000:0.0:1746140885.941500:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3310:x1830960576050816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1273us (1544us total) trans 21474841400 rc 0/0 00000100:00100000:0.0:1746140885.941504:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16960 00000100:00100000:1.0:1746140885.941626:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3313:x1830960576052224:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140885.941950:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3b4a80/2, rc 0, transno 21474841400 00000100:00100000:0.0:1746140885.941958:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576050816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140885.941966:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b1b3b80/2, rc 0, transno 21474841396 00000100:00100000:0.0:1746140885.941968:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576051328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140885.941974:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3b7100/2, rc 0, transno 21474841399 00000100:00100000:0.0:1746140885.941977:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576050688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140885.941983:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b1b1c00/2, rc 0, transno 21474841394 00000100:00100000:0.0:1746140885.941986:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576051200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.942066:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:3313:x1830960576052224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1150us (1612us total) trans 17179874117 rc 0/0 00000100:00100000:1.0:1746140885.942072:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16962 00002000:00010000:0.0:1746140885.942121:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140885.942123:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.942125:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.942127:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:0.0:1746140885.942128:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140885.942138:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+78:3313:x1830960576052096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1206us (1650us total) trans 17179874119 rc 0/0 00000100:00100000:3.0:1746140885.942143:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16964 00000100:00100000:0.0:1746140885.942147:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3313:x1830960576051584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1226us (1673us total) trans 17179874118 rc 0/0 00000100:00100000:0.0:1746140885.942152:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16963 00000004:00080000:2.0:1746140885.942195:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b750380/2, rc 0, transno 17179874118 00000100:00100000:2.0:1746140885.942200:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576051584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140885.942206:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b751880/2, rc 0, transno 17179874119 00000100:00100000:2.0:1746140885.942209:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576052096:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140885.942213:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d082d80/2, rc 0, transno 17179874117 00000100:00100000:2.0:1746140885.942215:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576052224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.942220:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746140885.942225:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576052608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.942241:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140885.942251:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576052608 00000100:00100000:0.0:1746140885.942254:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576052608 00000100:00100000:0.0:1746140885.942274:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16970 00000100:00100000:0.0:1746140885.942279:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3313:x1830960576052608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.942381:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3313:x1830960576052608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (138us total) trans 21474841401 rc 0/0 00000100:00100000:0.0:1746140885.942385:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16970 00000004:00080000:1.0:1746140885.942387:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3b5880/2, rc 0, transno 21474841397 00000100:00100000:1.0:1746140885.942390:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576050560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140885.942397:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3b5f80/2, rc 0, transno 21474841398 00000100:00100000:1.0:1746140885.942399:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576051072:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140885.942406:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3b7b80/2, rc 0, transno 21474841393 00000100:00100000:1.0:1746140885.942408:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576050432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140885.942414:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3b6300/2, rc 0, transno 21474841395 00000100:00100000:1.0:1746140885.942416:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576050944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140885.942458:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b3100/2, rc 0, transno 21474841401 00000100:00100000:2.0:1746140885.942461:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576052608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.943498:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.943584:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573724416 00000100:00100000:3.0:1746140885.943589:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573724416 00000100:00100000:3.0:1746140885.943625:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10734 00000100:00100000:3.0:1746140885.943630:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32646:x1830960573724416:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140885.943647:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.943663:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a173c expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.943717:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.943729:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.943744:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.943747:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140885.943749:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce7200, rc 0) 00000100:00100000:3.0:1746140885.943784:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32646:x1830960573724416:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 153us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.943789:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10734 00000100:00100000:1.0:1746140885.943910:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3296:1830960576051456:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140885.943929:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14744 initiator: MDT0 00010000:00010000:1.0:1746140885.943936:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba31e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14744 initiator: MDT0 00000100:00100000:0.0:1746140885.944834:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.944880:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573724544 00000100:00100000:2.0:1746140885.944885:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573724544 00000100:00100000:2.0:1746140885.944919:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4706 00000100:00100000:2.0:1746140885.944925:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32649:x1830960573724544:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:2.0:1746140885.945012:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32649:x1830960573724544:12345-192.168.204.16@tcp:49:cat.0 Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.945019:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4706 00000100:00100000:3.0:1746140885.945404:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573723904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20507us (22283us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.945412:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8681 00002000:00100000:3.0:1746140885.945420:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009b751c00 x1830960573723904/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.945429:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b751c00 with x1830960573723904 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.945434:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b751c00 00000100:00100000:0.0:1746140885.946866:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1983:x1830960573723136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24741us (24880us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140885.946875:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8678 00002000:00100000:0.0:1746140885.946883:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009b891500 x1830960573723136/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.946893:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891500 with x1830960573723136 ext(0->1048575) 00002000:00010000:0.0:1746140885.946898:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891500 00000100:00100000:0.0:1746140885.947899:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.947975:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573724800 00000100:00100000:2.0:1746140885.947983:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573724800 00000100:00100000:2.0:1746140885.948018:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4707 00000100:00100000:2.0:1746140885.948024:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32646:x1830960573724800:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746140885.948228:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32646:x1830960573724800:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 203us (330us total) trans 8589945027 rc 0/0 00000100:00100000:2.0:1746140885.948234:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4707 00000100:00100000:0.0:1746140885.953798:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.954537:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573724928 00000100:00100000:2.0:1746140885.954547:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573724928 00000100:00100000:2.0:1746140885.954585:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10735 00000100:00100000:2.0:1746140885.954592:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:32654:x1830960573724928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140885.954609:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.954627:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1743 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.954877:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.954936:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573725184 00000100:00100000:0.0:1746140885.954940:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573725184 00002000:00100000:0.0:1746140885.954966:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff88009b1b0000 x1830960573725184/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.954975:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b0000 with x1830960573725184 ext(4882432->4886527) 00002000:00010000:0.0:1746140885.954981:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b1b0000 00000100:00100000:0.0:1746140885.955002:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8682 00000100:00100000:0.0:1746140885.955007:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1982:x1830960573725184:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140885.955121:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 267 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.955135:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 267 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.955153:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.955155:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140885.955159:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c84e00, rc 0) 00000100:00100000:2.0:1746140885.955439:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32654:x1830960573724928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 846us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.955446:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10735 00000100:00100000:0.0:1746140885.955735:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1982:x1830960573725184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 726us (856us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140885.955741:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8682 00002000:00100000:0.0:1746140885.955747:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff88009b1b0000 x1830960573725184/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140885.955754:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b0000 with x1830960573725184 ext(4882432->4886527) 00002000:00010000:0.0:1746140885.955757:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b1b0000 00000100:00100000:0.0:1746140885.957275:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.957439:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573725440 00000100:00100000:2.0:1746140885.957447:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573725440 00000100:00100000:2.0:1746140885.957483:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10736 00000100:00100000:2.0:1746140885.957490:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32656:x1830960573725440:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140885.957509:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140885.957512:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746140885.957541:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6c00/0x8156357b7fdba341 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a172e expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.957558:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8a000/0x8156357b7fdba33a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1735 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.957567:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.957570:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140885.957581:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9c00/0x8156357b7fdba35d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a174a expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.957630:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.957641:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.957648:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 266 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.957654:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.957681:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 266 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.957696:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 266 pid: 27790 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140885.957707:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576052736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.957773:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.957780:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 7 pid: 14785 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140885.957788:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576052864:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.957806:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.960294:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.960557:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573725696 00000100:00100000:2.0:1746140885.960567:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573725696 00000100:00100000:0.0:1746140885.960600:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.960619:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573725824 00000100:00100000:2.0:1746140885.960621:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573725824 00010000:00010000:2.0:1746140885.960650:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 8 pid: 14785 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140885.960676:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8780 00000100:00100000:2.0:1746140885.960681:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573725824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.960692:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.960697:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 8 pid: 14785 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140885.960707:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 8 pid: 14785 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140885.960724:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4708 00010000:00010000:2.0:1746140885.960725:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140885.960730:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140885.960731:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32649:x1830960573725696:12345-192.168.204.16@tcp:35:cat.0 00010000:00010000:2.0:1746140885.960738:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.960743:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.960792:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573725824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 110us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.960799:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8780 00000100:00100000:3.0:1746140885.961010:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32649:x1830960573725696:12345-192.168.204.16@tcp:35:cat.0 Request processed in 278us (724us total) trans 8589945028 rc 0/0 00000100:00100000:3.0:1746140885.961015:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4708 00000100:00100000:3.0:1746140885.961050:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576052736:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.961059:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7200/0x8156357b7fdba34f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a173c expref: 7 pid: 14785 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140885.961068:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576052864:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.961100:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140885.964534:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.964576:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.964639:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573726208 00000100:00100000:1.0:1746140885.964648:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573726208 00000100:00100000:0.0:1746140885.964648:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573725952 00000100:00100000:0.0:1746140885.964652:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573725952 00010000:00010000:0.0:1746140885.964683:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 267 pid: 27790 timeout: 965 lvb_type: 0 00002000:00100000:1.0:1746140885.964690:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88012d082300 x1830960573726208/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140885.964699:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082300 with x1830960573726208 ext(1048576->2097151) 00002000:00010000:1.0:1746140885.964704:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d082300 00000100:00100000:0.0:1746140885.964721:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8781 00000100:00100000:0.0:1746140885.964729:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:1982:x1830960573725952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140885.964741:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140885.964748:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 267 pid: 27790 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140885.964768:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 267 pid: 27790 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140885.964794:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c84e00/0x8156357b7fdba356 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1743 expref: 267 pid: 27790 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140885.965364:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140885.965369:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.965381:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.965387:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140885.965417:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140885.965604:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:1982:x1830960573725952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 874us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140885.965611:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8781 00010000:00010000:2.0:1746140885.965641:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140885.965647:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140885.965776:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8683 00000100:00100000:3.0:1746140885.965786:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573726208:12345-192.168.204.16@tcp:3:cat.0 00000040:00080000:2.0:1746140885.966526:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3439, 88 off291296 00000004:00080000:2.0:1746140885.966533:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042227752ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966588:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3466, 88 off293848 00000004:00080000:2.0:1746140885.966592:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865042286723ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.966605:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3467, 88 off293936 00000004:00080000:2.0:1746140885.966607:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865042302607ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.966614:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3440, 88 off291384 00000004:00080000:2.0:1746140885.966617:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042311973ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966623:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3441, 88 off291472 00000004:00080000:2.0:1746140885.966626:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042321102ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966632:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3468, 88 off294024 00000004:00080000:2.0:1746140885.966635:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865042329996ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.966640:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3469, 88 off294112 00000004:00080000:2.0:1746140885.966643:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865042337852ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.966648:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3470, 88 off294200 00000004:00080000:2.0:1746140885.966651:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865042345833ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.966658:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3442, 88 off291560 00000004:00080000:2.0:1746140885.966660:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042355103ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966666:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3471, 88 off294288 00000004:00080000:2.0:1746140885.966669:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865042364096ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.966744:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3443, 88 off291648 00000004:00080000:2.0:1746140885.966748:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042443627ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966766:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3472, 88 off294376 00000004:00080000:2.0:1746140885.966769:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865042464226ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140885.966775:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3444, 88 off291736 00000004:00080000:2.0:1746140885.966778:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042473156ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966784:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3445, 88 off291824 00000004:00080000:2.0:1746140885.966787:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042482012ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966793:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3446, 88 off291912 00000004:00080000:2.0:1746140885.966795:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042490283ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966801:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3447, 88 off292000 00000004:00080000:2.0:1746140885.966803:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865042498526ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140885.966810:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3473, 88 off294464 00000004:00080000:2.0:1746140885.966812:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865042507122ns, next at 809142599738ns, rc = 0 00000100:00100000:3.0:1746140885.973825:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573726208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8033us (9239us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140885.973836:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8683 00002000:00100000:3.0:1746140885.973848:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88012d082300 x1830960573726208/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.973857:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082300 with x1830960573726208 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.973863:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d082300 00000100:00100000:1.0:1746140885.981257:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.981366:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573726336 00000100:00100000:3.0:1746140885.981376:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573726336 00000100:00100000:3.0:1746140885.981454:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10737 00000100:00100000:3.0:1746140885.981461:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:32654:x1830960573726336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140885.981478:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.981494:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1751 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.981553:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.981564:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 267 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.981896:0:14785:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140885.981910:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 267 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.981922:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.981925:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140885.982119:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 267 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.982127:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce6400, rc 0) 00000100:00100000:3.0:1746140885.982189:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32654:x1830960573726336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 728us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140885.982196:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10737 00000001:00080000:1.0:1746140885.985905:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945029 is committed 00000004:00080000:1.0:1746140885.985918:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2716 committed 00000004:00080000:1.0:1746140885.985926:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2693 committed 00000004:00080000:1.0:1746140885.985933:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2692 committed 00000004:00080000:1.0:1746140885.985936:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2691 committed 00000004:00080000:1.0:1746140885.985937:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2690 committed 00000004:00080000:1.0:1746140885.985938:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2715 committed 00000004:00080000:1.0:1746140885.985940:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2689 committed 00000004:00080000:1.0:1746140885.985941:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2714 committed 00000004:00080000:1.0:1746140885.985943:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2688 committed 00000004:00080000:1.0:1746140885.985945:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2713 committed 00000004:00080000:1.0:1746140885.985946:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2712 committed 00000004:00080000:1.0:1746140885.985948:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2711 committed 00000004:00080000:1.0:1746140885.985949:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2687 committed 00000004:00080000:1.0:1746140885.985951:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2686 committed 00000004:00080000:1.0:1746140885.985952:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2710 committed 00000004:00080000:1.0:1746140885.985954:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2709 committed 00000004:00080000:1.0:1746140885.985955:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2685 committed 00000001:00080000:1.0:1746140885.985961:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945027 is committed 00010000:00010000:3.0:1746140885.985979:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.985990:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.985993:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746140885.985997:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 266 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.986006:0:27790:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 266 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.986015:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 266 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.986038:0:27790:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 266 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140885.986051:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576053248:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140885.986129:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576053504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.986146:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140885.986159:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576053376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.986168:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.986190:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.986194:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576054016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.986203:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576053888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.986207:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.986216:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.986225:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576054528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.986229:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576054400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.986240:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.986248:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576053504 00000100:00100000:1.0:1746140885.986252:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576055040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.986254:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576053504 00000100:00100000:2.0:1746140885.986255:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576052992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.986266:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.986280:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576053376 00000100:00100000:3.0:1746140885.986282:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576053376 00000100:00100000:1.0:1746140885.986283:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576053120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.986292:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576054016 00000100:00100000:3.0:1746140885.986293:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576054016 00000100:00100000:3.0:1746140885.986301:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576053888 00000100:00100000:3.0:1746140885.986326:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576053888 00000100:00100000:1.0:1746140885.986326:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.986349:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576053760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.986364:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.987033:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576054528 00000100:00100000:3.0:1746140885.987037:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576054528 00000100:00100000:3.0:1746140885.987358:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576055040 00000100:00100000:3.0:1746140885.987361:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576055040 00000100:00100000:2.0:1746140885.987499:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576053120 00000100:00100000:2.0:1746140885.987507:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576053120 00000100:00100000:2.0:1746140885.987541:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576053760 00000100:00100000:2.0:1746140885.987543:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576053760 00000100:00100000:2.0:1746140885.987554:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16971 00000100:00100000:2.0:1746140885.987561:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576053504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.987704:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16972 00000100:00100000:3.0:1746140885.987712:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+92:3311:x1830960576053376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.987771:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+92:3312:x1830960576053504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (1601us total) trans 21474841402 rc 0/0 00000100:00100000:2.0:1746140885.987778:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16971 00000100:00100000:2.0:1746140885.987793:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16973 00000100:00100000:2.0:1746140885.987798:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576054016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140885.987862:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:3.0:1746140885.987866:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.987868:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.987871:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.987872:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00000100:00100000:2.0:1746140885.987872:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+93:3312:x1830960576054016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1663us total) trans 21474841404 rc 0/0 00000100:00100000:2.0:1746140885.987877:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16973 00000100:00100000:2.0:1746140885.987886:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16974 00000100:00100000:2.0:1746140885.987890:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+92:3311:x1830960576053888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.987905:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+92:3311:x1830960576053376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (1712us total) trans 21474841403 rc 0/0 00000100:00100000:3.0:1746140885.987911:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16972 00000100:00100000:3.0:1746140885.987924:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16975 00000100:00100000:3.0:1746140885.987929:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:3312:x1830960576054528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.987957:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+92:3311:x1830960576053888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1740us total) trans 21474841405 rc 0/0 00000100:00100000:2.0:1746140885.987962:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16974 00000100:00100000:2.0:1746140885.987971:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16976 00000100:00100000:2.0:1746140885.987975:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+78:3312:x1830960576055040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.988045:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+80:3312:x1830960576054528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (1803us total) trans 17179874120 rc 0/0 00000100:00100000:3.0:1746140885.988051:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16975 00000100:00100000:2.0:1746140885.988059:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+79:3312:x1830960576055040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1792us total) trans 17179874121 rc 0/0 00000100:00100000:3.0:1746140885.988062:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16977 00000100:00100000:2.0:1746140885.988066:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16976 00000100:00100000:3.0:1746140885.988068:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+91:3310:x1830960576053120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.988075:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16978 00000100:00100000:2.0:1746140885.988094:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+91:3310:x1830960576053760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140885.988151:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140885.988154:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988156:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988158:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988159:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140885.988179:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+92:3310:x1830960576053120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (1874us total) trans 21474841406 rc 0/0 00000100:00100000:3.0:1746140885.988183:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16977 00000100:00100000:3.0:1746140885.988212:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.988234:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576054912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.988258:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746140885.988284:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093135f80/2, rc 0, transno 21474841403 00000100:00100000:2.0:1746140885.988291:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+92:3310:x1830960576053760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (1925us total) trans 21474841407 rc 0/0 00000100:00100000:3.0:1746140885.988293:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576053376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.988297:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16978 00000004:00080000:3.0:1746140885.988322:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d2b480/2, rc 0, transno 21474841405 00000100:00100000:2.0:1746140885.988322:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576054400 00000100:00100000:3.0:1746140885.988326:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576053888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.988326:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576054400 00000100:00100000:2.0:1746140885.988340:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576054912 00000100:00100000:2.0:1746140885.988342:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576054912 00000100:00100000:3.0:1746140885.988349:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16979 00000100:00100000:3.0:1746140885.988355:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+80:3311:x1830960576054400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746140885.988440:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746140885.988443:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988445:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988447:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988448:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746140885.988471:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+81:3311:x1830960576054400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (259us total) trans 17179874122 rc 0/0 00000100:00100000:3.0:1746140885.988476:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16979 00000100:00100000:3.0:1746140885.988488:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16980 00000100:00100000:3.0:1746140885.988493:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+80:3311:x1830960576054912:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140885.988505:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d29880/2, rc 0, transno 21474841407 00000100:00100000:1.0:1746140885.988513:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576053760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.988514:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140885.988522:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576054272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.988533:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576053632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.988545:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.988555:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576052992 00000100:00100000:2.0:1746140885.988557:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576052992 00000100:00100000:1.0:1746140885.988567:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576054784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.988569:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576054272 00000100:00100000:2.0:1746140885.988571:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576054272 00000100:00100000:3.0:1746140885.988572:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+81:3311:x1830960576054912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (311us total) trans 17179874123 rc 0/0 00000100:00100000:3.0:1746140885.988577:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16980 00000100:00100000:2.0:1746140885.988581:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16981 00000100:00100000:1.0:1746140885.988583:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.988585:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+92:3313:x1830960576052992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.988589:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576054784 00000100:00100000:3.0:1746140885.988593:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576054784 00000004:00080000:1.0:1746140885.988606:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093135500/2, rc 0, transno 21474841406 00000100:00100000:3.0:1746140885.988610:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16982 00000100:00100000:1.0:1746140885.988610:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576053120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.988614:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+82:3310:x1830960576054272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.988627:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16983 00000100:00100000:1.0:1746140885.988634:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+82:3310:x1830960576054784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140885.988654:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140885.988657:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.988659:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.988660:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:2.0:1746140885.988662:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140885.988682:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3313:x1830960576052992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (169us total) trans 21474841408 rc 0/0 00000100:00100000:2.0:1746140885.988687:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16981 00002000:00010000:3.0:1746140885.988691:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140885.988695:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988697:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988699:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988701:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140885.988702:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140885.988714:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576054144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140885.988725:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3310:x1830960576054272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (179us total) trans 17179874124 rc 0/0 00000100:00100000:3.0:1746140885.988730:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16982 00000100:00100000:2.0:1746140885.988731:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.988739:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576053632 00000100:00100000:3.0:1746140885.988742:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576053632 00000100:00100000:2.0:1746140885.988743:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576054656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.988747:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3310:x1830960576054784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (161us total) trans 17179874125 rc 0/0 00000100:00100000:1.0:1746140885.988753:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16983 00000100:00100000:3.0:1746140885.988754:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576054144 00000100:00100000:3.0:1746140885.988756:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576054144 00000100:00100000:2.0:1746140885.988756:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140885.988767:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576054656 00000100:00100000:3.0:1746140885.988769:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576054656 00000100:00100000:1.0:1746140885.988774:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16984 00000004:00080000:2.0:1746140885.988776:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093136300/2, rc 0, transno 21474841408 00000100:00100000:2.0:1746140885.988780:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576052992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140885.988780:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3313:x1830960576053632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140885.988783:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16985 00000100:00100000:3.0:1746140885.988787:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3313:x1830960576054144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.988798:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16986 00000100:00100000:2.0:1746140885.988804:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+84:3313:x1830960576054656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.988843:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3313:x1830960576053632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (140us total) trans 21474841409 rc 0/0 00000100:00100000:1.0:1746140885.988847:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16984 00002000:00010000:3.0:1746140885.988853:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140885.988855:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988858:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988859:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140886 -> 1746140886 00002000:00010000:3.0:1746140885.988861:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746140885.988880:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3313:x1830960576054144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (148us total) trans 17179874126 rc 0/0 00000100:00100000:3.0:1746140885.988885:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16985 00000100:00100000:2.0:1746140885.988890:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+86:3313:x1830960576054656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (132us total) trans 17179874127 rc 0/0 00000100:00100000:2.0:1746140885.988896:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16986 00000004:00080000:2.0:1746140885.988922:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0ed80/2, rc 0, transno 17179874121 00000100:00100000:2.0:1746140885.988925:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576055040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140885.988933:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092612a00/2, rc 0, transno 17179874120 00000100:00100000:2.0:1746140885.988935:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576054528:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140885.988939:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092613100/2, rc 0, transno 17179874122 00000004:00080000:1.0:1746140885.988940:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135699f80/2, rc 0, transno 17179874124 00000004:00080000:2.0:1746140885.988943:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093135880/2, rc 0, transno 21474841402 00000100:00100000:3.0:1746140885.988944:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576054400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140885.988944:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576054272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.988946:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576053504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140885.988949:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0d500/2, rc 0, transno 17179874125 00000100:00100000:1.0:1746140885.988950:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576054784:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140885.988953:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0e300/2, rc 0, transno 17179874123 00000004:00080000:2.0:1746140885.988953:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d2b800/2, rc 0, transno 21474841404 00000100:00100000:3.0:1746140885.988956:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576054912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140885.988956:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576054016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.988962:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746140885.988967:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576055168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140885.988987:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746140885.989016:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d2ad80/2, rc 0, transno 21474841409 00000100:00100000:2.0:1746140885.989019:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576053632:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140885.989026:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf11180/2, rc 0, transno 17179874126 00000100:00100000:2.0:1746140885.989029:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576054144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140885.989035:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0ea00/2, rc 0, transno 17179874127 00000100:00100000:2.0:1746140885.989037:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576054656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140885.989168:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576055168 00000100:00100000:0.0:1746140885.989172:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576055168 00000100:00100000:0.0:1746140885.989195:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16987 00000100:00100000:0.0:1746140885.989200:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+94:3312:x1830960576055168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.989320:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3312:x1830960576055168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (317us total) trans 21474841410 rc 0/0 00000100:00100000:0.0:1746140885.989325:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16987 00000004:00080000:2.0:1746140885.989358:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f123480/2, rc 0, transno 21474841410 00000100:00100000:2.0:1746140885.989362:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576055168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140885.990574:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.990645:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573726592 00000100:00100000:3.0:1746140885.990650:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573726592 00000100:00100000:3.0:1746140885.990676:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10738 00000100:00100000:3.0:1746140885.990681:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32660:x1830960573726592:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140885.990695:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.990711:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6c00/0x8156357b7fdba372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1758 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.990803:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.990815:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.990825:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.990836:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.990842:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.990847:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.990938:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.990945:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.990950:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140885.990959:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140885.991062:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991068:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991074:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991091:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fce6600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.991096:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991101:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991111:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140885.991114:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.991117:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991122:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdba379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991132:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991137:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991142:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991150:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fce6e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140885.991152:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991157:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991162:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388800) 00010000:00010000:3.0:1746140885.991164:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140885.991166:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991170:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6e00/0x8156357b7fdba380 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140885.991201:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6c00/0x8156357b7fdba372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 270 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.991211:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.991216:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140885.991217:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140885.991219:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce7400, rc 0) 00000100:00100000:3.0:1746140885.991262:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32660:x1830960573726592:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 580us (692us total) trans 8589945030 rc 0/0 00000100:00100000:3.0:1746140885.991268:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10738 00000100:00100000:0.0:1746140885.992044:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.992067:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576053248:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140885.992108:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9c00/0x8156357b7fdba35d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 8 pid: 27790 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746140885.992125:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 7 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140885.992137:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573726720 00010000:00010000:3.0:1746140885.992146:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b48400, rc 0) 00000100:00100000:2.0:1746140885.992148:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573726720 00000100:00100000:3.0:1746140885.992184:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32656:x1830960573725440:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 34694us (34915us total) trans 8589945029 rc 0/0 00000100:00100000:3.0:1746140885.992190:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10736 00000100:00100000:2.0:1746140885.992194:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4709 00000100:00100000:2.0:1746140885.992200:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32654:x1830960573726720:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:2.0:1746140885.992289:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32654:x1830960573726720:12345-192.168.204.16@tcp:49:cat.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.992295:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4709 00000100:00100000:0.0:1746140885.994887:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.995094:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573726848 00000100:00100000:3.0:1746140885.995103:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573726848 00000100:00100000:3.0:1746140885.995150:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16988 00000100:00100000:3.0:1746140885.995157:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:32656:x1830960573726848:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140885.995171:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140885.995327:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a175f expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.995355:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.995363:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 32 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.995370:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 25 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.995376:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.995379:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140885.995383:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2502656->2699263] (req 2502656->2699263) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 25 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140885.995412:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 25 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.995423:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 25 pid: 32376 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140885.995435:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576055296:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.995578:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 32 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.995587:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 32 pid: 8459 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140885.995595:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576055424:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140885.995719:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140885.995728:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 16 pid: 4784 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140885.995736:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576055552:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140885.995757:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140885.996213:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140885.996337:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573726976 00000100:00100000:1.0:1746140885.996341:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573726976 00000100:00100000:1.0:1746140885.996366:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16989 00000100:00100000:1.0:1746140885.996372:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:32660:x1830960573726976:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140885.996379:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140885.996387:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1766 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.996400:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.996402:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.996405:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3149824->3235839] (req 3149824->3235839) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 34 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.996414:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3149824->3235839] (req 3149824->3235839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 34 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.996422:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c84e00, rc 0) 00000100:00100000:1.0:1746140885.996462:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:32660:x1830960573726976:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.996467:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16989 00000100:00100000:0.0:1746140885.997508:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140885.997696:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573727232 00000100:00100000:3.0:1746140885.997701:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573727232 00002000:00100000:3.0:1746140885.997732:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880092ba4700 x1830960573727232/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/0 e 0 to 0 dl 1746140896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140885.997741:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba4700 with x1830960573727232 ext(1048576->2097151) 00002000:00010000:3.0:1746140885.997745:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba4700 00000100:00100000:3.0:1746140885.997776:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8684 00000100:00100000:3.0:1746140885.997781:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573727232:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140885.997803:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576055296:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.997813:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576055424:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140885.997821:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576055552:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140885.997850:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2502656->2699263] (req 2502656->2699263) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 25 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140885.997861:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce7600, rc 0) 00000100:00100000:2.0:1746140885.997884:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+25:32656:x1830960573726848:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2728us (3006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.997888:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16988 00000100:00100000:0.0:1746140885.998743:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.998784:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140885.998825:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140885.998844:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573727360 00000100:00100000:2.0:1746140885.998850:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573727360 00000100:00100000:1.0:1746140885.998864:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573727616 00000100:00100000:1.0:1746140885.998868:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573727616 00010000:00010000:1.0:1746140885.998888:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 17 pid: 4784 timeout: 965 lvb_type: 1 00000100:00100000:1.0:1746140885.998922:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573727488 00000100:00100000:1.0:1746140885.998924:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573727488 00010000:00010000:1.0:1746140885.998934:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 25 pid: 32376 timeout: 965 lvb_type: 1 00000100:00100000:1.0:1746140885.998953:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8782 00000100:00100000:1.0:1746140885.998958:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4908c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+17:1983:x1830960573727616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.998966:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.998968:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 34 pid: 8459 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140885.998984:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 17 pid: 4784 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140885.998994:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 17 pid: 4784 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140885.999015:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f080c00/0x8156357b7fdba25a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16c5 expref: 17 pid: 4784 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140885.999027:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140885.999051:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4908c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573727616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140885.999057:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8782 00000100:00100000:1.0:1746140885.999069:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8783 00000100:00100000:1.0:1746140885.999074:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573727488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140885.999092:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140885.999200:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8784 00000100:00100000:2.0:1746140885.999208:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573727360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140885.999220:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140885.999239:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 34 pid: 8459 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140885.999249:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 34 pid: 8459 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140885.999272:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216600/0x8156357b7fdba310 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1719 expref: 34 pid: 8459 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140885.999286:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140885.999339:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1983:x1830960573727360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 132us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140885.999345:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8784 00010000:00010000:1.0:1746140885.999835:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 25 pid: 32376 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140885.999849:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 25 pid: 32376 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140885.999863:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba2d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e8 expref: 25 pid: 32376 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140885.999877:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.999879:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.999886:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 24 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.999892:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 24 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.999899:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.999901:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140885.999904:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 32 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.999911:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 32 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140885.999938:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 32 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140885.999947:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576055680:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140886.000017:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 24 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.000024:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576055808:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140886.000057:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.002376:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.002817:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573727872 00000100:00100000:2.0:1746140886.002828:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573727872 00002000:00100000:2.0:1746140886.002874:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3149824->3153919) req@ffff880092ba6300 x1830960573727872/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.002883:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba6300 with x1830960573727872 ext(3149824->3153919) 00002000:00010000:2.0:1746140886.002888:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba6300 00000100:00100000:2.0:1746140886.002924:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8685 00000100:00100000:2.0:1746140886.002932:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573727872:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140886.002943:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576055680:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.003104:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573727872:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 172us (737us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140886.003110:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8685 00002000:00100000:2.0:1746140886.003116:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3149824->3153919) req@ffff880092ba6300 x1830960573727872/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.003123:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba6300 with x1830960573727872 ext(3149824->3153919) 00002000:00010000:2.0:1746140886.003126:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba6300 00000100:00100000:0.0:1746140886.003797:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.003872:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576055808:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140886.003894:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.003915:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573728128 00000100:00100000:3.0:1746140886.003921:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573728128 00000100:00100000:1.0:1746140886.003926:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573727488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4851us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.003936:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8783 00002000:00100000:3.0:1746140886.003962:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2502656->2506751) req@ffff880092ba4a80 x1830960573728128/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.003971:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba4a80 with x1830960573728128 ext(2502656->2506751) 00002000:00010000:3.0:1746140886.003975:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba4a80 00000100:00100000:3.0:1746140886.003990:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8686 00000100:00100000:3.0:1746140886.003997:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573728128:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140886.004119:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573728128:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 123us (324us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.004125:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8686 00002000:00100000:3.0:1746140886.004130:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2502656->2506751) req@ffff880092ba4a80 x1830960573728128/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.004138:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba4a80 with x1830960573728128 ext(2502656->2506751) 00002000:00010000:3.0:1746140886.004148:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba4a80 00000100:00080000:0.0:1746140886.004177:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746140886.005581:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573727232:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7796us (8070us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.005589:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8684 00002000:00100000:3.0:1746140886.005596:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880092ba4700 x1830960573727232/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:301/0 lens 488/440 e 0 to 0 dl 1746140896 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.005603:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba4700 with x1830960573727232 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.005609:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba4700 00000100:00100000:0.0:1746140886.005998:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.006055:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573728384 00000100:00100000:3.0:1746140886.006060:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573728384 00002000:00100000:3.0:1746140886.006089:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3231744->3235839) req@ffff880092ba6a00 x1830960573728384/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.006097:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba6a00 with x1830960573728384 ext(3231744->3235839) 00002000:00010000:3.0:1746140886.006100:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba6a00 00000100:00100000:3.0:1746140886.006453:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8687 00000100:00100000:3.0:1746140886.006469:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573728384:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140886.006632:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573728384:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 169us (635us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.006640:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8687 00002000:00100000:3.0:1746140886.006651:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3231744->3235839) req@ffff880092ba6a00 x1830960573728384/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.006660:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba6a00 with x1830960573728384 ext(3231744->3235839) 00002000:00010000:3.0:1746140886.006665:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba6a00 00000100:00100000:0.0:1746140886.010484:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.010549:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573728640 00000100:00100000:3.0:1746140886.010562:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573728640 00002000:00100000:3.0:1746140886.010609:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2695168->2699263) req@ffff880092ba7100 x1830960573728640/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.010620:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7100 with x1830960573728640 ext(2695168->2699263) 00002000:00010000:3.0:1746140886.010625:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba7100 00000100:00100000:3.0:1746140886.010657:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8688 00000100:00100000:3.0:1746140886.010665:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573728640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140886.010832:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573728640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 167us (358us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.010839:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8688 00002000:00100000:3.0:1746140886.010844:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2695168->2699263) req@ffff880092ba7100 x1830960573728640/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.010851:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7100 with x1830960573728640 ext(2695168->2699263) 00002000:00010000:3.0:1746140886.010854:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba7100 00000100:00100000:0.0:1746140886.011066:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.011160:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573728896 00000100:00100000:2.0:1746140886.011167:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573728896 00000100:00100000:2.0:1746140886.011225:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4710 00000100:00100000:2.0:1746140886.011233:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32660:x1830960573728896:12345-192.168.204.16@tcp:35:multiop.0 00000100:00080000:0.0:1746140886.011408:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746140886.011472:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32660:x1830960573728896:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 239us (404us total) trans 8589945031 rc 0/0 00000100:00100000:2.0:1746140886.011479:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4710 00000100:00100000:0.0:1746140886.011582:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.012135:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573729152 00000100:00100000:3.0:1746140886.012142:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573729152 00002000:00100000:3.0:1746140886.012169:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880092ba6680 x1830960573729152/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.012176:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba6680 with x1830960573729152 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.012180:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba6680 00000100:00100000:3.0:1746140886.012209:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8689 00000100:00100000:3.0:1746140886.012215:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573729152:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140886.013060:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.013141:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573729408 00000100:00100000:2.0:1746140886.013147:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573729408 00000100:00100000:2.0:1746140886.013195:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4711 00000100:00100000:2.0:1746140886.013201:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32656:x1830960573729408:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140886.013374:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32656:x1830960573729408:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 172us (315us total) trans 8589945032 rc 0/0 00000100:00100000:2.0:1746140886.013380:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4711 00000100:00080000:0.0:1746140886.013485:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746140886.018579:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573729152:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6352us (6985us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.018592:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8689 00002000:00100000:3.0:1746140886.018603:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880092ba6680 x1830960573729152/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.018615:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba6680 with x1830960573729152 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.018620:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba6680 00000100:00100000:0.0:1746140886.026692:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.026757:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573729536 00000100:00100000:2.0:1746140886.026766:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573729536 00000100:00100000:2.0:1746140886.026818:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16990 00000100:00100000:2.0:1746140886.026826:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:32654:x1830960573729536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.026845:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.026862:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a176d expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.026894:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.026901:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.026903:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.026906:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.026933:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.026944:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 23 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.026955:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576055936:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.027040:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.029818:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576055936:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.029848:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.029863:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f899400, rc 0) 00000100:00100000:2.0:1746140886.029912:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:32654:x1830960573729536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3085us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.029923:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16990 00000100:00100000:0.0:1746140886.030117:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.030238:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573729664 00000100:00100000:3.0:1746140886.030244:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573729664 00002000:00100000:3.0:1746140886.030278:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2502656->2699263) req@ffff88009fc0b100 x1830960573729664/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.030287:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0b100 with x1830960573729664 ext(2502656->2699263) 00010000:00010000:3.0:1746140886.030294:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 24 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.030329:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 24 pid: 24958 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.030335:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc0b100 00000100:00100000:3.0:1746140886.030357:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1796 00000100:00100000:3.0:1746140886.030364:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573729664:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140886.032914:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573729664:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2542us (2789us total) trans 21474841411 rc 0/0 00000100:00100000:3.0:1746140886.032924:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1796 00002000:00100000:3.0:1746140886.032935:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2502656->2699263) req@ffff88009fc0b100 x1830960573729664/t21474841411(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.032944:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0b100 with x1830960573729664 ext(2502656->2699263) 00010000:00010000:3.0:1746140886.032952:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 26 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.032967:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 26 pid: 24958 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.032974:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc0b100 00000100:00100000:0.0:1746140886.035360:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.035409:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573729792 00000100:00100000:1.0:1746140886.035418:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573729792 00010000:00010000:1.0:1746140886.035450:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 26 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.035482:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8785 00000100:00100000:1.0:1746140886.035487:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573729792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.035497:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.035512:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 26 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.035519:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 26 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.035535:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdba395 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3149823] (req 2502656->2699263) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a175f expref: 26 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.035553:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.035555:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.035560:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.035568:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.035684:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.035692:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576056064:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140886.035872:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140886.038056:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576056064:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140886.038090:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.038152:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573729792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2662us (2801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.038162:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8785 00000100:00100000:0.0:1746140886.042427:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.042470:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.042555:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573730176 00000100:00100000:3.0:1746140886.042569:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573730176 00002000:00100000:3.0:1746140886.042612:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009fc08000 x1830960573730176/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.042621:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08000 with x1830960573730176 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.042626:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc08000 00000100:00100000:3.0:1746140886.042660:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573730304 00000100:00100000:3.0:1746140886.042663:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573730304 00002000:00100000:3.0:1746140886.042676:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009fc0bb80 x1830960573730304/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.042683:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0bb80 with x1830960573730304 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.042686:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc0bb80 00000100:00100000:3.0:1746140886.042907:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8690 00000100:00100000:3.0:1746140886.042915:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573730176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.042915:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8691 00000100:00100000:1.0:1746140886.042924:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573730304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.050794:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573730304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7864us (8315us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140886.050805:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8691 00002000:00100000:1.0:1746140886.050817:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009fc0bb80 x1830960573730304/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.050826:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0bb80 with x1830960573730304 ext(2097152->3145727) 00002000:00010000:1.0:1746140886.050831:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc0bb80 00000100:00100000:3.0:1746140886.052175:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573730176:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9252us (9748us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.052186:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8690 00002000:00100000:3.0:1746140886.052195:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009fc08000 x1830960573730176/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.052210:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08000 with x1830960573730176 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.052214:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc08000 00000100:00100000:0.0:1746140886.063667:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.063828:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573730432 00000100:00100000:2.0:1746140886.063836:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573730432 00000100:00100000:2.0:1746140886.063878:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16991 00000100:00100000:2.0:1746140886.063886:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:32654:x1830960573730432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.063903:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.063920:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1774 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.063947:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 35 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.063955:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.063957:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.063960:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 35 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.063987:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 35 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.063998:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 35 pid: 32377 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.064009:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576056192:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.064475:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.068406:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.068555:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576056192:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.068581:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 35 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.068597:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f898e00, rc 0) 00000100:00100000:2.0:1746140886.068634:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:32654:x1830960573730432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4749us (4978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.068642:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16991 00000100:00100000:3.0:1746140886.068728:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573730560 00000100:00100000:3.0:1746140886.068734:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573730560 00002000:00100000:3.0:1746140886.068767:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3149824->3235839) req@ffff88012b069500 x1830960573730560/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.068775:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069500 with x1830960573730560 ext(3149824->3235839) 00010000:00010000:3.0:1746140886.068782:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 35 pid: 32377 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.068793:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 35 pid: 32377 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.068799:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b069500 00000100:00100000:3.0:1746140886.068843:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1797 00000100:00100000:3.0:1746140886.068850:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573730560:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140886.071173:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573730560:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2315us (2767us total) trans 21474841412 rc 0/0 00000100:00100000:3.0:1746140886.071182:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1797 00002000:00100000:3.0:1746140886.071190:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3149824->3235839) req@ffff88012b069500 x1830960573730560/t21474841412(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.071199:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069500 with x1830960573730560 ext(3149824->3235839) 00010000:00010000:3.0:1746140886.071207:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 37 pid: 32377 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.071219:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 37 pid: 32377 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.071226:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b069500 00000100:00100000:0.0:1746140886.073371:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.073416:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573730688 00000100:00100000:1.0:1746140886.073425:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573730688 00010000:00010000:1.0:1746140886.073461:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 37 pid: 32377 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.073505:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8786 00000100:00100000:1.0:1746140886.073513:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573730688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.073527:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.073548:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 37 pid: 32377 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.073560:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 37 pid: 32377 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.073581:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c84e00/0x8156357b7fdba39c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3149824->18446744073709551615] (req 3149824->3235839) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1766 expref: 37 pid: 32377 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.073610:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.073612:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.073619:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.073628:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.073658:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.073670:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576056320:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140886.073759:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140886.074771:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576056320:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140886.074786:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.074936:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573730688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1423us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.074944:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8786 00000100:00100000:0.0:1746140886.078991:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.079050:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.079116:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573731072 00000100:00100000:3.0:1746140886.079125:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573731072 00000100:00100000:1.0:1746140886.079150:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573731200 00000100:00100000:1.0:1746140886.079155:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573731200 00002000:00100000:3.0:1746140886.079172:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b068a80 x1830960573731072/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.079175:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b068380 x1830960573731200/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.079180:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068a80 with x1830960573731072 ext(3145728->4194303) 00002000:00100000:1.0:1746140886.079183:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068380 with x1830960573731200 ext(3145728->4194303) 00002000:00010000:3.0:1746140886.079186:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b068a80 00002000:00010000:1.0:1746140886.079187:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b068380 00000100:00100000:1.0:1746140886.079221:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8692 00000100:00100000:1.0:1746140886.079229:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573731200:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.079340:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8693 00000100:00100000:0.0:1746140886.079349:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573731072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140886.088492:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573731072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9134us (9500us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140886.088503:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8693 00002000:00100000:2.0:1746140886.088514:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b068a80 x1830960573731072/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.088522:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068a80 with x1830960573731072 ext(3145728->4194303) 00002000:00010000:2.0:1746140886.088527:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b068a80 00000100:00100000:1.0:1746140886.090096:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573731200:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10859us (11036us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140886.090107:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8692 00002000:00100000:1.0:1746140886.090117:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b068380 x1830960573731200/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.090126:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068380 with x1830960573731200 ext(3145728->4194303) 00002000:00010000:1.0:1746140886.090132:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b068380 00000100:00100000:0.0:1746140886.095460:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.095964:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573731456 00000100:00100000:1.0:1746140886.095973:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573731456 00002000:00100000:1.0:1746140886.096016:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b069880 x1830960573731456/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.096030:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069880 with x1830960573731456 ext(4194304->4886527) 00002000:00010000:1.0:1746140886.096036:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b069880 00000100:00100000:1.0:1746140886.096069:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8694 00000100:00100000:1.0:1746140886.096085:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573731456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.100294:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573731456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4209us (4832us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140886.100335:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8694 00002000:00100000:1.0:1746140886.100346:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b069880 x1830960573731456/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.100354:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069880 with x1830960573731456 ext(4194304->4886527) 00002000:00010000:1.0:1746140886.100359:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b069880 00000100:00100000:0.0:1746140886.104721:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.104849:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573731712 00000100:00100000:1.0:1746140886.104862:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573731712 00000100:00100000:1.0:1746140886.105609:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4712 00000100:00100000:1.0:1746140886.105619:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32654:x1830960573731712:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140886.105840:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32654:x1830960573731712:12345-192.168.204.16@tcp:35:cat.0 Request processed in 223us (1130us total) trans 8589945033 rc 0/0 00000100:00100000:1.0:1746140886.105847:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4712 00000100:00100000:0.0:1746140886.130464:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.130896:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573731968 00000100:00100000:3.0:1746140886.130905:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573731968 00000100:00100000:3.0:1746140886.130959:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10739 00000100:00100000:3.0:1746140886.130967:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32665:x1830960573731968:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140886.130990:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.131006:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a177b expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.131100:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.131113:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 272 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.131119:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.131150:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 272 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.131160:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 272 pid: 14785 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.131170:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576056448:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.131258:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.133277:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.133414:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576056448:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140886.133419:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573732096 00000100:00100000:1.0:1746140886.133426:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573732096 00010000:00010000:3.0:1746140886.133447:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140886.133455:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 273 pid: 14785 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.133481:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8787 00000100:00100000:1.0:1746140886.133488:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:1984:x1830960573732096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.133499:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.133505:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 273 pid: 14785 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.133515:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 273 pid: 14785 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.133537:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba387 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1758 expref: 273 pid: 14785 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.133610:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140886.133615:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140886.133623:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140886.133629:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140886.133649:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140886.133670:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.133677:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:1.0:1746140886.133677:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1984:x1830960573732096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 190us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.133682:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8787 00000004:00200000:3.0:1746140886.133691:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.133808:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 273 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.133843:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 272 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.133849:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.133852:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746140886.133854:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67000, rc 0) 00000100:00100000:3.0:1746140886.133888:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32665:x1830960573731968:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2922us (3432us total) trans 8589945034 rc 0/0 00000100:00100000:3.0:1746140886.133895:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10739 00000100:00100000:0.0:1746140886.139966:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.140089:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573732224 00000100:00100000:2.0:1746140886.140098:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573732224 00000100:00100000:2.0:1746140886.140142:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16992 00000100:00100000:2.0:1746140886.140150:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:32665:x1830960573732224:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.140168:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.140186:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1782 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.140216:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.140224:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 37 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.140232:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.140238:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.140240:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.140244:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1564672->1757183] (req 1564672->1757183) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 37 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.140277:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.140287:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 15 pid: 8458 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.140298:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576056576:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.140529:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 37 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.140537:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 37 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.140546:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576056704:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.140574:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.140586:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 24 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.140593:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576056832:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.140607:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.142444:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.142805:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576056576:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.142814:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576056704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.142821:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576056832:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.142858:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1564672->1757183] (req 1564672->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 37 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.142873:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5217600, rc 0) 00000100:00100000:2.0:1746140886.142982:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:32665:x1830960573732224:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2831us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.142989:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16992 00000100:00100000:1.0:1746140886.143609:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573732352 00000100:00100000:0.0:1746140886.143768:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.143925:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573732480 00000100:00100000:3.0:1746140886.143929:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573732480 00010000:00010000:3.0:1746140886.143955:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.143977:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8788 00000100:00100000:3.0:1746140886.143983:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573732480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.143994:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140886.144002:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573732352 00010000:00010000:3.0:1746140886.144012:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.144018:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 16 pid: 8458 timeout: 965 lvb_type: 1 00010000:00010000:3.0:1746140886.144020:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.144037:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8789 00010000:00010000:3.0:1746140886.144041:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba214 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a168d expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.144041:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573732352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.144047:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.144069:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 16 pid: 8458 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.144087:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 16 pid: 8458 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.144099:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a36600/0x8156357b7fdba245 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16be expref: 16 pid: 8458 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.144112:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.144134:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573732352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.144140:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8789 00000100:00100000:0.0:1746140886.144544:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.144573:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573732608 00000100:00100000:1.0:1746140886.144576:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573732608 00010000:00010000:1.0:1746140886.144590:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 37 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:1.0:1746140886.144602:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8790 00000100:00100000:1.0:1746140886.144606:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4908850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573732608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.144613:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.144619:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 37 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.144626:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 37 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.144636:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba302 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1712 expref: 37 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.144644:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.144645:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.144651:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.144658:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.144722:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140886.144743:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.144753:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576056960:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140886.144812:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573732480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 828us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.144817:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8788 00000100:00100000:1.0:1746140886.144859:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140886.145911:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576056960:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140886.145924:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.145945:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4908850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573732608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1337us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.145951:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8790 00000100:00100000:0.0:1746140886.146363:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.146555:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573732864 00000100:00100000:1.0:1746140886.146559:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573732864 00002000:00100000:1.0:1746140886.146588:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1564672->1568767) req@ffff88009fc35c00 x1830960573732864/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.146597:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35c00 with x1830960573732864 ext(1564672->1568767) 00002000:00010000:1.0:1746140886.146601:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc35c00 00000100:00100000:1.0:1746140886.146623:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8695 00000100:00100000:1.0:1746140886.146629:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573732864:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140886.146934:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573732864:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 305us (571us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140886.146940:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8695 00002000:00100000:1.0:1746140886.146945:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1564672->1568767) req@ffff88009fc35c00 x1830960573732864/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.146952:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35c00 with x1830960573732864 ext(1564672->1568767) 00002000:00010000:1.0:1746140886.146955:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc35c00 00000100:00100000:0.0:1746140886.149675:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.149758:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573733120 00000100:00100000:1.0:1746140886.149765:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573733120 00002000:00100000:1.0:1746140886.149801:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1753088->1757183) req@ffff88009fc37100 x1830960573733120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.149810:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37100 with x1830960573733120 ext(1753088->1757183) 00002000:00010000:1.0:1746140886.149815:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc37100 00000100:00100000:1.0:1746140886.149850:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8696 00000100:00100000:1.0:1746140886.149857:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573733120:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140886.150506:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1985:x1830960573733120:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 649us (838us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140886.150514:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8696 00002000:00100000:1.0:1746140886.150521:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1753088->1757183) req@ffff88009fc37100 x1830960573733120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.150527:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37100 with x1830960573733120 ext(1753088->1757183) 00002000:00010000:1.0:1746140886.150530:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc37100 00000100:00100000:0.0:1746140886.182500:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.182592:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573733376 00000100:00100000:3.0:1746140886.182601:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573733376 00000100:00100000:3.0:1746140886.182647:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10740 00000100:00100000:3.0:1746140886.182655:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32669:x1830960573733376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.182676:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.182693:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba3cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1789 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.182810:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.182823:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.182833:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.182844:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.182849:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.182854:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.182959:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.182967:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183505:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140886.183515:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.183605:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183612:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183618:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183623:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec67c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.183627:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183633:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183643:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.183645:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.183648:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183653:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba3d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183685:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183690:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183695:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183698:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.183701:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183709:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183715:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388100) 00010000:00010000:3.0:1746140886.183716:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.183718:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183723:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba3db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.183762:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba3cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.183773:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.183779:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.183781:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.183784:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66800, rc 0) 00000100:00100000:3.0:1746140886.183843:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32669:x1830960573733376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1188us (1354us total) trans 8589945035 rc 0/0 00000100:00100000:3.0:1746140886.183850:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10740 00000100:00100000:0.0:1746140886.187141:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.187185:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.187211:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573733504 00000100:00100000:2.0:1746140886.187224:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573733504 00000100:00100000:2.0:1746140886.187267:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573733632 00000100:00100000:2.0:1746140886.187269:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573733632 00000100:00100000:1.0:1746140886.187348:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16993 00000100:00100000:1.0:1746140886.187361:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573733504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140886.187380:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140886.187456:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16994 00000100:00100000:2.0:1746140886.187464:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573733632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.187478:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.187495:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1797 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.187519:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.187521:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.187529:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140886.187686:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f100600/0x8156357b7fdba3f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1790 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.187734:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057088:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140886.187816:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e480 going to sleep for 11 seconds 00010000:00010000:2.0:1746140886.187874:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 27 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.187885:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801399b5a00, rc 0) 00000100:00100000:2.0:1746140886.187941:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573733632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 476us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.187948:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16994 00000100:00100000:1.0:1746140886.189866:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057088:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140886.189893:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f100600/0x8156357b7fdba3f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1790 expref: 26 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140886.189905:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f100600/0x8156357b7fdba3f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1790 expref: 26 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140886.189926:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f100600, rc 0) 00000100:00100000:1.0:1746140886.189968:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573733504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2611us (2834us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140886.189975:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16993 00000100:00100000:0.0:1746140886.197237:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.197285:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.197370:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573733888 00000100:00100000:1.0:1746140886.197382:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573733888 00002000:00100000:1.0:1746140886.197430:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc35180 x1830960573733888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.197440:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35180 with x1830960573733888 ext(0->1048575) 00002000:00010000:1.0:1746140886.197445:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc35180 00000100:00100000:1.0:1746140886.197485:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573734144 00000100:00100000:1.0:1746140886.197488:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573734144 00002000:00100000:1.0:1746140886.197500:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc37b80 x1830960573734144/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.197508:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37b80 with x1830960573734144 ext(1048576->2097151) 00002000:00010000:1.0:1746140886.197511:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc37b80 00000100:00100000:1.0:1746140886.197525:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8697 00000100:00100000:1.0:1746140886.197532:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573733888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140886.197676:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8698 00000100:00100000:2.0:1746140886.197684:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1982:x1830960573734144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.197763:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.197830:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573734400 00000100:00100000:3.0:1746140886.197835:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573734400 00002000:00100000:3.0:1746140886.197854:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009fc34a80 x1830960573734400/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.197861:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34a80 with x1830960573734400 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.197866:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc34a80 00000100:00100000:3.0:1746140886.197890:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8699 00000100:00100000:3.0:1746140886.197895:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1983:x1830960573734400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.205473:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573733888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7930us (8232us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140886.205485:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8697 00002000:00100000:1.0:1746140886.205497:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc35180 x1830960573733888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.205506:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35180 with x1830960573733888 ext(0->1048575) 00002000:00010000:1.0:1746140886.205512:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc35180 00000100:00100000:3.0:1746140886.210816:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1983:x1830960573734400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12908us (13041us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.210828:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8699 00002000:00100000:3.0:1746140886.210839:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009fc34a80 x1830960573734400/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.210849:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34a80 with x1830960573734400 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.210855:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc34a80 00000100:00100000:2.0:1746140886.212200:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1982:x1830960573734144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14508us (14905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140886.212210:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8698 00002000:00100000:2.0:1746140886.212219:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc37b80 x1830960573734144/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.212228:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37b80 with x1830960573734144 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.212233:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc37b80 00000100:00100000:2.0:1746140886.221271:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.221503:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573734528 00000100:00100000:1.0:1746140886.221513:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573734528 00000100:00100000:1.0:1746140886.221557:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16995 00000100:00100000:1.0:1746140886.221565:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+25:32669:x1830960573734528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140886.221584:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140886.221601:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a179e expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.221972:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 35 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.221981:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140886.221983:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140886.221986:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.222015:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 35 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.222026:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 35 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.222038:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057216:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140886.222496:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.223752:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057216:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.223856:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.223872:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f101200, rc 0) 00000100:00100000:2.0:1746140886.223908:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32669:x1830960573734528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2344us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.223916:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16995 00000100:00100000:0.0:1746140886.224131:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.224358:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573734656 00000100:00100000:2.0:1746140886.224364:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573734656 00002000:00100000:2.0:1746140886.224398:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1564672->1757183) req@ffff88009fc37480 x1830960573734656/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.224408:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37480 with x1830960573734656 ext(1564672->1757183) 00010000:00010000:2.0:1746140886.224414:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 36 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.224426:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 36 pid: 24958 timeout: 965 lvb_type: 0 00002000:00010000:2.0:1746140886.224432:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc37480 00000100:00100000:2.0:1746140886.224457:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1798 00000100:00100000:2.0:1746140886.224463:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573734656:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140886.228421:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1983:x1830960573734656:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3942us (4274us total) trans 21474841413 rc 0/0 00000100:00100000:2.0:1746140886.228433:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1798 00002000:00100000:2.0:1746140886.228443:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1564672->1757183) req@ffff88009fc37480 x1830960573734656/t21474841413(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.228458:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37480 with x1830960573734656 ext(1564672->1757183) 00010000:00010000:2.0:1746140886.228467:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 38 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.228480:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 38 pid: 24958 timeout: 965 lvb_type: 0 00002000:00010000:2.0:1746140886.228486:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc37480 00000100:00100000:0.0:1746140886.229574:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.229656:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573734784 00000100:00100000:1.0:1746140886.229663:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573734784 00010000:00010000:1.0:1746140886.229690:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 38 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.229727:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8791 00000100:00100000:1.0:1746140886.229734:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573734784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.229747:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.229766:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 38 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.229776:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 38 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.229797:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba3c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1757183) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1782 expref: 38 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.229932:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.229934:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.229941:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.229949:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.229980:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.229992:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576057344:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140886.230492:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.231644:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.231842:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573735040 00000100:00100000:3.0:1746140886.231849:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573735040 00000100:00100000:1.0:1746140886.231878:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576057344:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140886.231889:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10741 00010000:00010000:1.0:1746140886.231893:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.231894:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32671:x1830960573735040:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140886.231914:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140886.231922:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573734784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2189us (2352us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140886.231929:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17a5 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.231930:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8791 00010000:00010000:3.0:1746140886.232032:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232044:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232053:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232064:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232070:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232087:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232220:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba41a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232227:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba41a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232233:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba41a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140886.232241:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.232358:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232364:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232370:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232375:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.232378:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232383:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232391:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.232395:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.232398:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.232402:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba40c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.233000:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.233008:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.233013:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.233018:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.233020:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.233025:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.233033:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388200) 00010000:00010000:3.0:1746140886.233035:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.233038:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.233042:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba413 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.233158:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17a5 expref: 13 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.233172:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba41a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17a5 expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.233178:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.233180:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.233183:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67200, rc 0) 00000100:00100000:3.0:1746140886.233228:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32671:x1830960573735040:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1332us (1586us total) trans 8589945036 rc 0/0 00000100:00100000:3.0:1746140886.233234:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10741 00000100:00100000:0.0:1746140886.234788:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.234867:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.234949:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573735424 00000100:00100000:1.0:1746140886.234957:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573735424 00000100:00100000:1.0:1746140886.235007:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 772 00000100:00100000:1.0:1746140886.235014:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573735424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.235027:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.235044:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba41a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17a5 expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.235056:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140886.235060:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.235103:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573735424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.235108:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 772 00000100:00100000:2.0:1746140886.235226:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573735296 00000100:00100000:2.0:1746140886.235230:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573735296 00002000:00100000:2.0:1746140886.235268:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880093130000 x1830960573735296/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.235281:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130000 with x1830960573735296 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.235285:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093130000 00000100:00100000:2.0:1746140886.235345:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8700 00000100:00100000:2.0:1746140886.235350:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573735296:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.239018:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.239111:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573735552 00000100:00100000:2.0:1746140886.239121:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573735552 00000100:00100000:2.0:1746140886.239176:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16996 00000100:00100000:2.0:1746140886.239183:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32671:x1830960573735552:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.239199:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.239214:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17ac expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.239239:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.239246:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 29 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.239250:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.239253:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.239255:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.239256:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2478080->2654207] (req 2478080->2654207) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.239279:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.239287:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 36 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.239295:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057472:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.239612:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 29 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.239619:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 29 pid: 24958 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.239627:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057600:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.239661:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.239753:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.239765:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057728:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.239788:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.240670:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057472:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.240680:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057600:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.240686:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576057728:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.240707:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2478080->2654207] (req 2478080->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.240719:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801354a9800, rc 0) 00000100:00100000:2.0:1746140886.240804:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32671:x1830960573735552:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1619us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.240811:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16996 00000100:00100000:3.0:1746140886.240851:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573735296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5499us (6066us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.240860:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8700 00002000:00100000:3.0:1746140886.240869:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880093130000 x1830960573735296/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.240878:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130000 with x1830960573735296 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.240882:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093130000 00000100:00100000:0.0:1746140886.244465:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.244501:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.244536:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.244597:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573735680 00000100:00100000:3.0:1746140886.244606:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573735680 00010000:00010000:3.0:1746140886.244644:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 27 pid: 24958 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140886.244672:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573735808 00000100:00100000:3.0:1746140886.244674:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573735808 00010000:00010000:3.0:1746140886.244684:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 37 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.244712:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573735936 00000100:00100000:2.0:1746140886.244716:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573735936 00000100:00100000:2.0:1746140886.244739:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16997 00000100:00100000:2.0:1746140886.244745:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32669:x1830960573735936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.244760:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.244772:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17b3 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.244796:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.244802:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2478080->2654207] (req 2478080->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.244809:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746140886.244835:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8792 00000100:00100000:0.0:1746140886.244841:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8793 00000100:00100000:1.0:1746140886.244843:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573735680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140886.244849:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573735808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.244851:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140886.244856:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.245020:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.245531:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 37 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140886.245543:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 37 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140886.245559:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f899400/0x8156357b7fdba3a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a176d expref: 37 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140886.245586:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140886.245617:0:20960:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2478080->2654207] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140886.245626:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573735808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 779us (1124us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140886.245629:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140886.245632:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8793 00010000:00010000:2.0:1746140886.245635:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bc200, rc 0) 00000100:00100000:2.0:1746140886.245650:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+29:32669:x1830960573735936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 907us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.245654:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16997 00000100:00100000:0.0:1746140886.245682:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140886.245741:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 28 pid: 24958 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.245746:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573736064 00000100:00100000:2.0:1746140886.245749:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573736064 00010000:00010000:1.0:1746140886.245750:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 28 pid: 24958 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140886.245759:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.245761:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801399b5a00/0x8156357b7fdba3f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1797 expref: 28 pid: 24958 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.245769:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.245775:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8794 00000100:00100000:2.0:1746140886.245778:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573736064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.245783:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140886.245787:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573735680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 946us (1333us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140886.245789:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.245793:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8792 00010000:00010000:2.0:1746140886.245795:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.245802:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f898e00/0x8156357b7fdba3aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1774 expref: 36 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.245859:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.245861:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.245866:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.245873:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.245890:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.245900:0:9847:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 26 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.245910:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576057984:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.246036:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.248928:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.249031:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573736320 00000100:00100000:2.0:1746140886.249034:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576057984:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140886.249037:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573736320 00010000:00010000:2.0:1746140886.249051:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746140886.249084:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2478080->2482175) req@ffff88009b755880 x1830960573736320/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140886.249095:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573736064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3315us (3412us total) trans 0 rc 0/0 00002000:00100000:3.0:1746140886.249097:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755880 with x1830960573736320 ext(2478080->2482175) 00000100:00100000:2.0:1746140886.249104:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8794 00010000:00010000:3.0:1746140886.249105:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.249118:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.249124:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b755880 00000100:00100000:3.0:1746140886.249139:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1799 00000100:00100000:3.0:1746140886.249146:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573736320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140886.249326:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573736320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 156us (382us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.249332:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1799 00002000:00100000:3.0:1746140886.249338:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2478080->2482175) req@ffff88009b755880 x1830960573736320/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.249345:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755880 with x1830960573736320 ext(2478080->2482175) 00010000:00010000:3.0:1746140886.249349:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.249358:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.249365:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b755880 00000100:00100000:0.0:1746140886.251487:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.251538:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573736576 00000100:00100000:3.0:1746140886.251546:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573736576 00002000:00100000:3.0:1746140886.251578:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2650112->2654207) req@ffff88009b757480 x1830960573736576/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.251586:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b757480 with x1830960573736576 ext(2650112->2654207) 00010000:00010000:3.0:1746140886.251593:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.251606:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.251612:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b757480 00000100:00100000:3.0:1746140886.251636:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1800 00000100:00100000:3.0:1746140886.251641:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573736576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140886.251796:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573736576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 154us (319us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.251802:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1800 00002000:00100000:3.0:1746140886.251807:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2650112->2654207) req@ffff88009b757480 x1830960573736576/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.251814:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b757480 with x1830960573736576 ext(2650112->2654207) 00010000:00010000:3.0:1746140886.251818:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.251831:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.251837:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b757480 00000100:00100000:1.0:1746140886.254531:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.254580:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.254652:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573737088 00000100:00100000:3.0:1746140886.254660:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573737088 00002000:00100000:3.0:1746140886.254700:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2478080->2654207) req@ffff88009abdc700 x1830960573737088/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.254709:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc700 with x1830960573737088 ext(2478080->2654207) 00010000:00010000:3.0:1746140886.254718:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.254735:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.254741:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abdc700 00000100:00100000:0.0:1746140886.254745:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573736960 00000100:00100000:0.0:1746140886.254751:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573736960 00000100:00100000:3.0:1746140886.254773:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1801 00000100:00100000:0.0:1746140886.254774:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4713 00000100:00100000:0.0:1746140886.254779:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32671:x1830960573736960:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140886.254780:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573737088:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140886.254975:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32671:x1830960573736960:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 192us (391us total) trans 8589945037 rc 0/0 00000100:00100000:0.0:1746140886.254981:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4713 00000100:00100000:3.0:1746140886.257188:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573737088:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2395us (2653us total) trans 21474841414 rc 0/0 00000100:00100000:3.0:1746140886.257199:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1801 00002000:00100000:3.0:1746140886.257208:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2478080->2654207) req@ffff88009abdc700 x1830960573737088/t21474841414(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.257216:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc700 with x1830960573737088 ext(2478080->2654207) 00010000:00010000:3.0:1746140886.257226:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.257240:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.257340:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abdc700 00000100:00100000:0.0:1746140886.260636:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.260745:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573737216 00000100:00100000:2.0:1746140886.260755:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573737216 00010000:00010000:2.0:1746140886.260793:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.260832:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8795 00000100:00100000:2.0:1746140886.260839:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573737216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.260855:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.260876:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.260888:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.260908:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801354a9800/0x8156357b7fdba428 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->2654207) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ac expref: 29 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.260937:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.260939:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.260946:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.260953:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.260986:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.260996:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576058112:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.261093:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.262619:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576058112:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.262635:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.262669:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573737216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1830us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.262678:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8795 00000100:00100000:0.0:1746140886.268476:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.268567:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573737472 00000100:00100000:3.0:1746140886.268576:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573737472 00000100:00100000:3.0:1746140886.268623:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10742 00000100:00100000:3.0:1746140886.268629:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32674:x1830960573737472:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140886.268651:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.268666:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17ba expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.268883:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.268897:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.268907:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.268920:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.268926:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.268931:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269036:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269044:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269050:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140886.269058:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.269154:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269160:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269166:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269171:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.269175:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269180:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269190:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.269192:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.269196:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269200:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba43d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269234:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269239:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269243:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269246:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.269249:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269253:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269260:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388900) 00010000:00010000:3.0:1746140886.269262:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.269264:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269268:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba444 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.269331:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 275 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.269341:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 274 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.269346:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.269349:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.269351:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66600, rc 0) 00000100:00100000:3.0:1746140886.269407:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32674:x1830960573737472:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 777us (945us total) trans 8589945038 rc 0/0 00000100:00100000:3.0:1746140886.269413:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10742 00000100:00100000:0.0:1746140886.271051:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.271236:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573737728 00000100:00100000:2.0:1746140886.271244:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573737728 00000100:00100000:2.0:1746140886.271293:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4714 00000100:00100000:2.0:1746140886.271300:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32674:x1830960573737728:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140886.271516:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32674:x1830960573737728:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 216us (470us total) trans 8589945039 rc 0/0 00000100:00100000:2.0:1746140886.271522:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4714 00000100:00100000:0.0:1746140886.271739:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.271772:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573737984 00000100:00100000:3.0:1746140886.271775:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573737984 00000100:00100000:0.0:1746140886.271777:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746140886.271796:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b755c00 x1830960573737984/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.271802:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755c00 with x1830960573737984 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.271806:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b755c00 00000100:00100000:3.0:1746140886.271823:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573738240 00000100:00100000:3.0:1746140886.271824:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573738240 00002000:00100000:3.0:1746140886.271830:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009b754700 x1830960573738240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.271834:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754700 with x1830960573738240 ext(3145728->4194303) 00002000:00010000:3.0:1746140886.271835:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b754700 00000100:00100000:3.0:1746140886.271840:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8701 00000100:00100000:3.0:1746140886.271843:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573737984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140886.271849:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8702 00000100:00100000:2.0:1746140886.271856:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573738240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.272782:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.272813:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.272827:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573738496 00000100:00100000:0.0:1746140886.272830:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573738496 00000100:00100000:1.0:1746140886.272836:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573738624 00000100:00100000:1.0:1746140886.272840:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573738624 00002000:00100000:0.0:1746140886.272849:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b755500 x1830960573738496/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.272859:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009b754380 x1830960573738624/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140886.272862:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755500 with x1830960573738496 ext(2097152->3145727) 00002000:00010000:0.0:1746140886.272865:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b755500 00002000:00100000:1.0:1746140886.272866:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754380 with x1830960573738624 ext(3145728->4194303) 00002000:00010000:1.0:1746140886.272869:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754380 00000100:00100000:0.0:1746140886.272884:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8703 00000100:00100000:0.0:1746140886.272890:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573738496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.273269:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8704 00000100:00100000:1.0:1746140886.273276:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573738624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.274196:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.274238:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573738880 00000100:00100000:2.0:1746140886.274243:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573738880 00000100:00100000:2.0:1746140886.274281:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16998 00000100:00100000:2.0:1746140886.274287:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:32674:x1830960573738880:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.274297:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.274328:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17c1 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.274353:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 26 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.274362:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 41 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.274370:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 16 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.274376:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.274378:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.274381:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1724416->1818623] (req 1724416->1818623) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 41 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.274406:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 16 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.274419:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 16 pid: 4782 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.274431:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058240:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.274493:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 41 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.274505:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 41 pid: 8459 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.274513:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058368:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.274536:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 26 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.274543:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 26 pid: 8460 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.274550:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058496:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.274564:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.284763:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058240:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.284777:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058368:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.284785:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058496:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.284813:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1724416->1818623] (req 1724416->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 41 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.284832:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bc400, rc 0) 00000100:00100000:2.0:1746140886.284887:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:32674:x1830960573738880:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10600us (10693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.284894:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16998 00000100:00100000:3.0:1746140886.285042:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573737984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13190us (13295us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.285053:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8701 00002000:00100000:3.0:1746140886.285064:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b755c00 x1830960573737984/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.285087:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755c00 with x1830960573737984 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.285094:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b755c00 00000100:00100000:0.0:1746140886.289114:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.289160:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.289191:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.289344:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573739008 00000100:00100000:2.0:1746140886.289353:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573739008 00010000:00010000:2.0:1746140886.289391:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 17 pid: 4782 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.289417:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573739264 00000100:00100000:2.0:1746140886.289419:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573739264 00010000:00010000:2.0:1746140886.289428:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 41 pid: 8459 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.289440:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573739136 00000100:00100000:2.0:1746140886.289442:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573739136 00010000:00010000:2.0:1746140886.289454:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 28 pid: 8460 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.289456:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8796 00000100:00100000:1.0:1746140886.289466:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4908450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+17:1983:x1830960573739008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140886.289469:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8797 00000100:00100000:2.0:1746140886.289474:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573739264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.289479:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.289483:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.289501:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 41 pid: 8459 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.289506:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 17 pid: 4782 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140886.289513:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 41 pid: 8459 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.289545:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 17 pid: 4782 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.289569:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8b200/0x8156357b7fdba253 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b7 expref: 17 pid: 4782 timeout: 965 lvb_type: 1 00000100:00100000:0.0:1746140886.289578:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8798 00000100:00100000:0.0:1746140886.289587:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573739136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.289590:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140886.289594:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140886.289603:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 28 pid: 8460 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140886.289612:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 28 pid: 8460 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140886.289624:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f081a00/0x8156357b7fdba206 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1686 expref: 28 pid: 8460 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.289629:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4908450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573739008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.289635:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8796 00010000:00010000:0.0:1746140886.289637:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140886.289652:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573739136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140886.289657:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8798 00010000:00010000:2.0:1746140886.289877:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba2fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a170b expref: 41 pid: 8459 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140886.289901:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.289904:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.289911:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 40 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.289918:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 40 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.289949:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 40 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.289961:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576058624:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.290002:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.290214:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573738240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18357us (18435us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.290224:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8702 00002000:00100000:3.0:1746140886.290233:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009b754700 x1830960573738240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.290242:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754700 with x1830960573738240 ext(3145728->4194303) 00002000:00010000:3.0:1746140886.290246:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b754700 00000100:00100000:0.0:1746140886.290968:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573738496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18075us (18184us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140886.290975:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8703 00002000:00100000:0.0:1746140886.290981:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b755500 x1830960573738496/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140886.290989:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755500 with x1830960573738496 ext(2097152->3145727) 00002000:00010000:0.0:1746140886.290993:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b755500 00000100:00100000:0.0:1746140886.295243:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.295273:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573739520 00000100:00100000:0.0:1746140886.295281:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573739520 00002000:00100000:0.0:1746140886.295359:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1724416->1728511) req@ffff880099494000 x1830960573739520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140886.295370:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494000 with x1830960573739520 ext(1724416->1728511) 00002000:00010000:0.0:1746140886.295376:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099494000 00000100:00100000:0.0:1746140886.295409:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8705 00000100:00100000:0.0:1746140886.295416:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573739520:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140886.295587:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573739520:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 171us (355us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140886.295594:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8705 00002000:00100000:0.0:1746140886.295599:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1724416->1728511) req@ffff880099494000 x1830960573739520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140886.295607:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494000 with x1830960573739520 ext(1724416->1728511) 00002000:00010000:0.0:1746140886.295610:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099494000 00000100:00100000:2.0:1746140886.295749:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576058624:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.295767:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.295792:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573739264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6317us (6631us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.295799:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8797 00000100:00100000:1.0:1746140886.296200:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573738624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22924us (23385us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140886.296207:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8704 00002000:00100000:1.0:1746140886.296212:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009b754380 x1830960573738624/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.296219:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754380 with x1830960573738624 ext(3145728->4194303) 00002000:00010000:1.0:1746140886.296223:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754380 00000100:00100000:0.0:1746140886.299001:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.299633:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573739776 00000100:00100000:1.0:1746140886.299642:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573739776 00002000:00100000:1.0:1746140886.299689:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1814528->1818623) req@ffff880094af4e00 x1830960573739776/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.299699:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4e00 with x1830960573739776 ext(1814528->1818623) 00002000:00010000:1.0:1746140886.299704:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094af4e00 00000100:00100000:1.0:1746140886.299738:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8706 00000100:00100000:1.0:1746140886.299745:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573739776:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140886.299936:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573739776:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 191us (943us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140886.299944:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8706 00002000:00100000:1.0:1746140886.299950:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1814528->1818623) req@ffff880094af4e00 x1830960573739776/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.299957:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4e00 with x1830960573739776 ext(1814528->1818623) 00002000:00010000:1.0:1746140886.299961:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094af4e00 00000100:00100000:0.0:1746140886.301641:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.301862:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573739904 00000100:00100000:2.0:1746140886.301871:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573739904 00000100:00100000:2.0:1746140886.301925:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16999 00000100:00100000:2.0:1746140886.301932:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573739904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.301948:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.301965:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356bcc00/0x8156357b7fdba460 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17c8 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.302015:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058752:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.302106:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746140886.306549:0:24958:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime: 1746140886 -> 1746140887 00002000:00010000:2.0:1746140886.306556:0:24958:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime: 1746140886 -> 1746140887 00000100:00100000:2.0:1746140886.306580:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058752:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.306611:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356bcc00/0x8156357b7fdba460 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c8 expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.306625:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356bcc00/0x8156357b7fdba460 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c8 expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.306960:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bcc00, rc 0) 00000100:00100000:2.0:1746140886.307010:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573739904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5077us (5376us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.307018:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16999 00000100:00100000:0.0:1746140886.310011:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.310102:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573740160 00000100:00100000:1.0:1746140886.310112:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573740160 00002000:00100000:1.0:1746140886.310154:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094af7480 x1830960573740160/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.310164:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af7480 with x1830960573740160 ext(4194304->4886527) 00002000:00010000:1.0:1746140886.310169:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af7480 00000100:00100000:1.0:1746140886.310199:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8707 00000100:00100000:1.0:1746140886.310206:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573740160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.317896:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573740160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7679us (7883us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140886.317909:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8707 00002000:00100000:1.0:1746140886.317920:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094af7480 x1830960573740160/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.317929:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af7480 with x1830960573740160 ext(4194304->4886527) 00002000:00010000:1.0:1746140886.317935:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af7480 00000100:00100000:0.0:1746140886.324040:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.324149:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573740288 00000100:00100000:2.0:1746140886.324159:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573740288 00000100:00100000:2.0:1746140886.324222:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17000 00000100:00100000:2.0:1746140886.324229:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573740288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.324247:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.324265:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356bc600/0x8156357b7fdba467 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17cf expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.324353:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058880:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.324448:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.324503:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.324561:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573740544 00000100:00100000:3.0:1746140886.324565:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573740544 00000100:00100000:3.0:1746140886.324607:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10743 00000100:00100000:3.0:1746140886.324613:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32678:x1830960573740544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.324627:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.324639:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba46e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17d6 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.324739:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.324751:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.324761:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.324772:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.324777:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.324784:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.324880:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba483 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.324888:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba483 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.324893:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba483 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140886.325652:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:2.0:1746140886.325706:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576058880:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.325731:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356bc600/0x8156357b7fdba467 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17cf expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.325740:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140886.325742:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356bc600/0x8156357b7fdba467 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17cf expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.325753:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325759:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140886.325761:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bc600, rc 0) 00010000:00010000:3.0:1746140886.325764:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec67a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.325768:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325775:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325785:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.325787:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746140886.325790:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573740288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1561us (1761us total) trans 0 rc 301/301 00010000:00010000:3.0:1746140886.325791:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140886.325796:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17000 00010000:00010000:3.0:1746140886.325799:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325812:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325816:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325820:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325825:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.325827:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325831:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325837:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388900) 00010000:00010000:3.0:1746140886.325838:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.325840:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325844:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba47c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.325879:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba46e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17d6 expref: 278 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.325888:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba483 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17d6 expref: 277 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.325898:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.325900:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.325902:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67c00, rc 0) 00000100:00100000:3.0:1746140886.325934:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:32678:x1830960573740544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1321us (1431us total) trans 8589945040 rc 0/0 00000100:00100000:3.0:1746140886.325940:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10743 00000100:00100000:0.0:1746140886.327627:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.327662:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.327688:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.327709:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.327717:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573740800 00000100:00100000:3.0:1746140886.327724:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573740800 00000100:00100000:2.0:1746140886.327779:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573740672 00000100:00100000:2.0:1746140886.327783:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573740672 00000100:00100000:2.0:1746140886.327813:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 773 00000100:00100000:2.0:1746140886.327820:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:1984:x1830960573740672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.327835:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.327854:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba483 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17d6 expref: 277 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.327867:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140886.327871:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.327915:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:1984:x1830960573740672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.327921:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 773 00000100:00100000:3.0:1746140886.327973:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573741056 00000100:00100000:3.0:1746140886.327976:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573741056 00000100:00100000:2.0:1746140886.328207:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573740928 00000100:00100000:2.0:1746140886.328211:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573740928 00000100:00100000:2.0:1746140886.328457:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17001 00000100:00100000:2.0:1746140886.328465:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573740800:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140886.328470:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17002 00000100:00100000:0.0:1746140886.328475:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17003 00000100:00100000:3.0:1746140886.328476:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1982:x1830960573741056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.328480:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140886.328481:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573740928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.328484:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140886.328488:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.328493:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17eb expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.328493:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17dd expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.328497:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f785e00/0x8156357b7fdba49f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17e4 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.328510:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.328511:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.328511:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.328513:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.328519:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.328519:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.328530:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.328530:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140886.328536:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576059008:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140886.328538:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66e00, rc 0) 00010000:00010000:2.0:1746140886.328538:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bd200, rc 0) 00000100:00100000:3.0:1746140886.328560:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573741056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 84us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.328560:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1983:x1830960573740800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 96us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.328566:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17001 00000100:00100000:3.0:1746140886.328574:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17002 00000100:00100000:0.0:1746140886.328574:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.330253:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576059008:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.330276:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f785e00/0x8156357b7fdba49f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17e4 expref: 24 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.330287:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f785e00/0x8156357b7fdba49f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17e4 expref: 24 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.330296:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f785e00, rc 0) 00000100:00100000:2.0:1746140886.330354:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573740928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1873us (2643us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.330361:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17003 00000100:00100000:0.0:1746140886.336048:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.336133:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573741312 00000100:00100000:2.0:1746140886.336144:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573741312 00000100:00100000:2.0:1746140886.336201:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4715 00000100:00100000:2.0:1746140886.336209:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32669:x1830960573741312:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140886.336641:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32669:x1830960573741312:12345-192.168.204.16@tcp:35:cat.0 Request processed in 432us (604us total) trans 8589945041 rc 0/0 00000100:00100000:2.0:1746140886.336647:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4715 00000100:00100000:0.0:1746140886.340140:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.340182:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.340472:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573742080 00000100:00100000:0.0:1746140886.340475:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.340481:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573742080 00000100:00100000:0.0:1746140886.340492:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573742336 00000100:00100000:0.0:1746140886.340494:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573742336 00002000:00100000:3.0:1746140886.340524:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800a6bad180 x1830960573742080/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 504/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140886.340524:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a6bac000 x1830960573742336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.340534:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bad180 with x1830960573742080 ext(1048576->2097151) 00002000:00100000:0.0:1746140886.340534:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bac000 with x1830960573742336 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.340539:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6bad180 00002000:00010000:0.0:1746140886.340539:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6bac000 00000100:00100000:0.0:1746140886.340569:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573741696 00000100:00100000:0.0:1746140886.340571:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573741696 00000100:00100000:3.0:1746140886.340580:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8708 00002000:00100000:0.0:1746140886.340580:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f51b480 x1830960573741696/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140886.340586:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573742336:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:0.0:1746140886.340587:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51b480 with x1830960573741696 ext(0->1048575) 00002000:00010000:0.0:1746140886.340590:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51b480 00000100:00100000:0.0:1746140886.340600:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8709 00000100:00100000:0.0:1746140886.340604:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573742080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.340835:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8710 00000100:00100000:1.0:1746140886.340842:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573741696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.341935:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.342293:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573741952 00000100:00100000:2.0:1746140886.342299:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573741952 00002000:00100000:2.0:1746140886.342340:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f51bb80 x1830960573741952/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.342348:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51bb80 with x1830960573741952 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.342353:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f51bb80 00000100:00100000:2.0:1746140886.342375:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8711 00000100:00100000:2.0:1746140886.342381:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573741952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140886.347523:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573742080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6905us (7381us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746140886.347534:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8709 00002000:00100000:2.0:1746140886.347544:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800a6bad180 x1830960573742080/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 504/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.347551:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bad180 with x1830960573742080 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.347557:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6bad180 00000100:00100000:1.0:1746140886.352789:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573741696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11936us (12302us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140886.352800:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8710 00002000:00100000:1.0:1746140886.352811:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f51b480 x1830960573741696/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.352830:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51b480 with x1830960573741696 ext(0->1048575) 00002000:00010000:1.0:1746140886.352836:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51b480 00000100:00100000:3.0:1746140886.353820:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573742336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13230us (13634us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.353829:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8708 00002000:00100000:3.0:1746140886.353835:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a6bac000 x1830960573742336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.353843:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bac000 with x1830960573742336 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.353847:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6bac000 00000100:00100000:2.0:1746140886.355120:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573741952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12733us (13184us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140886.355128:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8711 00002000:00100000:2.0:1746140886.355137:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f51bb80 x1830960573741952/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.355145:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51bb80 with x1830960573741952 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.355149:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f51bb80 00000100:00100000:2.0:1746140886.365008:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.365062:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.365115:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573742592 00000100:00100000:3.0:1746140886.365125:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573742592 00000100:00100000:0.0:1746140886.365133:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573742848 00000100:00100000:0.0:1746140886.365138:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573742848 00002000:00100000:3.0:1746140886.365170:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880129e0d880 x1830960573742592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140886.365170:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a55e1180 x1830960573742848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.365181:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0d880 with x1830960573742592 ext(2097152->3145727) 00002000:00100000:0.0:1746140886.365181:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e1180 with x1830960573742848 ext(3145728->4194303) 00002000:00010000:3.0:1746140886.365186:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0d880 00002000:00010000:0.0:1746140886.365187:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55e1180 00000100:00100000:3.0:1746140886.365220:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8712 00000100:00100000:3.0:1746140886.365228:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573742592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.365621:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8713 00000100:00100000:0.0:1746140886.365628:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573742848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140886.375422:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573742848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9784us (10349us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140886.375434:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8713 00002000:00100000:2.0:1746140886.375446:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a55e1180 x1830960573742848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.375457:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55e1180 with x1830960573742848 ext(3145728->4194303) 00002000:00010000:2.0:1746140886.375462:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55e1180 00000100:00100000:3.0:1746140886.376584:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573742592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11353us (11582us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.376591:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8712 00002000:00100000:3.0:1746140886.376597:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880129e0d880 x1830960573742592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.376605:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0d880 with x1830960573742592 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.376608:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0d880 00000100:00100000:0.0:1746140886.384719:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.384842:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573743104 00000100:00100000:3.0:1746140886.384852:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573743104 00002000:00100000:3.0:1746140886.384895:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f518a80 x1830960573743104/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.384905:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518a80 with x1830960573743104 ext(4194304->4886527) 00002000:00010000:3.0:1746140886.384910:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f518a80 00000100:00100000:3.0:1746140886.385057:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8714 00000100:00100000:3.0:1746140886.385084:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573743104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140886.390895:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573743104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5819us (6178us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140886.391116:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8714 00002000:00100000:3.0:1746140886.391129:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f518a80 x1830960573743104/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.391138:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518a80 with x1830960573743104 ext(4194304->4886527) 00002000:00010000:3.0:1746140886.391143:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f518a80 00000100:00100000:0.0:1746140886.397724:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.397843:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573743360 00000100:00100000:2.0:1746140886.397855:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573743360 00000100:00100000:2.0:1746140886.397909:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4716 00000100:00100000:2.0:1746140886.397917:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32678:x1830960573743360:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140886.398412:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:32678:x1830960573743360:12345-192.168.204.16@tcp:35:cat.0 Request processed in 495us (695us total) trans 8589945042 rc 0/0 00000100:00100000:2.0:1746140886.398419:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4716 00000100:00100000:0.0:1746140886.415833:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.415957:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573743616 00000100:00100000:3.0:1746140886.415974:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573743616 00000100:00100000:3.0:1746140886.416043:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10744 00000100:00100000:3.0:1746140886.416054:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:32682:x1830960573743616:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140886.416091:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.416109:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba4a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17f2 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.416889:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.416901:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.416911:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.416922:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.416927:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.416932:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417022:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba4bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417030:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba4bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417035:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba4bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140886.417045:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.417130:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417136:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417141:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417147:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.417150:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417156:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417165:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.417168:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.417171:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417176:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdba4ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417191:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417195:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417199:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417206:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec67400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.417208:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417212:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417217:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388100) 00010000:00010000:3.0:1746140886.417219:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.417220:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417224:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67400/0x8156357b7fdba4b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.417263:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdba4a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f2 expref: 280 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.417273:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba4bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f2 expref: 279 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.417278:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.417280:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.417282:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67a00, rc 0) 00000100:00100000:3.0:1746140886.417355:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:32682:x1830960573743616:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1301us (1532us total) trans 8589945043 rc 0/0 00000100:00100000:3.0:1746140886.417363:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10744 00000100:00100000:0.0:1746140886.418816:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.418858:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.418877:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573744000 00000100:00100000:2.0:1746140886.418887:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573744000 00000100:00100000:2.0:1746140886.418934:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4717 00000100:00100000:2.0:1746140886.418942:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:32682:x1830960573744000:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140886.419155:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:32682:x1830960573744000:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 213us (345us total) trans 8589945044 rc 0/0 00000100:00100000:3.0:1746140886.419343:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573743744 00000100:00100000:3.0:1746140886.419354:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573743744 00000100:00100000:3.0:1746140886.419407:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 774 00000100:00100000:3.0:1746140886.419413:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:1984:x1830960573743744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.419424:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.419444:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67a00/0x8156357b7fdba4bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f2 expref: 281 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.419459:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4717 00010000:00010000:3.0:1746140886.419460:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.419464:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.419555:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:1984:x1830960573743744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 141us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.419562:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 774 00000100:00100000:0.0:1746140886.464631:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.464912:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573744128 00000100:00100000:2.0:1746140886.464923:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573744128 00000100:00100000:2.0:1746140886.465379:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17004 00000100:00100000:2.0:1746140886.465389:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:32682:x1830960573744128:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.465409:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.465428:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a17f9 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.465463:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.465472:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.465479:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.465481:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.465484:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 38 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.465517:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.465531:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.465544:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576059136:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.465658:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.465666:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.465673:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576059264:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.465691:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.468405:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576059136:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.468522:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576059264:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.468558:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 38 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.468576:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bda00, rc 0) 00000100:00100000:2.0:1746140886.468698:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:32682:x1830960573744128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3309us (4078us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.468707:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17004 00000100:00100000:0.0:1746140886.469620:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.469720:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573744256 00000100:00100000:3.0:1746140886.469729:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573744256 00010000:00010000:3.0:1746140886.469770:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140886.469811:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8799 00000100:00100000:3.0:1746140886.469818:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573744256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.469830:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.469855:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 965 lvb_type: 1 00010000:00010000:3.0:1746140886.469866:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 965 lvb_type: 1 00010000:00010000:3.0:1746140886.469889:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356bd200/0x8156357b7fdba491 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17dd expref: 38 pid: 32377 timeout: 965 lvb_type: 1 00010000:00010000:3.0:1746140886.469921:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.469970:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573744256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.469975:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8799 00000100:00100000:1.0:1746140886.470476:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.470510:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573744384 00000100:00100000:2.0:1746140886.470515:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573744384 00010000:00010000:2.0:1746140886.470533:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 28 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.470559:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8800 00000100:00100000:2.0:1746140886.470565:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573744384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.470573:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.470587:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 28 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.470596:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 28 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.470610:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f101200/0x8156357b7fdba3fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a179e expref: 28 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.470632:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.470634:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.470640:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.470649:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.470682:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.470694:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576059392:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.470765:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.472081:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576059392:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.472102:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.472131:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573744384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1566us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.472139:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8800 00000100:00100000:0.0:1746140886.472330:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.472432:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573744640 00000100:00100000:3.0:1746140886.472437:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573744640 00002000:00100000:3.0:1746140886.472469:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1896448->1900543) req@ffff880094453100 x1830960573744640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.472478:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094453100 with x1830960573744640 ext(1896448->1900543) 00002000:00010000:3.0:1746140886.472482:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094453100 00000100:00100000:3.0:1746140886.472510:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8715 00000100:00100000:3.0:1746140886.472515:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573744640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140886.472950:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573744640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 433us (644us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.472956:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8715 00002000:00100000:3.0:1746140886.472961:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1896448->1900543) req@ffff880094453100 x1830960573744640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.472968:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094453100 with x1830960573744640 ext(1896448->1900543) 00002000:00010000:3.0:1746140886.472971:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094453100 00000100:00100000:0.0:1746140886.476181:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.476264:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573744768 00000100:00100000:2.0:1746140886.476273:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573744768 00000100:00100000:2.0:1746140886.476353:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17005 00000100:00100000:2.0:1746140886.476366:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:32682:x1830960573744768:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.476383:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.476400:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1800 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.476427:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.476435:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.476441:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.476442:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.476445:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2506751] (req 2097152->2506751) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 38 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140886.476464:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140886.476474:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.476485:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.476497:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576059520:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.476531:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573745024 00000100:00100000:3.0:1746140886.476535:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573745024 00000100:00100000:3.0:1746140886.476560:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10745 00000100:00100000:3.0:1746140886.476565:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32684:x1830960573745024:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.476572:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.476579:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 26 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.476580:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140886.476586:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576059648:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140886.476591:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba4d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1807 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.476604:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409b780 going to sleep for 11 seconds 00010000:00010000:3.0:1746140886.476761:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.476772:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.476781:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.476793:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.476798:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.476803:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.476910:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba4ec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.476918:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba4ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.476924:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba4ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140886.476933:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.477032:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477043:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477048:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477053:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec67c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.477057:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477063:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477086:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.477089:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.477093:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477098:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdba4de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477119:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477125:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477129:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477134:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec66a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.477136:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477144:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477149:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388800) 00010000:00010000:3.0:1746140886.477151:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.477153:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477157:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdba4e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140886.477196:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba4d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1807 expref: 16 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.477207:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba4ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1807 expref: 15 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.477213:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.477215:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.477217:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66000, rc 0) 00000100:00100000:3.0:1746140886.477741:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32684:x1830960573745024:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1174us (1275us total) trans 8589945045 rc 0/0 00000100:00100000:3.0:1746140886.477748:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10745 00000100:00100000:3.0:1746140886.478016:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576059520:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.478026:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576059648:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140886.478046:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2506751] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 38 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.478062:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bc600, rc 0) 00000100:00100000:3.0:1746140886.478107:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:32682:x1830960573744768:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1747us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.478113:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17005 00000100:00100000:2.0:1746140886.480404:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.480512:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573745152 00000100:00100000:0.0:1746140886.480523:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573745152 00000100:00100000:0.0:1746140886.480581:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 775 00000100:00100000:0.0:1746140886.480588:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4908050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573745152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140886.480604:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140886.480628:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66000/0x8156357b7fdba4ec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1807 expref: 15 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.480893:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140886.480898:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140886.481235:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4908050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960573745152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 647us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140886.481243:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 775 00000100:00100000:3.0:1746140886.481409:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.481528:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573745280 00000100:00100000:0.0:1746140886.481531:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573745280 00010000:00010000:0.0:1746140886.481546:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:0.0:1746140886.481570:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8801 00000100:00100000:0.0:1746140886.481574:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1983:x1830960573745280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140886.481582:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140886.481614:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:0.0:1746140886.481624:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:0.0:1746140886.481647:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec66e00/0x8156357b7fdba498 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17eb expref: 38 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:0.0:1746140886.481658:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140886.481684:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573745280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140886.481689:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8801 00000100:00100000:0.0:1746140886.483767:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.483934:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573745408 00000100:00100000:2.0:1746140886.483943:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573745408 00010000:00010000:2.0:1746140886.483974:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.484026:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8802 00000100:00100000:2.0:1746140886.484035:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573745408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.484049:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.484085:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.484095:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.484117:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc200/0x8156357b7fdba42f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17b3 expref: 27 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.484131:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.484133:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.484140:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.484148:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.484183:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.484197:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576059776:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.484292:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.488909:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.489007:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576059776:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.489028:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.489082:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573745408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5049us (5325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.489092:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8802 00000100:00100000:3.0:1746140886.489442:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573745664 00000100:00100000:3.0:1746140886.489452:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573745664 00002000:00100000:3.0:1746140886.489502:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2502656->2506751) req@ffff880099497100 x1830960573745664/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.489513:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497100 with x1830960573745664 ext(2502656->2506751) 00002000:00010000:3.0:1746140886.489519:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497100 00000100:00100000:3.0:1746140886.490732:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8716 00000100:00100000:3.0:1746140886.490746:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573745664:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140886.490976:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573745664:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 234us (2078us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.490982:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8716 00002000:00100000:3.0:1746140886.490988:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2502656->2506751) req@ffff880099497100 x1830960573745664/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.490999:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497100 with x1830960573745664 ext(2502656->2506751) 00002000:00010000:3.0:1746140886.491003:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497100 00000100:00100000:0.0:1746140886.560655:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.560704:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.560748:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573746048 00000100:00100000:0.0:1746140886.560756:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573746048 00000100:00100000:3.0:1746140886.561204:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573745792 00000100:00100000:3.0:1746140886.561208:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573745792 00000100:00100000:3.0:1746140886.561256:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17006 00000100:00100000:3.0:1746140886.561263:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+23:32684:x1830960573745792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140886.561280:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.561297:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a180e expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.561355:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.561363:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 39 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.561369:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 24 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.561374:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.561376:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.561379:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1499136->2097151] (req 1499136->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.561409:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 24 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.561421:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 24 pid: 32376 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140886.561433:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576059904:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140886.561452:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10746 00000100:00100000:0.0:1746140886.561458:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32688:x1830960573746048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140886.561470:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140886.561482:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfc00/0x8156357b7fdba501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1815 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.561527:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 39 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.561536:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 39 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140886.561543:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576060032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140886.561567:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.561575:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 15 pid: 8458 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140886.561583:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576060160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.561597:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746140886.561805:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.561816:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.561826:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.561838:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.561843:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.561848:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.561950:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba516 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.561957:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba516 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.561963:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba516 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140886.561971:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140886.562052:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562058:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562063:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562081:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddfe00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140886.562085:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562091:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562101:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140886.562103:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140886.562107:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562111:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562170:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562175:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562179:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562187:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddee00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140886.562189:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562194:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562200:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130d2f300) 00010000:00010000:0.0:1746140886.562202:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140886.562204:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562207:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba50f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140886.562241:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfc00/0x8156357b7fdba501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1815 expref: 17 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.562251:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba516 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1815 expref: 16 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.562256:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140886.562257:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140886.562260:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ddec00, rc 0) 00000100:00100000:0.0:1746140886.562287:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32688:x1830960573746048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 829us (1582us total) trans 8589945046 rc 0/0 00000100:00100000:0.0:1746140886.562293:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10746 00000100:00100000:1.0:1746140886.565695:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.565885:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573746304 00000100:00100000:0.0:1746140886.565894:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573746304 00000100:00100000:2.0:1746140886.565926:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.566595:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.566613:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.566630:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573746816 00000100:00100000:2.0:1746140886.566634:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573746816 00010000:00010000:2.0:1746140886.566661:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 26 pid: 32376 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.566689:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8803 00000100:00100000:2.0:1746140886.566695:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573746816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.566710:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.566739:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 26 pid: 32376 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140886.566749:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 26 pid: 32376 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140886.566752:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573746432 00000100:00100000:3.0:1746140886.566756:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573746432 00010000:00010000:2.0:1746140886.566774:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.566778:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573746688 00000100:00100000:3.0:1746140886.566779:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573746688 00000100:00100000:3.0:1746140886.566793:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17007 00000100:00100000:3.0:1746140886.566799:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573746304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.566812:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.566825:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba524 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a181c expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.566841:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.566848:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba524 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a181c expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.566864:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5216c00/0x8156357b7fdba524 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a181c expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140886.566870:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17008 00000100:00100000:0.0:1746140886.566877:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573746432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.566878:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5216c00, rc 0) 00010000:00010000:0.0:1746140886.566884:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140886.566891:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddea00/0x8156357b7fdba52b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1823 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140886.566912:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573746304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 113us (1230us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140886.566918:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17007 00000100:00100000:0.0:1746140886.566932:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576060288:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140886.566934:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17009 00000100:00100000:3.0:1746140886.566951:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1983:x1830960573746688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.566958:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.566967:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba532 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1831 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140886.566984:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.566993:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576060416:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140886.567015:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00010000:00010000:3.0:1746140886.567042:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdba2c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16e1 expref: 27 pid: 32376 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140886.567050:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576059904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.567059:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576060032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.567077:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576060160:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140886.567100:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1499136->2097151] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.567111:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67400, rc 0) 00000100:00100000:3.0:1746140886.567126:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32684:x1830960573745792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5864us (6482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.567131:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17006 00000100:00100000:2.0:1746140886.567219:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573746816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 524us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.567226:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8803 00000100:00100000:2.0:1746140886.567589:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.567618:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.567629:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573747072 00000100:00100000:2.0:1746140886.567631:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573747072 00010000:00010000:2.0:1746140886.567643:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 40 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.567657:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573746176 00000100:00100000:2.0:1746140886.567659:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573746176 00000100:00100000:3.0:1746140886.567665:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8804 00010000:00010000:2.0:1746140886.567668:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 16 pid: 8458 timeout: 965 lvb_type: 1 00000100:00100000:3.0:1746140886.567672:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573747072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140886.567688:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8805 00000100:00100000:2.0:1746140886.567693:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573746176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.567696:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.567699:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.567708:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 40 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140886.567708:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 16 pid: 8458 timeout: 965 lvb_type: 1 00010000:00010000:3.0:1746140886.567719:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 40 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:1.0:1746140886.567785:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.567819:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.567894:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573746944 00000100:00100000:0.0:1746140886.567897:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573746944 00000100:00100000:0.0:1746140886.567923:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 776 00000100:00100000:0.0:1746140886.567929:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573746944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140886.567937:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140886.567951:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba516 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1815 expref: 16 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.567963:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140886.567966:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140886.567981:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573746944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140886.567986:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 776 00000100:00100000:1.0:1746140886.568043:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140886.568132:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 16 pid: 8458 timeout: 965 lvb_type: 1 00010000:00010000:3.0:1746140886.568150:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f800/0x8156357b7fdba2f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1704 expref: 40 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:0.0:1746140886.568164:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573747200 00000100:00100000:0.0:1746140886.568167:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573747200 00000100:00080000:0.0:1746140886.568188:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140886.568212:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10747 00000100:00100000:0.0:1746140886.568217:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:32689:x1830960573747200:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140886.568230:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140886.568239:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1838 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.568292:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a37800/0x8156357b7fdba23e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16b0 expref: 16 pid: 8458 timeout: 965 lvb_type: 1 00010000:00010000:3.0:1746140886.568301:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.568318:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.568324:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.568332:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140886.568349:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573746560 00000100:00100000:3.0:1746140886.568353:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573746560 00000100:00100000:3.0:1746140886.568376:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17010 00010000:00010000:2.0:1746140886.568378:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.568398:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573746176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 704us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.568404:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8805 00010000:00010000:2.0:1746140886.568472:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140886.568474:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573746560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.568482:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140886.568482:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576060544:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140886.568493:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940cb800/0x8156357b7fdba540 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a182a expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.568511:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.568516:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576060672:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140886.568538:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746140886.568690:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140886.568701:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140886.568709:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140886.568721:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140886.568727:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140886.568732:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140886.568931:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140886.568940:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 278 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.568950:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140886.568967:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 278 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.568976:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 278 pid: 27790 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.568984:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576060800:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140886.569005:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435ec00 going to sleep for 11 seconds 00002000:00010000:3.0:1746140886.569387:0:20960:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime: 1746140886 -> 1746140887 00002000:00010000:3.0:1746140886.569391:0:20960:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140886 -> 1746140887 00002000:00010000:3.0:1746140886.569393:0:20960:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime: 1746140886 -> 1746140887 00002000:00010000:2.0:1746140886.569393:0:8459:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140886 -> 1746140887 00000100:00100000:3.0:1746140886.569406:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576060416:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.569406:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576060288:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140886.569423:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba532 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1831 expref: 29 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.569423:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddea00/0x8156357b7fdba52b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1823 expref: 24 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.569431:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddea00/0x8156357b7fdba52b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1823 expref: 24 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.569433:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5217600/0x8156357b7fdba532 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1831 expref: 29 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.569438:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ddea00, rc 0) 00010000:00010000:3.0:1746140886.569440:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5217600, rc 0) 00000100:00100000:3.0:1746140886.569459:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573746688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2508us (2866us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.569459:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573746432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2583us (3534us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140886.569465:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17009 00000100:00100000:2.0:1746140886.569473:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17008 00000100:00100000:0.0:1746140886.572255:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.572302:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.572364:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573747456 00000100:00100000:0.0:1746140886.572371:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573747456 00000100:00100000:0.0:1746140886.572408:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4718 00000100:00100000:0.0:1746140886.572414:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:27404:x1830960573747456:12345-192.168.204.16@tcp:35:ldlm_bl.0 00002000:00010000:3.0:1746140886.572481:0:9872:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140886 -> 1746140887 00002000:00010000:3.0:1746140886.572486:0:9872:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140886 -> 1746140887 00002000:00010000:3.0:1746140886.572488:0:9872:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140886 -> 1746140887 00000100:00100000:3.0:1746140886.572506:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576060672:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140886.572537:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940cb800/0x8156357b7fdba540 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a182a expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.572556:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940cb800/0x8156357b7fdba540 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a182a expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.572567:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cb800, rc 0) 00000100:00100000:3.0:1746140886.572619:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573746560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4146us (4798us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140886.572626:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17010 00000100:00100000:3.0:1746140886.572652:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573747712 00000100:00100000:3.0:1746140886.572655:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573747712 00002000:00100000:3.0:1746140886.572677:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1499136->1503231) req@ffff8800a513ed80 x1830960573747712/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.572686:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ed80 with x1830960573747712 ext(1499136->1503231) 00002000:00010000:3.0:1746140886.572690:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513ed80 00000100:00100000:3.0:1746140886.572704:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8717 00000100:00100000:3.0:1746140886.572709:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573747712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140886.572712:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576060544:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.572724:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.572743:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573747072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5072us (5154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.572751:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8804 00000100:00100000:1.0:1746140886.572797:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576060800:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140886.572814:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140886.572847:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573747712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 137us (545us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.572854:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8717 00002000:00100000:3.0:1746140886.572858:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1499136->1503231) req@ffff8800a513ed80 x1830960573747712/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.572865:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ed80 with x1830960573747712 ext(1499136->1503231) 00002000:00010000:3.0:1746140886.572868:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513ed80 00000100:00100000:1.0:1746140886.573240:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:27404:x1830960573747456:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 825us (992us total) trans 8589945047 rc 0/0 00000100:00100000:1.0:1746140886.573247:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4718 00000100:00100000:0.0:1746140886.574814:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.574910:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573747840 00000100:00100000:2.0:1746140886.574916:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573747840 00010000:00010000:2.0:1746140886.574947:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 280 pid: 27790 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.575169:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8806 00000100:00100000:2.0:1746140886.575176:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:1984:x1830960573747840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.575189:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.575195:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 280 pid: 27790 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.575206:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 280 pid: 27790 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.575226:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67000/0x8156357b7fdba3b8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a177b expref: 280 pid: 27790 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.575239:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140886.575243:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575253:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575259:0:9847:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575280:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140886.575293:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575299:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140886.575360:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140886.575364:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746140886.575379:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575388:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575612:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575619:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575625:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575630:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f101000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140886.575634:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575644:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575652:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140886.575654:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140886.575657:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575661:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101000/0x8156357b7fdba547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575670:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575675:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575680:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575684:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f101a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140886.575686:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575690:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575695:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4d400) 00010000:00010000:2.0:1746140886.575697:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140886.575699:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575703:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101a00/0x8156357b7fdba54e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.575731:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.575743:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.575749:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140886.575750:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140886.575752:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f101800, rc 0) 00000100:00100000:2.0:1746140886.575927:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32689:x1830960573747200:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 7709us (7882us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.575934:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10747 00000100:00100000:2.0:1746140886.576039:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:1984:x1830960573747840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 862us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.576044:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8806 00000100:00100000:0.0:1746140886.577006:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.577064:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573748096 00000100:00100000:3.0:1746140886.577081:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573748096 00002000:00100000:3.0:1746140886.577115:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1499135) req@ffff8800a513c700 x1830960573748096/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.577125:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513c700 with x1830960573748096 ext(1048576->1499135) 00002000:00010000:3.0:1746140886.577135:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513c700 00000100:00100000:3.0:1746140886.577392:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8718 00000100:00100000:3.0:1746140886.577402:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1982:x1830960573748096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.577746:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.577858:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573748224 00000100:00100000:2.0:1746140886.577863:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573748224 00000100:00100000:2.0:1746140886.577893:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17011 00000100:00100000:2.0:1746140886.577899:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+25:32684:x1830960573748224:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.577907:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.577921:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a183f expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.577941:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.577952:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.577953:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.577956:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->1228799] (req 1048576->1228799) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.577983:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.577993:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 38 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.578003:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576060928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.578145:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.580202:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.580264:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.580278:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.580323:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.580432:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573748352 00000100:00100000:0.0:1746140886.580439:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573748352 00000100:00100000:2.0:1746140886.580462:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573748480 00000100:00100000:2.0:1746140886.580471:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573748480 00000100:00100000:0.0:1746140886.580477:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573748608 00000100:00100000:0.0:1746140886.580480:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573748608 00000100:00100000:0.0:1746140886.580494:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573748736 00000100:00100000:0.0:1746140886.580496:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573748736 00000100:00100000:2.0:1746140886.580513:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17012 00000100:00100000:2.0:1746140886.580518:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573748352:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140886.580534:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.580547:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356bd200/0x8156357b7fdba563 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1846 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.580589:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576061056:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.580650:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.580851:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17013 00000100:00100000:0.0:1746140886.580859:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573748608:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:3.0:1746140886.580909:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17014 00000100:00100000:2.0:1746140886.580918:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17015 00010000:00010000:0.0:1746140886.580919:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140886.580920:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573748480:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746140886.580923:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573748736:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140886.580928:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.580928:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140886.580933:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba56a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1854 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.580936:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940cbe00/0x8156357b7fdba571 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a184d expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.580936:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356bc800/0x8156357b7fdba578 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a185b expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.580954:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576061184:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140886.580968:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576061312:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.580968:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.580968:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576061440:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.581009:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576060928:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.581012:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.581021:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746140886.581025:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->1228799] (req 1048576->1228799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.581032:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bde00, rc 0) 00000100:00100000:2.0:1746140886.581049:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32684:x1830960573748224:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3152us (3304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.581053:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17011 00000100:00100000:2.0:1746140886.581293:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1982:x1830960573748096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3896us (4289us total) trans 0 rc 450560/450560 00000100:00100000:2.0:1746140886.581299:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8718 00002000:00100000:2.0:1746140886.581330:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1499135) req@ffff8800a513c700 x1830960573748096/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 450560/450560 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.581335:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513c700 with x1830960573748096 ext(1048576->1499135) 00002000:00010000:2.0:1746140886.581338:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513c700 00000100:00100000:0.0:1746140886.581513:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.582131:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573748864 00000100:00100000:2.0:1746140886.582136:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573748864 00002000:00100000:2.0:1746140886.582161:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1724416->1818623) req@ffff8800a51cd880 x1830960573748864/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.582178:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cd880 with x1830960573748864 ext(1724416->1818623) 00010000:00010000:2.0:1746140886.582184:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 39 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.582195:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 39 pid: 24958 timeout: 965 lvb_type: 0 00002000:00010000:2.0:1746140886.582201:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a51cd880 00002000:00010000:3.0:1746140886.582221:0:8459:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime: 1746140886 -> 1746140887 00002000:00010000:3.0:1746140886.582225:0:8459:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime: 1746140886 -> 1746140887 00002000:00010000:3.0:1746140886.582227:0:8459:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime: 1746140886 -> 1746140887 00000100:00100000:2.0:1746140886.582228:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1802 00000100:00100000:2.0:1746140886.582234:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1982:x1830960573748864:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140886.582247:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576061056:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140886.582271:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356bd200/0x8156357b7fdba563 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1846 expref: 18 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.582283:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356bd200/0x8156357b7fdba563 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1846 expref: 18 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.582295:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bd200, rc 0) 00000100:00100000:3.0:1746140886.582358:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573748352:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1838us (2162us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140886.582364:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17012 00000100:00100000:2.0:1746140886.582750:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576061184:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.582770:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356bc800/0x8156357b7fdba578 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a185b expref: 18 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.582779:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc800/0x8156357b7fdba578 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a185b expref: 18 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.582788:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bc800, rc 0) 00000100:00100000:2.0:1746140886.582811:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+17:1985:x1830960573748736:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1888us (2505us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.582817:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17015 00000100:00100000:3.0:1746140886.582838:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576061312:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140886.582855:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940cbe00/0x8156357b7fdba571 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a184d expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.582863:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940cbe00/0x8156357b7fdba571 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a184d expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.582871:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cbe00, rc 0) 00000100:00100000:3.0:1746140886.582889:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573748480:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1971us (2625us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140886.582895:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17014 00000100:00100000:0.0:1746140886.582906:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576061440:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140886.582922:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba56a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1854 expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140886.582932:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba56a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1854 expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140886.582940:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ddec00, rc 0) 00000100:00100000:0.0:1746140886.582957:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573748608:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2099us (2677us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140886.582962:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17013 00000100:00100000:1.0:1746140886.586105:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.586352:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573749120 00000100:00100000:3.0:1746140886.586361:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573749120 00000100:00100000:3.0:1746140886.586400:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10748 00000100:00100000:3.0:1746140886.586406:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32689:x1830960573749120:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140886.586421:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.586437:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbc00/0x8156357b7fdba57f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1862 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.586519:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.586533:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.586539:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.586567:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.586576:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 8 pid: 14742 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.586587:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576061568:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.587239:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.587339:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1982:x1830960573748864:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5104us (5823us total) trans 17179874128 rc 0/0 00000100:00100000:2.0:1746140886.587348:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1802 00002000:00100000:2.0:1746140886.587358:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1724416->1818623) req@ffff8800a51cd880 x1830960573748864/t17179874128(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.587577:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cd880 with x1830960573748864 ext(1724416->1818623) 00010000:00010000:2.0:1746140886.587585:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 41 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.587596:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 41 pid: 24958 timeout: 965 lvb_type: 0 00002000:00010000:2.0:1746140886.587603:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a51cd880 00000100:00100000:0.0:1746140886.587732:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.587791:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573749248 00000100:00100000:2.0:1746140886.587795:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573749248 00000100:00100000:2.0:1746140886.587832:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17016 00000100:00100000:2.0:1746140886.587837:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+24:32688:x1830960573749248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.587846:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.587854:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1869 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.587871:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.587876:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->1228799] (req 1048576->1228799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 25 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.587881:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140886.587883:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.587913:0:12255:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->1228799] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 25 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.587923:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.587932:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bce00, rc 0) 00000100:00100000:2.0:1746140886.587964:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:32688:x1830960573749248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.587969:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17016 00000100:00100000:0.0:1746140886.590297:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.590348:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576061568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140886.590367:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140886.590452:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573749376 00000100:00100000:2.0:1746140886.590458:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573749376 00010000:00010000:2.0:1746140886.590485:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 9 pid: 14742 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.590519:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8807 00000100:00100000:2.0:1746140886.590526:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573749376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.590539:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.590545:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 9 pid: 14742 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.590554:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 9 pid: 14742 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.590617:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f101800/0x8156357b7fdba555 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1838 expref: 9 pid: 14742 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.590628:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140886.590633:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.590641:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.590647:0:9847:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.590689:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.590696:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140886.590714:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140886.590746:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140886.590849:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbc00/0x8156357b7fdba57f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1862 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.590862:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1862 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.590869:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.590871:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746140886.590873:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cb600, rc 0) 00000100:00100000:0.0:1746140886.590930:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.590957:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573749376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 431us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.590962:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:32689:x1830960573749120:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4556us (4866us total) trans 8589945048 rc 0/0 00000100:00100000:2.0:1746140886.590964:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8807 00000100:00100000:3.0:1746140886.590969:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10748 00000100:00100000:2.0:1746140886.590976:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573749504 00000100:00100000:2.0:1746140886.590979:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573749504 00010000:00010000:2.0:1746140886.590990:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 41 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.591436:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8808 00000100:00100000:2.0:1746140886.591443:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1983:x1830960573749504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.591450:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.591469:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 41 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.591477:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 41 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.591491:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356bc400/0x8156357b7fdba459 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1724416->1818623) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17c1 expref: 41 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.591504:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.591506:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.591511:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.591519:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140886.592159:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.592202:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573749760 00000100:00100000:3.0:1746140886.592207:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573749760 00010000:00010000:2.0:1746140886.592226:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 24 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.592238:0:9847:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 24 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.592242:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10749 00000100:00100000:3.0:1746140886.592247:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32689:x1830960573749760:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746140886.592250:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576061824:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140886.592262:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.592264:0:14742:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746140886.592273:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0x8156357b7fdba586 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1862 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.592287:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.592291:0:14742:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140886.592300:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cae00/0x8156357b7fdba59b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1870 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.592319:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140886.592387:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592396:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592402:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592411:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592416:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592421:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592426:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940cac00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.592430:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592435:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592441:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.592444:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140886.592446:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592450:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cac00/0x8156357b7fdba5a2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.592468:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cae00/0x8156357b7fdba59b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1870 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.592474:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cae00/0x8156357b7fdba59b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1870 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.592480:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cae00, rc 0) 00000100:00100000:3.0:1746140886.592503:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32689:x1830960573749760:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 256us (344us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140886.592509:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10749 00000100:00100000:2.0:1746140886.594984:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576061824:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.595004:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.595062:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1983:x1830960573749504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3619us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.595082:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8808 00000100:00100000:2.0:1746140886.596047:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.596137:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573750016 00000100:00100000:1.0:1746140886.596150:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573750016 00000100:00100000:1.0:1746140886.596209:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4719 00000100:00100000:1.0:1746140886.596216:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32689:x1830960573750016:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:0.0:1746140886.596228:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.596332:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573750272 00000100:00100000:3.0:1746140886.596336:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573750272 00002000:00100000:3.0:1746140886.596363:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1224704->1228799) req@ffff88009f24ea00 x1830960573750272/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.596373:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ea00 with x1830960573750272 ext(1224704->1228799) 00010000:00010000:3.0:1746140886.596773:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.596796:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.596803:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f24ea00 00000100:00100000:1.0:1746140886.596965:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32689:x1830960573750016:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 748us (919us total) trans 8589945049 rc 0/0 00000100:00100000:3.0:1746140886.596968:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1803 00000100:00100000:1.0:1746140886.596972:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4719 00000100:00100000:3.0:1746140886.596975:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573750272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140886.597126:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573750272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 152us (898us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.597132:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1803 00002000:00100000:3.0:1746140886.597137:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1224704->1228799) req@ffff88009f24ea00 x1830960573750272/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.597144:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ea00 with x1830960573750272 ext(1224704->1228799) 00010000:00010000:3.0:1746140886.597149:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.597163:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.597169:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f24ea00 00000100:00100000:0.0:1746140886.599900:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.599955:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.600003:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573750528 00000100:00100000:3.0:1746140886.600012:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573750528 00000100:00100000:1.0:1746140886.600037:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573750784 00000100:00100000:1.0:1746140886.600041:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573750784 00000100:00100000:1.0:1746140886.600088:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4720 00000100:00100000:1.0:1746140886.600097:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32684:x1830960573750784:12345-192.168.204.16@tcp:35:multiop.0 00002000:00100000:3.0:1746140886.600102:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1228799) req@ffff88009f24d500 x1830960573750528/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.600110:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24d500 with x1830960573750528 ext(1048576->1228799) 00010000:00010000:3.0:1746140886.600119:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.600133:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.600140:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f24d500 00000100:00100000:3.0:1746140886.600153:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1804 00000100:00100000:3.0:1746140886.600158:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573750528:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140886.600276:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32684:x1830960573750784:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 182us (320us total) trans 8589945050 rc 0/0 00000100:00100000:1.0:1746140886.600282:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4720 00000100:00100000:3.0:1746140886.603566:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573750528:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3398us (3666us total) trans 17179874129 rc 0/0 00000100:00100000:3.0:1746140886.603578:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1804 00002000:00100000:3.0:1746140886.603589:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1228799) req@ffff88009f24d500 x1830960573750528/t17179874129(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.603598:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24d500 with x1830960573750528 ext(1048576->1228799) 00010000:00010000:3.0:1746140886.603608:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 27 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.603621:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 27 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.603628:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f24d500 00000100:00100000:0.0:1746140886.605791:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.605886:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573750912 00000100:00100000:2.0:1746140886.605895:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573750912 00010000:00010000:2.0:1746140886.605926:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 27 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.605966:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8809 00000100:00100000:2.0:1746140886.605973:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573750912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.605989:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.606009:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 27 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.606021:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 27 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.606042:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356bde00/0x8156357b7fdba55c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a183f expref: 27 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.606082:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.606084:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.606090:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.606099:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.606129:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.606142:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576061952:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.606906:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.607710:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576061952:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.607725:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.607751:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573750912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1778us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.607760:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8809 00000100:00100000:0.0:1746140886.609023:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.609123:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573751168 00000100:00100000:3.0:1746140886.609132:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573751168 00002000:00100000:3.0:1746140886.609174:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f24ce00 x1830960573751168/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.609184:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ce00 with x1830960573751168 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.609189:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f24ce00 00000100:00100000:3.0:1746140886.609205:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8719 00000100:00100000:3.0:1746140886.609211:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573751168:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.617514:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.619059:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573751424 00000100:00100000:3.0:1746140886.619081:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573751424 00000100:00100000:3.0:1746140886.619657:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10750 00000100:00100000:3.0:1746140886.619666:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:32695:x1830960573751424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.619689:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.619706:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb400/0x8156357b7fdba5a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1877 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.619822:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.619835:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.619846:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.619858:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.619864:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.619869:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.619970:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.619979:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.619984:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140886.619993:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.620092:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620098:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620104:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620110:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940cba00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.620114:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620120:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620130:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.620132:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.620136:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620141:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba00/0x8156357b7fdba5b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620168:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620172:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620177:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620181:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940cb200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.620183:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620187:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620193:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388800) 00010000:00010000:3.0:1746140886.620195:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.620197:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620201:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb200/0x8156357b7fdba5b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.620238:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb400/0x8156357b7fdba5a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 282 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.620248:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 281 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.620254:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.620255:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140886.620258:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cb000, rc 0) 00000100:00100000:2.0:1746140886.621559:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573751168:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12341us (12534us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140886.621569:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8719 00002000:00100000:2.0:1746140886.621579:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f24ce00 x1830960573751168/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.621589:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ce00 with x1830960573751168 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.621594:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f24ce00 00000100:00100000:3.0:1746140886.622264:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:32695:x1830960573751424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2598us (4758us total) trans 8589945051 rc 0/0 00000100:00100000:3.0:1746140886.622272:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10750 00000100:00100000:0.0:1746140886.625654:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.625693:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.625731:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.625781:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573751552 00000100:00100000:3.0:1746140886.625794:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573751552 00000100:00100000:3.0:1746140886.625848:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573751680 00000100:00100000:3.0:1746140886.625851:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573751680 00000100:00100000:2.0:1746140886.625857:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573751808 00000100:00100000:2.0:1746140886.625864:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573751808 00000100:00100000:3.0:1746140886.625876:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17017 00000100:00100000:3.0:1746140886.625884:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573751552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.625902:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140886.625908:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17018 00000100:00100000:2.0:1746140886.625915:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573751680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.625918:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940caa00/0x8156357b7fdba5cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a187e expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.625933:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140886.625941:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17019 00010000:00010000:2.0:1746140886.625947:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1885 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.625951:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+26:32688:x1830960573751808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140886.625960:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140886.625967:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576062080:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.625968:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.625969:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.625971:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a188c expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.625978:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 43 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140886.625991:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.625992:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 43 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140886.625998:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140886.625999:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140886.626003:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 27 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.626006:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb6600, rc 0) 00010000:00010000:1.0:1746140886.626025:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.626037:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573751680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 124us (345us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140886.626037:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 36 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.626040:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb900 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.626043:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17018 00000100:00100000:1.0:1746140886.626051:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576062208:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140886.626095:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140886.629043:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576062208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140886.629080:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 27 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.629097:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f100c00, rc 0) 00000100:00100000:1.0:1746140886.629137:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32688:x1830960573751808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3188us (3404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.629145:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17019 00000100:00100000:2.0:1746140886.629207:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576062080:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140886.629219:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140886.629232:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940caa00/0x8156357b7fdba5cc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a187e expref: 42 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.629242:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940caa00/0x8156357b7fdba5cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a187e expref: 42 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.629255:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940caa00, rc 0) 00000100:00100000:2.0:1746140886.629274:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573751552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3392us (3630us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.629279:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17017 00000100:00100000:3.0:1746140886.629344:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573751936 00000100:00100000:3.0:1746140886.629350:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573751936 00002000:00100000:3.0:1746140886.629384:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1896448->2097151) req@ffff88009f7aa300 x1830960573751936/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.629394:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aa300 with x1830960573751936 ext(1896448->2097151) 00010000:00010000:3.0:1746140886.629400:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 37 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.629411:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 37 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.629417:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7aa300 00000100:00100000:3.0:1746140886.629444:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1805 00000100:00100000:3.0:1746140886.629451:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573751936:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140886.632602:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573751936:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3142us (3373us total) trans 21474841415 rc 0/0 00000100:00100000:3.0:1746140886.632613:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1805 00002000:00100000:3.0:1746140886.632624:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1896448->2097151) req@ffff88009f7aa300 x1830960573751936/t21474841415(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.632631:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aa300 with x1830960573751936 ext(1896448->2097151) 00010000:00010000:3.0:1746140886.632639:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 39 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.632652:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 39 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.632659:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7aa300 00000100:00100000:0.0:1746140886.632990:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.633154:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573752064 00000100:00100000:2.0:1746140886.633161:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573752064 00000100:00100000:2.0:1746140886.633192:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17020 00000100:00100000:2.0:1746140886.633199:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:32695:x1830960573752064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.633217:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.633232:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1893 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.633258:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 25 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.633265:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.633267:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.633270:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 42 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.633297:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 25 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.633329:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 25 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.633341:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576062336:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.633419:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.634385:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.634471:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576062336:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.634548:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 42 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.634561:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb7200, rc 0) 00000100:00100000:2.0:1746140886.634659:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:32695:x1830960573752064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1459us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.634665:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17020 00000100:00100000:2.0:1746140886.634690:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573752192 00000100:00100000:2.0:1746140886.634694:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573752192 00010000:00010000:2.0:1746140886.634711:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 39 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.634742:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8810 00000100:00100000:2.0:1746140886.634747:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573752192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.634757:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.634778:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 39 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:0.0:1746140886.635127:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.635176:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573752320 00000100:00100000:3.0:1746140886.635181:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573752320 00002000:00100000:3.0:1746140886.635206:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1499136->2097151) req@ffff88009f7a8a80 x1830960573752320/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.635215:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a8a80 with x1830960573752320 ext(1499136->2097151) 00010000:00010000:3.0:1746140886.635220:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 26 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.635228:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 26 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.635234:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7a8a80 00000100:00100000:3.0:1746140886.635259:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1806 00000100:00100000:3.0:1746140886.635265:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573752320:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:2.0:1746140886.635467:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 39 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.635486:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356bda00/0x8156357b7fdba4c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17f9 expref: 39 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.635511:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.635513:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.635520:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 26 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.635566:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 26 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.635594:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 26 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.635604:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576062464:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.636133:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.639977:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576062464:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140886.639998:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.640049:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573752192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5300us (5664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.640059:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8810 00000100:00100000:0.0:1746140886.640443:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.641675:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573752576 00000100:00100000:2.0:1746140886.641685:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573752576 00002000:00100000:2.0:1746140886.641723:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f7abb80 x1830960573752576/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.641733:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7abb80 with x1830960573752576 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.641738:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7abb80 00000100:00100000:2.0:1746140886.641759:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8720 00000100:00100000:2.0:1746140886.641765:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573752576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140886.642908:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573752320:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7639us (7777us total) trans 17179874130 rc 0/0 00000100:00100000:3.0:1746140886.642916:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1806 00002000:00100000:3.0:1746140886.642923:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1499136->2097151) req@ffff88009f7a8a80 x1830960573752320/t17179874130(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.642931:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a8a80 with x1830960573752320 ext(1499136->2097151) 00010000:00010000:3.0:1746140886.642939:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 28 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.642953:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 28 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:3.0:1746140886.642960:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7a8a80 00000100:00100000:0.0:1746140886.648055:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.648498:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573752704 00000100:00100000:3.0:1746140886.648511:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573752704 00010000:00010000:3.0:1746140886.648564:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 28 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.648608:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8811 00000100:00100000:3.0:1746140886.648617:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573752704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.648633:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.648659:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 28 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.649227:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 28 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.649250:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67400/0x8156357b7fdba4fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a180e expref: 28 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.649282:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.649284:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.649292:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.649324:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.649362:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140886.649374:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576062592:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.650211:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573752576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8437us (9759us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.650220:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.650223:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8720 00002000:00100000:2.0:1746140886.650235:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f7abb80 x1830960573752576/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.650244:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7abb80 with x1830960573752576 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.650249:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7abb80 00000100:00100000:3.0:1746140886.652052:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576062592:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140886.652081:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.652129:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573752704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3513us (4084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.652139:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8811 00000100:00100000:0.0:1746140886.654409:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.654511:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573752832 00000100:00100000:2.0:1746140886.654521:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573752832 00000100:00100000:2.0:1746140886.654582:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17021 00000100:00100000:2.0:1746140886.654590:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32688:x1830960573752832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.654607:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.654623:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a189a expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.654650:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 37 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.654661:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.654663:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140886.654666:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.654696:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 37 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.654708:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 37 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.654718:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576062720:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.654807:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.657154:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.657239:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573753088 00000100:00100000:2.0:1746140886.657247:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573753088 00002000:00100000:2.0:1746140886.657285:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f7a8700 x1830960573753088/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.657295:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a8700 with x1830960573753088 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.657300:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7a8700 00000100:00100000:2.0:1746140886.657362:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8721 00000100:00100000:2.0:1746140886.657369:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573753088:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140886.661519:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576062720:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140886.661519:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.661549:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573753216 00010000:00010000:2.0:1746140886.661550:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.661556:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573753216 00000100:00100000:0.0:1746140886.661572:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140886.661574:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb6400, rc 0) 00002000:00100000:1.0:1746140886.661596:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2506751) req@ffff880094add880 x1830960573753216/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.661606:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094add880 with x1830960573753216 ext(2097152->2506751) 00010000:00010000:1.0:1746140886.661613:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 38 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.661623:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573753472 00000100:00100000:2.0:1746140886.661623:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32688:x1830960573752832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7033us (7221us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140886.661626:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 38 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.661627:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573753472 00000100:00100000:2.0:1746140886.661632:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17021 00002000:00010000:1.0:1746140886.661632:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094add880 00002000:00100000:3.0:1746140886.661646:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880094ade300 x1830960573753472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140886.661652:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1807 00002000:00100000:3.0:1746140886.661653:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ade300 with x1830960573753472 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.661656:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ade300 00000100:00100000:1.0:1746140886.661658:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573753216:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140886.661670:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8722 00000100:00100000:3.0:1746140886.661674:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573753472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140886.664949:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573753088:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7568us (7788us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.664966:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8721 00002000:00100000:3.0:1746140886.664979:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f7a8700 x1830960573753088/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.664989:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a8700 with x1830960573753088 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.664994:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7a8700 00000100:00100000:1.0:1746140886.670851:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573753216:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9179us (9327us total) trans 21474841416 rc 0/0 00000100:00100000:1.0:1746140886.670865:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1807 00002000:00100000:1.0:1746140886.670880:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2506751) req@ffff880094add880 x1830960573753216/t21474841416(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.670889:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094add880 with x1830960573753216 ext(2097152->2506751) 00010000:00010000:1.0:1746140886.670899:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 40 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.670916:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 40 pid: 9872 timeout: 965 lvb_type: 0 00002000:00010000:1.0:1746140886.670922:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094add880 00000100:00100000:3.0:1746140886.671016:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573753472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9333us (9435us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.671141:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8722 00002000:00100000:3.0:1746140886.671152:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880094ade300 x1830960573753472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.671161:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ade300 with x1830960573753472 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.671166:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ade300 00000100:00100000:0.0:1746140886.677296:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.677422:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573753600 00000100:00100000:3.0:1746140886.677435:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573753600 00000100:00100000:0.0:1746140886.677444:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140886.677476:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 40 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.677510:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8812 00000100:00100000:3.0:1746140886.677516:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573753600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.677528:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.677554:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 40 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.677565:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 40 pid: 9872 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.677586:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356bc600/0x8156357b7fdba4d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1800 expref: 40 pid: 9872 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.677590:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573753728 00000100:00100000:2.0:1746140886.677594:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573753728 00010000:00010000:3.0:1746140886.677612:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140886.677612:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17022 00010000:00010000:3.0:1746140886.677613:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140886.677615:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:32695:x1830960573753728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.677620:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.677627:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.677628:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.677636:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18a1 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.677649:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.677650:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.677653:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.677658:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.677665:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140886.677669:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576062848:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.677670:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb7c00, rc 0) 00000100:00100000:3.0:1746140886.677739:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.677779:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:32695:x1830960573753728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 163us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.677783:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17022 00000100:00100000:3.0:1746140886.679883:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576062848:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140886.679901:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.680299:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573753600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2781us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.680498:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8812 00010000:00010000:1.0:1746140886.682224:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140886.682432:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.682880:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573753984 00000100:00100000:3.0:1746140886.682889:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573753984 00002000:00100000:3.0:1746140886.682943:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880094adce00 x1830960573753984/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.682962:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adce00 with x1830960573753984 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.682967:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094adce00 00000100:00100000:3.0:1746140886.682997:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8723 00000100:00100000:3.0:1746140886.683004:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573753984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.683180:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.683210:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.683385:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573754240 00000100:00100000:1.0:1746140886.683389:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573754240 00002000:00100000:1.0:1746140886.683407:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009abb8000 x1830960573754240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.683415:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8000 with x1830960573754240 ext(2097152->3145727) 00002000:00010000:1.0:1746140886.683418:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb8000 00000100:00100000:1.0:1746140886.683427:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573754368 00000100:00100000:1.0:1746140886.683429:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573754368 00002000:00100000:1.0:1746140886.683436:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009abb8380 x1830960573754368/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.683442:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8380 with x1830960573754368 ext(3145728->4194303) 00000100:00100000:2.0:1746140886.683443:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8724 00002000:00010000:1.0:1746140886.683445:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb8380 00000100:00100000:2.0:1746140886.683452:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573754240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.683460:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8725 00000100:00100000:1.0:1746140886.683465:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573754368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140886.698554:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573753984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15541us (16122us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.698565:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8723 00002000:00100000:3.0:1746140886.698577:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880094adce00 x1830960573753984/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.698587:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094adce00 with x1830960573753984 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.698593:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094adce00 00000100:00100000:1.0:1746140886.700488:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573754368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17015us (17270us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140886.700499:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8725 00002000:00100000:1.0:1746140886.700508:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009abb8380 x1830960573754368/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.700516:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8380 with x1830960573754368 ext(3145728->4194303) 00002000:00010000:1.0:1746140886.700521:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb8380 00000100:00100000:3.0:1746140886.701257:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573754240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17805us (18075us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.701264:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8724 00002000:00100000:3.0:1746140886.701270:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009abb8000 x1830960573754240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.701276:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8000 with x1830960573754240 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.701279:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb8000 00000100:00100000:0.0:1746140886.704518:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.704632:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573754624 00000100:00100000:2.0:1746140886.704642:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573754624 00000100:00100000:2.0:1746140886.704695:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17023 00000100:00100000:2.0:1746140886.704703:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:32695:x1830960573754624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.704720:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.704738:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18a8 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.704762:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.704764:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.704771:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.705166:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.705181:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb6800, rc 0) 00000100:00100000:2.0:1746140886.705623:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:32695:x1830960573754624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 919us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.705631:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17023 00000100:00100000:0.0:1746140886.708906:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.709012:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573754752 00000100:00100000:2.0:1746140886.709021:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573754752 00000100:00100000:2.0:1746140886.709645:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17024 00000100:00100000:2.0:1746140886.709653:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573754752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.709671:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.709688:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18af expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.709715:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.709717:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.709725:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.709740:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.709750:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb6000, rc 0) 00000100:00100000:2.0:1746140886.709799:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573754752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 147us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.709806:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17024 00000100:00100000:0.0:1746140886.712397:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.712489:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573755008 00000100:00100000:0.0:1746140886.712498:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.712502:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573755008 00000100:00100000:0.0:1746140886.712537:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746140886.712542:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009abb8e00 x1830960573755008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.712552:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8e00 with x1830960573755008 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.712558:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb8e00 00000100:00100000:3.0:1746140886.712577:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573755264 00000100:00100000:3.0:1746140886.712579:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573755264 00002000:00100000:3.0:1746140886.712591:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009abb9500 x1830960573755264/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.712597:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb9500 with x1830960573755264 ext(3145728->4194303) 00002000:00010000:3.0:1746140886.712599:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb9500 00000100:00100000:3.0:1746140886.712626:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8726 00000100:00100000:3.0:1746140886.712633:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573755008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.712900:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8727 00000100:00100000:1.0:1746140886.712912:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573755264:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140886.713400:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573755520 00000100:00100000:2.0:1746140886.713406:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573755520 00000100:00100000:2.0:1746140886.713445:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10751 00000100:00100000:2.0:1746140886.713451:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:32697:x1830960573755520:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.713466:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.713484:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb6c00/0x8156357b7fdba604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18b6 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.713579:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.713594:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 282 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.713604:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.713635:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 282 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.713647:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 282 pid: 14742 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.713658:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576062976:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.713723:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.714666:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.714712:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573755776 00000100:00100000:3.0:1746140886.714718:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573755776 00002000:00100000:3.0:1746140886.714745:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009abb9880 x1830960573755776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.714753:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb9880 with x1830960573755776 ext(4194304->4886527) 00002000:00010000:3.0:1746140886.714757:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb9880 00000100:00100000:3.0:1746140886.714781:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8728 00000100:00100000:3.0:1746140886.714787:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573755776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.718914:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.718976:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573755904 00000100:00100000:3.0:1746140886.718985:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573755904 00010000:00010000:3.0:1746140886.719018:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 283 pid: 14742 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.719058:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8813 00000100:00100000:3.0:1746140886.719077:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:1985:x1830960573755904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.719090:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.719097:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 283 pid: 14742 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.719107:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 283 pid: 14742 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.719127:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.719132:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.719140:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.719145:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb000/0x8156357b7fdba5be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1877 expref: 283 pid: 14742 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.719146:0:9847:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.719160:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.719259:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:1985:x1830960573755904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 193us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.719266:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8813 00000100:00100000:2.0:1746140886.719402:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576062976:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.719420:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.719428:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.719433:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140886.719449:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140886.719564:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb6c00/0x8156357b7fdba604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 283 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.719577:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 282 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.719584:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140886.719586:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140886.719589:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356bc600, rc 0) 00000100:00100000:2.0:1746140886.719611:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:32697:x1830960573755520:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6160us (7113us total) trans 8589945052 rc 0/0 00000100:00100000:2.0:1746140886.719618:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10751 00000100:00100000:2.0:1746140886.719902:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.719917:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573756160 00000100:00100000:0.0:1746140886.719921:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573756160 00000100:00100000:0.0:1746140886.719948:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10752 00000100:00100000:0.0:1746140886.719953:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32699:x1830960573756160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140886.719968:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140886.720141:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf800/0x8156357b7fdba619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18bd expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.720214:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720222:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720228:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720238:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720243:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720247:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720352:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf400/0x8156357b7fdba62e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720359:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf400/0x8156357b7fdba62e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720364:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf400/0x8156357b7fdba62e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140886.720370:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140886.720403:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720409:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720417:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720422:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddfa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140886.720425:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720431:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720453:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140886.720456:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140886.720459:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720464:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfa00/0x8156357b7fdba620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720487:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720492:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720497:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720500:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddf600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140886.720502:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720507:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720517:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871600) 00010000:00010000:0.0:1746140886.720518:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140886.720521:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720524:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba627 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140886.720546:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf800/0x8156357b7fdba619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18bd expref: 19 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.720554:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf400/0x8156357b7fdba62e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18bd expref: 18 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.720558:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140886.720560:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140886.720561:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ddf400, rc 0) 00000100:00100000:0.0:1746140886.720597:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32699:x1830960573756160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 642us (694us total) trans 8589945053 rc 0/0 00000100:00100000:0.0:1746140886.720602:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10752 00000100:00100000:3.0:1746140886.722095:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573755008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9457us (9700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.722104:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8726 00002000:00100000:3.0:1746140886.722116:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009abb8e00 x1830960573755008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.722124:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8e00 with x1830960573755008 ext(2097152->3145727) 00002000:00010000:3.0:1746140886.722128:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb8e00 00000100:00100000:1.0:1746140886.723880:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573755264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10965us (11336us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140886.723890:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8727 00002000:00100000:1.0:1746140886.723899:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009abb9500 x1830960573755264/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.723907:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb9500 with x1830960573755264 ext(3145728->4194303) 00002000:00010000:1.0:1746140886.723912:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb9500 00000100:00100000:3.0:1746140886.725029:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573755776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10238us (10364us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140886.725040:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8728 00002000:00100000:3.0:1746140886.725047:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009abb9880 x1830960573755776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.725055:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb9880 with x1830960573755776 ext(4194304->4886527) 00002000:00010000:3.0:1746140886.725058:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb9880 00000100:00100000:0.0:1746140886.727465:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.727593:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.727617:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573756288 00000100:00100000:1.0:1746140886.727625:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573756288 00000100:00100000:3.0:1746140886.727663:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573756416 00000100:00100000:3.0:1746140886.727667:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573756416 00000100:00100000:1.0:1746140886.727672:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17025 00000100:00100000:1.0:1746140886.727680:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:32697:x1830960573756288:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140886.727701:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140886.727702:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 777 00000100:00100000:3.0:1746140886.727707:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573756416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.727717:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18c4 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.727719:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.727738:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf400/0x8156357b7fdba62e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18bd expref: 18 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.727740:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.727748:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 43 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.727753:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140886.727754:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.727755:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.727757:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140886.727758:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1126400->1236991] (req 1126400->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.727782:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 43 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140886.727785:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573756416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.727790:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 777 00010000:00010000:1.0:1746140886.727794:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 43 pid: 12255 timeout: 965 lvb_type: 1 00000100:00100000:1.0:1746140886.727804:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576063104:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140886.727871:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.727879:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 27 pid: 12255 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.727950:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576063232:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140886.727974:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140886.728955:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576063104:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140886.728964:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576063232:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140886.728982:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1126400->1236991] (req 1126400->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.728995:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bae2e00, rc 0) 00000100:00100000:1.0:1746140886.729025:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:32697:x1830960573756288:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1346us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.729032:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17025 00000100:00100000:0.0:1746140886.729481:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.729519:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573756544 00000100:00100000:1.0:1746140886.729523:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573756544 00000100:00100000:0.0:1746140886.729931:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.729938:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17026 00000100:00100000:1.0:1746140886.729945:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573756544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140886.729956:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140886.729967:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bae3400/0x8156357b7fdba643 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18cb expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.729987:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.729994:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bae3400/0x8156357b7fdba643 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18cb expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140886.730005:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bae3400/0x8156357b7fdba643 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18cb expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140886.730122:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573756672 00000100:00100000:2.0:1746140886.730129:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573756672 00010000:00010000:2.0:1746140886.730156:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 44 pid: 12255 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.730190:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8814 00000100:00100000:0.0:1746140886.730459:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.730471:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573756800 00000100:00100000:0.0:1746140886.730474:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573756800 00010000:00010000:0.0:1746140886.730491:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 28 pid: 12255 timeout: 965 lvb_type: 0 00000100:00100000:0.0:1746140886.730508:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8815 00000100:00100000:0.0:1746140886.730513:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573756800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140886.730523:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140886.730545:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 28 pid: 12255 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140886.730555:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 28 pid: 12255 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140886.730573:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356bce00/0x8156357b7fdba58d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1869 expref: 28 pid: 12255 timeout: 965 lvb_type: 0 00010000:00010000:0.0:1746140886.730592:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140886.730621:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573756800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140886.730627:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8815 00000100:00100000:0.0:1746140886.730662:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.730683:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573756928 00000100:00100000:3.0:1746140886.730689:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573756928 00000100:00100000:3.0:1746140886.730715:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17027 00000100:00100000:3.0:1746140886.730720:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573756928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.730726:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.730738:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940caa00/0x8156357b7fdba64a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18d2 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.730754:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.730760:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940caa00/0x8156357b7fdba64a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18d2 expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.730768:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940caa00/0x8156357b7fdba64a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18d2 expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.730775:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940caa00, rc 0) 00000100:00100000:2.0:1746140886.730883:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573756672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.730891:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.730901:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 44 pid: 12255 timeout: 965 lvb_type: 1 00010000:00010000:2.0:1746140886.730909:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 44 pid: 12255 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.730913:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bae3400, rc 0) 00010000:00010000:2.0:1746140886.730920:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6600/0x8156357b7fdba5d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1885 expref: 44 pid: 12255 timeout: 965 lvb_type: 1 00000100:00100000:1.0:1746140886.730932:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573756544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 988us (1457us total) trans 0 rc 301/301 00010000:00010000:2.0:1746140886.730933:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.730936:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.730943:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.730943:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17026 00010000:00010000:2.0:1746140886.730950:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.730980:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 42 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.730992:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576063360:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.731037:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.731148:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573756928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 87us (144us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140886.731155:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17027 00000100:00100000:2.0:1746140886.732523:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576063360:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.732537:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.732605:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573756672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2408us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.732613:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8814 00000100:00100000:0.0:1746140886.733127:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.733191:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573757184 00000100:00100000:3.0:1746140886.733201:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573757184 00002000:00100000:3.0:1746140886.733236:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1126400->1130495) req@ffff88009abbb100 x1830960573757184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.733245:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb100 with x1830960573757184 ext(1126400->1130495) 00002000:00010000:3.0:1746140886.733249:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abbb100 00000100:00100000:3.0:1746140886.733368:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8729 00000100:00100000:3.0:1746140886.733375:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1984:x1830960573757184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140886.733625:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1984:x1830960573757184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 250us (498us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140886.733631:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8729 00002000:00100000:3.0:1746140886.733636:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1126400->1130495) req@ffff88009abbb100 x1830960573757184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140886.733644:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746140886.733650:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb100 with x1830960573757184 ext(1126400->1130495) 00002000:00010000:3.0:1746140886.733652:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abbb100 00000100:00100000:2.0:1746140886.733826:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.733943:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573757568 00000100:00100000:3.0:1746140886.733947:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573757568 00000100:00100000:3.0:1746140886.733973:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17028 00000100:00100000:3.0:1746140886.733978:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573757568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.733986:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.733999:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940cb600/0x8156357b7fdba651 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18d9 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140886.734042:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576063488:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140886.734045:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573757440 00000100:00100000:1.0:1746140886.734052:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573757440 00002000:00100000:1.0:1746140886.734096:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f781c00 x1830960573757440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140886.734106:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00002000:00100000:1.0:1746140886.734106:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f781c00 with x1830960573757440 ext(4194304->4886527) 00002000:00010000:1.0:1746140886.734110:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f781c00 00000100:00100000:3.0:1746140886.734123:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8730 00000100:00100000:3.0:1746140886.734130:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573757440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.737217:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.737280:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573757824 00000100:00100000:2.0:1746140886.737290:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573757824 00000100:00100000:3.0:1746140886.737580:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576063488:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140886.737612:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940cb600/0x8156357b7fdba651 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18d9 expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.737625:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940cb600/0x8156357b7fdba651 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18d9 expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140886.737635:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cb600, rc 0) 00000100:00100000:3.0:1746140886.737677:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573757568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3698us (3850us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140886.737688:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17028 00002000:00100000:2.0:1746140886.737762:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1232896->1236991) req@ffff88009abbb480 x1830960573757824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.737772:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb480 with x1830960573757824 ext(1232896->1236991) 00002000:00010000:2.0:1746140886.737776:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abbb480 00000100:00100000:2.0:1746140886.738212:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8731 00000100:00100000:2.0:1746140886.738219:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573757824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140886.738358:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573757824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 140us (1153us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140886.738364:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8731 00002000:00100000:2.0:1746140886.738368:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1232896->1236991) req@ffff88009abbb480 x1830960573757824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.738375:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb480 with x1830960573757824 ext(1232896->1236991) 00002000:00010000:2.0:1746140886.738377:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abbb480 00000100:00100000:3.0:1746140886.739629:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573757440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5497us (5982us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140886.739637:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8730 00002000:00100000:3.0:1746140886.739643:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f781c00 x1830960573757440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.739651:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f781c00 with x1830960573757440 ext(4194304->4886527) 00002000:00010000:3.0:1746140886.739655:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f781c00 00000100:00100000:0.0:1746140886.742108:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.742800:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573758080 00000100:00100000:1.0:1746140886.742809:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573758080 00000100:00100000:1.0:1746140886.742861:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4721 00000100:00100000:1.0:1746140886.742869:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32688:x1830960573758080:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140886.743100:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32688:x1830960573758080:12345-192.168.204.16@tcp:35:cat.0 Request processed in 231us (999us total) trans 8589945054 rc 0/0 00000100:00100000:1.0:1746140886.743107:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4721 00000100:00100000:0.0:1746140886.744203:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.744262:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573758336 00000100:00100000:1.0:1746140886.744267:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573758336 00000100:00100000:1.0:1746140886.744300:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4722 00000100:00100000:1.0:1746140886.744325:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:32695:x1830960573758336:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140886.744443:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:32695:x1830960573758336:12345-192.168.204.16@tcp:35:cat.0 Request processed in 119us (243us total) trans 8589945055 rc 0/0 00000100:00100000:1.0:1746140886.744450:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4722 00000100:00100000:0.0:1746140886.826923:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.827012:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573758464 00000100:00100000:3.0:1746140886.827023:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573758464 00000100:00100000:3.0:1746140886.827110:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17029 00000100:00100000:3.0:1746140886.827117:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32699:x1830960573758464:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140886.827137:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.827155:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18e0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.827186:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 41 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.827193:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140886.827195:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140886.827198:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.827228:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 41 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.827243:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 41 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.827255:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576063616:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.827398:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.829691:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576063616:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140886.829719:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.829736:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cbc00, rc 0) 00000100:00100000:0.0:1746140886.830074:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.830171:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573758592 00000100:00100000:2.0:1746140886.830180:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573758592 00002000:00100000:2.0:1746140886.830221:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1126400->1236991) req@ffff88009abbbb80 x1830960573758592/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.830232:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbbb80 with x1830960573758592 ext(1126400->1236991) 00010000:00010000:2.0:1746140886.830239:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 42 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.830252:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 42 pid: 24958 timeout: 965 lvb_type: 0 00002000:00010000:2.0:1746140886.830260:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009abbbb80 00000100:00100000:2.0:1746140886.830295:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1808 00000100:00100000:3.0:1746140886.830358:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32699:x1830960573758464:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3238us (3445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.830366:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17029 00000100:00100000:2.0:1746140886.830435:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573758592:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140886.832785:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573758592:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2472us (2713us total) trans 17179874131 rc 0/0 00000100:00100000:2.0:1746140886.832798:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1808 00002000:00100000:2.0:1746140886.832809:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1126400->1236991) req@ffff88009abbbb80 x1830960573758592/t17179874131(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.832818:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbbb80 with x1830960573758592 ext(1126400->1236991) 00010000:00010000:2.0:1746140886.832828:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 44 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.832842:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 44 pid: 24958 timeout: 965 lvb_type: 0 00002000:00010000:2.0:1746140886.832848:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009abbbb80 00000100:00100000:0.0:1746140886.835006:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.835091:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573758720 00000100:00100000:2.0:1746140886.835102:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573758720 00010000:00010000:2.0:1746140886.835136:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 44 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.835230:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8816 00000100:00100000:2.0:1746140886.835237:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573758720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.835250:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.835273:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 44 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.835284:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 44 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.835475:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba63c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18c4 expref: 44 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.835511:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.835513:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.835520:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.835528:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.835565:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.835624:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576063744:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140886.835844:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.836674:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576063744:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140886.836686:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.836736:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573758720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1498us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.836743:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8816 00000100:00100000:0.0:1746140886.837347:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.837423:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573758976 00000100:00100000:2.0:1746140886.837428:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573758976 00002000:00100000:2.0:1746140886.837459:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1720320->1724415) req@ffff88009abb8a80 x1830960573758976/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.837467:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8a80 with x1830960573758976 ext(1720320->1724415) 00002000:00010000:2.0:1746140886.837472:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abb8a80 00000100:00100000:2.0:1746140886.837484:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8732 00000100:00100000:2.0:1746140886.837489:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573758976:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140886.837651:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573758976:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 161us (306us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140886.837655:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8732 00002000:00100000:2.0:1746140886.837658:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1720320->1724415) req@ffff88009abb8a80 x1830960573758976/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.837663:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8a80 with x1830960573758976 ext(1720320->1724415) 00002000:00010000:2.0:1746140886.837665:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abb8a80 00000100:00100000:0.0:1746140886.842591:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.842684:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573759104 00000100:00100000:3.0:1746140886.842693:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573759104 00000100:00100000:3.0:1746140886.842792:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17030 00000100:00100000:3.0:1746140886.842801:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32699:x1830960573759104:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140886.842820:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.842835:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18e7 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.842861:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 29 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.842873:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.842879:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.842880:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.842883:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 29 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.842948:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.842962:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 40 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.842975:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576063872:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140886.843132:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 29 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.843141:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 29 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.843239:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576064000:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.843263:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.844780:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576063872:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140886.845037:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576064000:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140886.845059:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 29 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.845085:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cbe00, rc 0) 00000100:00100000:3.0:1746140886.845129:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+29:32699:x1830960573759104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2328us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.845138:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17030 00000100:00100000:0.0:1746140886.845732:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.845805:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573759232 00000100:00100000:2.0:1746140886.845811:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573759232 00010000:00010000:2.0:1746140886.845837:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 41 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.845871:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8817 00000100:00100000:2.0:1746140886.845877:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573759232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140886.845889:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140886.845907:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 41 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.845916:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 41 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.845935:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb7c00/0x8156357b7fdba5ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a1 expref: 41 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:2.0:1746140886.845962:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.845989:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573759232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.845995:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8817 00000100:00100000:0.0:1746140886.846188:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.846230:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573759360 00000100:00100000:3.0:1746140886.846234:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573759360 00010000:00010000:3.0:1746140886.846246:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 29 pid: 24958 timeout: 965 lvb_type: 0 00000100:00100000:3.0:1746140886.846264:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8818 00000100:00100000:3.0:1746140886.846267:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573759360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.846273:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.846281:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 29 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.846380:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 29 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.846394:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f100c00/0x8156357b7fdba5da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a188c expref: 29 pid: 24958 timeout: 965 lvb_type: 0 00010000:00010000:3.0:1746140886.846406:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.846408:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.846414:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.846422:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.846451:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140886.846463:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576064128:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140886.846525:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.847703:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576064128:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140886.847716:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.847885:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573759360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1615us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.847894:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8818 00000100:00100000:0.0:1746140886.851230:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.851368:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573759616 00000100:00100000:2.0:1746140886.851382:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573759616 00002000:00100000:2.0:1746140886.851430:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1564672->1568767) req@ffff88009abbb800 x1830960573759616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.851439:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb800 with x1830960573759616 ext(1564672->1568767) 00002000:00010000:2.0:1746140886.851445:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abbb800 00000100:00100000:2.0:1746140886.851474:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8733 00000100:00100000:2.0:1746140886.851482:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573759616:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140886.851808:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573759616:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 325us (590us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140886.851815:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8733 00002000:00100000:2.0:1746140886.851821:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1564672->1568767) req@ffff88009abbb800 x1830960573759616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.851828:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb800 with x1830960573759616 ext(1564672->1568767) 00002000:00010000:2.0:1746140886.851831:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abbb800 00000100:00100000:0.0:1746140886.853574:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.853739:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573759872 00000100:00100000:1.0:1746140886.853748:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573759872 00000100:00100000:1.0:1746140886.853805:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4723 00000100:00100000:1.0:1746140886.853813:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:32699:x1830960573759872:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140886.854155:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:32699:x1830960573759872:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 341us (588us total) trans 8589945056 rc 0/0 00000100:00100000:1.0:1746140886.854162:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4723 00000100:00100000:0.0:1746140886.857576:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.857639:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.857686:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573760128 00000100:00100000:1.0:1746140886.857695:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573760128 00000100:00100000:1.0:1746140886.857791:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573760384 00000100:00100000:1.0:1746140886.857794:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573760384 00000100:00100000:2.0:1746140886.857836:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10753 00000100:00100000:2.0:1746140886.857850:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+19:32707:x1830960573760128:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140886.857860:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10754 00000100:00100000:3.0:1746140886.857868:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:32705:x1830960573760384:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140886.857878:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.857878:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.857900:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d600/0x8156357b7fdba66d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18ee expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.857901:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cae00/0x8156357b7fdba666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18f5 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.858055:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858080:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858091:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858103:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858105:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858108:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858112:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858114:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858121:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858129:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858134:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858140:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858224:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca000/0x8156357b7fdba697 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858224:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524ce00/0x8156357b7fdba690 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858232:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca000/0x8156357b7fdba697 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858237:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca000/0x8156357b7fdba697 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858238:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524ce00/0x8156357b7fdba690 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858243:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524ce00/0x8156357b7fdba690 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140886.858245:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140886.858249:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.858350:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858357:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858363:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858394:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858399:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858404:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858405:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940ca800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140886.858407:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a524d200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.858409:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858410:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858415:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858415:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858429:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.858431:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140886.858434:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.858435:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858437:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.858439:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca800/0x8156357b7fdba67b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858440:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858444:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d200/0x8156357b7fdba674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858464:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858469:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.858473:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858474:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858479:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858484:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800940ca400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140886.858484:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858486:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858487:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a524d000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140886.858489:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858490:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858494:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858496:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388f00) 00010000:00010000:3.0:1746140886.858498:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.858501:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858504:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388f00) 00010000:00010000:3.0:1746140886.858505:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0x8156357b7fdba682 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140886.858506:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140886.858508:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140886.858513:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d000/0x8156357b7fdba689 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140886.858537:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cae00/0x8156357b7fdba666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18f5 expref: 286 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.858540:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524d600/0x8156357b7fdba66d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18ee expref: 22 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.858549:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca000/0x8156357b7fdba697 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18f5 expref: 285 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.858549:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524ce00/0x8156357b7fdba690 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18ee expref: 21 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.858555:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140886.858557:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.858559:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140886.858559:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a524ce00, rc 0) 00010000:00010000:3.0:1746140886.858561:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.858563:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940ca000, rc 0) 00000100:00100000:3.0:1746140886.858943:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:32705:x1830960573760384:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1075us (1301us total) trans 8589945058 rc 0/0 00000100:00100000:2.0:1746140886.858943:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32707:x1830960573760128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1098us (1378us total) trans 8589945057 rc 0/0 00000100:00100000:2.0:1746140886.858950:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10753 00000100:00100000:3.0:1746140886.858954:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10754 00000100:00100000:0.0:1746140886.863564:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.863625:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.863675:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.863790:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573760896 00000100:00100000:1.0:1746140886.863799:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573760896 00000100:00100000:1.0:1746140886.863854:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4724 00000100:00100000:1.0:1746140886.863862:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:32705:x1830960573760896:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140886.864102:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:32705:x1830960573760896:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 240us (424us total) trans 8589945059 rc 0/0 00000100:00100000:1.0:1746140886.864109:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4724 00000100:00100000:1.0:1746140886.864130:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573760512 00000100:00100000:1.0:1746140886.864133:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573760512 00000100:00100000:1.0:1746140886.864155:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573760640 00000100:00100000:1.0:1746140886.864157:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573760640 00000100:00100000:1.0:1746140886.864171:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 778 00000100:00100000:1.0:1746140886.864175:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573760512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.864183:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.864205:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a524ce00/0x8156357b7fdba690 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18ee expref: 21 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.864225:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140886.864229:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.864243:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1983:x1830960573760512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.864248:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 778 00000100:00100000:1.0:1746140886.864284:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 779 00000100:00100000:1.0:1746140886.864289:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:1984:x1830960573760640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.864294:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.864324:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca000/0x8156357b7fdba697 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18f5 expref: 286 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.864333:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140886.864336:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.864348:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1984:x1830960573760640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.864354:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 779 00000100:00100000:1.0:1746140886.866464:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.866948:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573761152 00000100:00100000:3.0:1746140886.866956:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573761152 00002000:00100000:3.0:1746140886.866989:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009abdf480 x1830960573761152/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.866996:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf480 with x1830960573761152 ext(1048576->2097151) 00002000:00010000:3.0:1746140886.867000:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdf480 00000100:00100000:3.0:1746140886.867022:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8734 00000100:00100000:3.0:1746140886.867026:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573761152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.867103:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.867118:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573761536 00000100:00100000:1.0:1746140886.867119:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.867122:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573761536 00000100:00100000:1.0:1746140886.867132:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573761664 00000100:00100000:1.0:1746140886.867135:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573761664 00002000:00100000:0.0:1746140886.867140:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1720319) req@ffff88009abdea00 x1830960573761536/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140886.867147:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdea00 with x1830960573761536 ext(1048576->1720319) 00002000:00010000:0.0:1746140886.867151:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdea00 00002000:00100000:1.0:1746140886.867152:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1568768->2097151) req@ffff88009abdd500 x1830960573761664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.867158:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdd500 with x1830960573761664 ext(1568768->2097151) 00002000:00010000:1.0:1746140886.867161:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdd500 00000100:00100000:0.0:1746140886.867240:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8735 00000100:00100000:0.0:1746140886.867248:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573761536:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.867262:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8736 00000100:00100000:1.0:1746140886.867267:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573761664:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140886.867978:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.868564:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573761792 00000100:00100000:2.0:1746140886.868571:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573761792 00000100:00100000:2.0:1746140886.868604:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17031 00000100:00100000:2.0:1746140886.868610:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:32705:x1830960573761792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140886.868622:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.868639:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a18fc expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.869021:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 44 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.869030:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.869034:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.869036:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140886.869039:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1912832->2002943] (req 1912832->2002943) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 44 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.869079:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 31 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.869090:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 31 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:2.0:1746140886.869101:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064256:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.869177:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 44 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.869184:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 44 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:2.0:1746140886.869191:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064384:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.869207:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140886.873002:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573761664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5722us (5869us total) trans 0 rc 528384/528384 00000100:00100000:1.0:1746140886.873014:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8736 00002000:00100000:1.0:1746140886.873025:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1568768->2097151) req@ffff88009abdd500 x1830960573761664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140886.873035:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdd500 with x1830960573761664 ext(1568768->2097151) 00002000:00010000:1.0:1746140886.873041:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdd500 00000100:00100000:2.0:1746140886.873674:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064256:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140886.874407:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064384:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140886.874436:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1912832->2002943] (req 1912832->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 44 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140886.874454:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a524ca00, rc 0) 00000100:00100000:2.0:1746140886.874488:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:32705:x1830960573761792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5878us (6510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140886.874495:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17031 00000100:00100000:3.0:1746140886.876257:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573761152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9221us (9792us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140886.876267:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8734 00002000:00100000:3.0:1746140886.876277:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009abdf480 x1830960573761152/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.876517:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf480 with x1830960573761152 ext(1048576->2097151) 00010000:00010000:3.0:1746140886.876528:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 30 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:3.0:1746140886.876541:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 30 pid: 20960 timeout: 965 lvb_type: 1 00002000:00010000:3.0:1746140886.876548:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009abdf480 00000100:00100000:0.0:1746140886.877107:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.877207:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573761920 00000100:00100000:1.0:1746140886.877215:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573761920 00010000:00010000:1.0:1746140886.877239:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 44 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:1.0:1746140886.877271:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8819 00000100:00100000:1.0:1746140886.877276:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573761920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.877287:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.877327:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 44 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.877337:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 44 pid: 20960 timeout: 965 lvb_type: 0 00010000:00010000:1.0:1746140886.877359:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb7200/0x8156357b7fdba5e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1893 expref: 44 pid: 20960 timeout: 965 lvb_type: 0 00000100:00100000:0.0:1746140886.877408:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573761536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10159us (10303us total) trans 0 rc 671744/671744 00000100:00100000:0.0:1746140886.877415:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8735 00002000:00100000:0.0:1746140886.877421:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1720319) req@ffff88009abdea00 x1830960573761536/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140886.877428:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdea00 with x1830960573761536 ext(1048576->1720319) 00002000:00010000:0.0:1746140886.877432:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdea00 00010000:00010000:1.0:1746140886.877624:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.877659:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1983:x1830960573761920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 382us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.877666:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8819 00000100:00100000:0.0:1746140886.882254:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.882379:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573762048 00000100:00100000:1.0:1746140886.882390:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573762048 00010000:00010000:1.0:1746140886.882431:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 28 pid: 20960 timeout: 965 lvb_type: 1 00000100:00100000:1.0:1746140886.882493:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8820 00000100:00100000:1.0:1746140886.882504:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573762048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.882523:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140886.882554:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 28 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.882568:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 28 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.882592:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb6000/0x8156357b7fdba5fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18af expref: 28 pid: 20960 timeout: 965 lvb_type: 1 00010000:00010000:1.0:1746140886.882631:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.882634:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140886.882642:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 42 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.882657:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 42 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.882695:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 42 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.882711:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576064512:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140886.883369:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e180 going to sleep for 11 seconds 00000100:00100000:1.0:1746140886.886489:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576064512:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140886.886489:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140886.886510:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140886.886555:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573762048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4053us (4311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.886565:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8820 00000100:00100000:2.0:1746140886.886647:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573762304 00000100:00100000:2.0:1746140886.886654:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573762304 00002000:00100000:2.0:1746140886.886697:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1912832->1916927) req@ffff88009fc35880 x1830960573762304/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.886707:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35880 with x1830960573762304 ext(1912832->1916927) 00002000:00010000:2.0:1746140886.886711:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc35880 00000100:00100000:2.0:1746140886.886738:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8737 00000100:00100000:2.0:1746140886.886745:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573762304:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140886.886955:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573762304:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 210us (475us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140886.886961:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8737 00002000:00100000:2.0:1746140886.886966:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1912832->1916927) req@ffff88009fc35880 x1830960573762304/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.886973:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35880 with x1830960573762304 ext(1912832->1916927) 00002000:00010000:2.0:1746140886.886976:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc35880 00000100:00100000:0.0:1746140886.887031:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.887151:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573762432 00000100:00100000:2.0:1746140886.887154:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573762432 00000100:00100000:2.0:1746140886.887184:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17032 00000100:00100000:2.0:1746140886.887189:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573762432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.887198:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.887274:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a524c200/0x8156357b7fdba6b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1903 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.887351:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064640:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.887571:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.888739:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.888797:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573762688 00000100:00100000:2.0:1746140886.888802:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573762688 00002000:00100000:2.0:1746140886.888826:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1998848->2002943) req@ffff88009b754e00 x1830960573762688/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.888834:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754e00 with x1830960573762688 ext(1998848->2002943) 00002000:00010000:2.0:1746140886.888837:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754e00 00000100:00100000:2.0:1746140886.888912:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8738 00000100:00100000:2.0:1746140886.888919:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573762688:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140886.889233:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573762688:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 314us (496us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140886.889239:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8738 00002000:00100000:2.0:1746140886.889245:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1998848->2002943) req@ffff88009b754e00 x1830960573762688/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.889251:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754e00 with x1830960573762688 ext(1998848->2002943) 00002000:00010000:2.0:1746140886.889254:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754e00 00000100:00100000:2.0:1746140886.889466:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064640:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.889493:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a524c200/0x8156357b7fdba6b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1903 expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.889506:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a524c200/0x8156357b7fdba6b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1903 expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.889518:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a524c200, rc 0) 00000100:00100000:2.0:1746140886.889551:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573762432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2362us (2519us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.889557:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17032 00000100:00100000:0.0:1746140886.892942:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.893037:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573762816 00000100:00100000:2.0:1746140886.893045:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573762816 00000100:00100000:2.0:1746140886.893098:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17033 00000100:00100000:2.0:1746140886.893105:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573762816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.893123:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.893140:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a524c800/0x8156357b7fdba6ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a190a expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.893203:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064768:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.893426:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.895004:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064768:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.895034:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a524c800/0x8156357b7fdba6ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a190a expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.895051:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a524c800/0x8156357b7fdba6ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a190a expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.895088:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a524c800, rc 0) 00000100:00100000:2.0:1746140886.895138:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573762816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2033us (2205us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.895145:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17033 00000100:00100000:0.0:1746140886.897886:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.898003:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573762944 00000100:00100000:2.0:1746140886.898013:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573762944 00000100:00100000:2.0:1746140886.898071:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17034 00000100:00100000:2.0:1746140886.898078:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573762944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.898094:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140886.898111:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a524c600/0x8156357b7fdba6c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1911 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140886.898162:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064896:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140886.898244:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.900446:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576064896:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.900479:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a524c600/0x8156357b7fdba6c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1911 expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.900493:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a524c600/0x8156357b7fdba6c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1911 expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.900531:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a524c600, rc 0) 00000100:00100000:2.0:1746140886.900592:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573762944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2512us (2719us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.900599:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17034 00000100:00100000:0.0:1746140886.904942:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.905021:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573763200 00000100:00100000:2.0:1746140886.905030:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573763200 00000100:00100000:2.0:1746140886.905096:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4725 00000100:00100000:2.0:1746140886.905104:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:32707:x1830960573763200:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140886.905369:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32707:x1830960573763200:12345-192.168.204.16@tcp:35:cat.0 Request processed in 253us (425us total) trans 8589945060 rc 0/0 00000100:00100000:2.0:1746140886.905376:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4725 00000100:00100000:0.0:1746140886.963632:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.963744:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573763456 00000100:00100000:3.0:1746140886.963755:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573763456 00000100:00100000:3.0:1746140886.963810:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10755 00000100:00100000:3.0:1746140886.963818:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:32713:x1830960573763456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140886.963843:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140886.963863:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e600/0x8156357b7fdba6c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1918 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.963977:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.963989:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964000:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964012:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964017:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964023:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964141:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdba6dd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964149:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdba6dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964155:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdba6dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140886.964163:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140886.964243:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964249:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964254:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964259:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8e800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.964262:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964268:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964277:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140886.964280:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.964283:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964292:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba6cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964336:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964341:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964345:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964349:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8f200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140886.964351:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964356:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964362:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388d00) 00010000:00010000:3.0:1746140886.964364:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140886.964366:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964369:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f200/0x8156357b7fdba6d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140886.964406:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e600/0x8156357b7fdba6c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1918 expref: 288 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.964417:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdba6dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1918 expref: 287 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.964427:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.964429:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140886.964431:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8fe00, rc 0) 00000100:00100000:3.0:1746140886.964496:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:32713:x1830960573763456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 678us (873us total) trans 8589945061 rc 0/0 00000100:00100000:3.0:1746140886.964503:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10755 00000100:00100000:0.0:1746140886.969426:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.969465:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.969512:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.969541:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573763584 00000100:00100000:2.0:1746140886.969548:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573763840 00000100:00100000:0.0:1746140886.969549:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573763584 00000100:00100000:2.0:1746140886.969553:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573763840 00000100:00100000:2.0:1746140886.969600:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17035 00000100:00100000:2.0:1746140886.969608:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573763840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140886.969625:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140886.969630:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573763712 00000100:00100000:1.0:1746140886.969633:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573763712 00010000:00010000:2.0:1746140886.969641:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a524c400/0x8156357b7fdba6eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1926 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.969670:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 780 00000100:00100000:1.0:1746140886.969676:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1982:x1830960573763712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140886.969686:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140886.969698:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576065024:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140886.969705:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdba6dd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1918 expref: 287 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.969734:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140886.969738:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140886.969784:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.969785:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17036 00000100:00100000:0.0:1746140886.969791:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573763584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140886.969799:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140886.969810:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4dde600/0x8156357b7fdba6f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a191f expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140886.969849:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:1982:x1830960573763712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 172us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.969856:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 780 00000100:00100000:1.0:1746140886.969986:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576065152:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140886.970023:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140886.971525:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576065024:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140886.971554:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a524c400/0x8156357b7fdba6eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1926 expref: 41 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.971571:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a524c400/0x8156357b7fdba6eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1926 expref: 41 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140886.971598:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a524c400, rc 0) 00000100:00100000:2.0:1746140886.971642:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573763840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2035us (2128us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140886.971649:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17035 00000100:00100000:1.0:1746140886.973365:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576065152:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140886.973393:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4dde600/0x8156357b7fdba6f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a191f expref: 44 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140886.973402:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4dde600/0x8156357b7fdba6f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a191f expref: 44 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140886.973410:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4dde600, rc 0) 00000100:00100000:1.0:1746140886.973461:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573763584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3670us (3995us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140886.973466:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17036 00000100:00100000:2.0:1746140886.973561:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.973613:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573764096 00000100:00100000:0.0:1746140886.973620:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573764096 00000100:00100000:0.0:1746140886.973654:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10756 00000100:00100000:0.0:1746140886.973659:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+21:32715:x1830960573764096:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140886.973677:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140886.973691:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba6f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a192d expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140886.973796:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.973809:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.973819:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.973829:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.973834:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.973838:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.973945:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfc00/0x8156357b7fdba70e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.973954:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfc00/0x8156357b7fdba70e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.973960:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfc00/0x8156357b7fdba70e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:0.0:1746140886.973968:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140886.974789:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.974797:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.974803:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.974811:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddee00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140886.974814:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.974819:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.974828:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140886.974870:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140886.974875:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.974879:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddee00/0x8156357b7fdba700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.975157:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.975163:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.975167:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.975171:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddfe00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140886.975174:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.975179:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.975185:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871300) 00010000:00010000:0.0:1746140886.975187:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140886.975190:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140886.975194:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfe00/0x8156357b7fdba707 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140886.975367:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddec00/0x8156357b7fdba6f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a192d expref: 24 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.975381:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfc00/0x8156357b7fdba70e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a192d expref: 23 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.975387:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140886.975389:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746140886.975391:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ddfc00, rc 0) 00000100:00100000:1.0:1746140886.975446:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:32715:x1830960573764096:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1785us (1887us total) trans 8589945062 rc 0/0 00000100:00100000:1.0:1746140886.975457:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10756 00000100:00100000:0.0:1746140886.977883:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.977947:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573764224 00000100:00100000:3.0:1746140886.977956:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573764224 00000100:00100000:3.0:1746140886.978013:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 781 00000100:00100000:3.0:1746140886.978020:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573764224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.978035:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.978055:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddfc00/0x8156357b7fdba70e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a192d expref: 23 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.978092:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140886.978095:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140886.978222:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573764224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 200us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140886.978228:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 781 00000100:00100000:0.0:1746140886.980360:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140886.980390:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573764480 00000100:00100000:2.0:1746140886.980398:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573764480 00002000:00100000:2.0:1746140886.980439:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc08e00 x1830960573764480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 504/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.980449:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08e00 with x1830960573764480 ext(1048576->2097151) 00002000:00010000:2.0:1746140886.980454:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc08e00 00000100:00100000:2.0:1746140886.980488:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8739 00000100:00100000:2.0:1746140886.980495:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1983:x1830960573764480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140886.981207:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.981413:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573764608 00000100:00100000:1.0:1746140886.981418:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573764608 00000100:00100000:1.0:1746140886.981447:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17037 00000100:00100000:1.0:1746140886.981453:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32715:x1830960573764608:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140886.981463:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140886.981478:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1934 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.981502:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 44 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.981508:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140886.981510:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140886.981513:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1441792->1589247] (req 1441792->1589247) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.981538:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 44 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.981549:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 44 pid: 32377 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140886.981560:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576065280:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140886.981633:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e180 going to sleep for 11 seconds 00000100:00100000:0.0:1746140886.986380:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.986712:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576065280:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140886.986744:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1441792->1589247] (req 1441792->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.986763:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bae2000, rc 0) 00000100:00100000:1.0:1746140886.986810:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32715:x1830960573764608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5356us (5603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.986819:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17037 00000100:00100000:3.0:1746140886.986938:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573764736 00000100:00100000:3.0:1746140886.986945:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573764736 00002000:00100000:3.0:1746140886.986977:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1912832->2002943) req@ffff88009f2c2a00 x1830960573764736/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.986986:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2a00 with x1830960573764736 ext(1912832->2002943) 00010000:00010000:3.0:1746140886.986992:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 45 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140886.987004:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 45 pid: 32377 timeout: 966 lvb_type: 0 00002000:00010000:3.0:1746140886.987010:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c2a00 00000100:00100000:3.0:1746140886.987035:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1809 00000100:00100000:3.0:1746140886.987041:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1984:x1830960573764736:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140886.987619:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573764480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7123us (7265us total) trans 0 rc 958464/958464 00000100:00100000:2.0:1746140886.987627:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8739 00002000:00100000:2.0:1746140886.987633:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc08e00 x1830960573764480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 504/440 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140886.987640:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08e00 with x1830960573764480 ext(1048576->2097151) 00010000:00010000:2.0:1746140886.987644:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 45 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140886.987655:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 45 pid: 32377 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140886.987660:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc08e00 00000100:00100000:3.0:1746140886.989236:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1984:x1830960573764736:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2187us (2860us total) trans 17179874132 rc 0/0 00000100:00100000:3.0:1746140886.989247:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1809 00002000:00100000:3.0:1746140886.989257:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1912832->2002943) req@ffff88009f2c2a00 x1830960573764736/t17179874132(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140886.989266:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2a00 with x1830960573764736 ext(1912832->2002943) 00010000:00010000:3.0:1746140886.989275:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 45 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140886.989290:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 45 pid: 32377 timeout: 966 lvb_type: 0 00002000:00010000:3.0:1746140886.989296:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c2a00 00000100:00100000:0.0:1746140886.995252:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.995400:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140886.995509:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573764864 00000100:00100000:1.0:1746140886.995518:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573764864 00000100:00100000:1.0:1746140886.995571:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17038 00000100:00100000:1.0:1746140886.995579:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:32713:x1830960573764864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140886.995597:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140886.995614:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a193b expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.995646:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.995654:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140886.995655:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140886.995659:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 46 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.995689:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.995700:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 27 pid: 32377 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140886.995713:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576065408:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140886.995799:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e180 going to sleep for 11 seconds 00000100:00100000:3.0:1746140886.996037:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573764992 00000100:00100000:3.0:1746140886.996041:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573764992 00010000:00010000:3.0:1746140886.996072:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 47 pid: 32377 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140886.996106:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8821 00000100:00100000:3.0:1746140886.996111:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1982:x1830960573764992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140886.996120:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140886.996140:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 47 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140886.996150:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 47 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140886.996168:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a524ca00/0x8156357b7fdba6ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18fc expref: 47 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140886.996188:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.996190:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140886.996199:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.996207:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140886.996226:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140886.996234:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576065536:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140886.996265:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb900 going to sleep for 11 seconds 00000100:00100000:1.0:1746140886.998432:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576065408:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140886.998457:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 46 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140886.998472:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83e00, rc 0) 00000100:00100000:1.0:1746140886.998514:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:32713:x1830960573764864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2936us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140886.998522:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17038 00000100:00100000:0.0:1746140886.999928:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140886.999970:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140886.999997:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576065536:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.000012:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.000042:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573764992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3930us (4641us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.000051:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8821 00000100:00100000:2.0:1746140887.000081:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573765120 00000100:00100000:2.0:1746140887.000094:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573765120 00002000:00100000:2.0:1746140887.000135:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1720320->2097151) req@ffff88009f170380 x1830960573765120/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.000145:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170380 with x1830960573765120 ext(1720320->2097151) 00010000:00010000:2.0:1746140887.000153:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 28 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.000167:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 28 pid: 32377 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140887.000174:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f170380 00000100:00100000:2.0:1746140887.000206:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573765376 00000100:00100000:2.0:1746140887.000209:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573765376 00002000:00100000:2.0:1746140887.000220:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1441792->1445887) req@ffff88009f170a80 x1830960573765376/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/0 e 0 to 0 dl 1746140897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.000226:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170a80 with x1830960573765376 ext(1441792->1445887) 00002000:00010000:2.0:1746140887.000229:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f170a80 00000100:00100000:2.0:1746140887.000239:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1810 00000100:00100000:2.0:1746140887.000245:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573765120:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140887.000768:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8740 00000100:00100000:1.0:1746140887.000787:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573765376:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140887.000941:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573765376:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 165us (970us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140887.000947:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8740 00002000:00100000:1.0:1746140887.000953:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1441792->1445887) req@ffff88009f170a80 x1830960573765376/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746140897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.000961:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170a80 with x1830960573765376 ext(1441792->1445887) 00002000:00010000:1.0:1746140887.000966:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f170a80 00000100:00080000:1.0:1746140887.000983:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746140887.003725:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.003821:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573765632 00000100:00100000:1.0:1746140887.003829:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573765632 00002000:00100000:1.0:1746140887.003866:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1585152->1589247) req@ffff88009f121f80 x1830960573765632/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.003878:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121f80 with x1830960573765632 ext(1585152->1589247) 00002000:00010000:1.0:1746140887.003883:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f121f80 00000100:00100000:1.0:1746140887.003906:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8741 00000100:00100000:1.0:1746140887.003912:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573765632:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140887.004893:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573765632:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 978us (1173us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140887.004900:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8741 00002000:00100000:1.0:1746140887.004906:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1585152->1589247) req@ffff88009f121f80 x1830960573765632/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.004913:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121f80 with x1830960573765632 ext(1585152->1589247) 00002000:00010000:1.0:1746140887.004916:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f121f80 00000100:00100000:2.0:1746140887.006284:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573765120:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6034us (6354us total) trans 17179874133 rc 0/0 00000100:00100000:2.0:1746140887.006292:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1810 00002000:00100000:2.0:1746140887.006298:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1720320->2097151) req@ffff88009f170380 x1830960573765120/t17179874133(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:302/0 lens 488/448 e 0 to 0 dl 1746140897 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.006321:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170380 with x1830960573765120 ext(1720320->2097151) 00010000:00010000:2.0:1746140887.006329:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.006344:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140887.006350:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f170380 00000100:00100000:0.0:1746140887.006581:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.006625:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573765888 00000100:00100000:1.0:1746140887.006631:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573765888 00000100:00100000:1.0:1746140887.006672:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4726 00000100:00100000:1.0:1746140887.006677:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:32715:x1830960573765888:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140887.006856:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:32715:x1830960573765888:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 178us (275us total) trans 8589945063 rc 0/0 00000100:00100000:1.0:1746140887.006862:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4726 00000100:00100000:0.0:1746140887.008166:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.008245:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573766016 00000100:00100000:3.0:1746140887.008250:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573766016 00010000:00010000:3.0:1746140887.009394:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.009438:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8822 00000100:00100000:3.0:1746140887.009446:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573766016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.009460:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.009482:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.009493:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.009513:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940cbc00/0x8156357b7fdba658 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e0 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.009537:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.009539:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.009546:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 44 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.009558:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 44 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.009596:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 44 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.009609:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576065664:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.009705:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140887.011419:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576065664:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.011438:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.011482:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573766016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2036us (3317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.011493:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8822 00000100:00100000:0.0:1746140887.012011:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.013157:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573766272 00000100:00100000:2.0:1746140887.013166:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573766272 00002000:00100000:2.0:1746140887.013214:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f171500 x1830960573766272/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.013224:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171500 with x1830960573766272 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.013229:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f171500 00000100:00100000:2.0:1746140887.013245:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8742 00000100:00100000:2.0:1746140887.013251:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1984:x1830960573766272:12345-192.168.204.16@tcp:3:cat.0 00000100:00080000:0.0:1746140887.013286:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746140887.020203:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1984:x1830960573766272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6941us (8182us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.020215:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8742 00002000:00100000:2.0:1746140887.020229:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f171500 x1830960573766272/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.020239:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171500 with x1830960573766272 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.020245:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f171500 00000100:00100000:0.0:1746140887.022753:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.023139:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573766400 00000100:00100000:1.0:1746140887.023149:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573766400 00000100:00080000:0.0:1746140887.023209:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746140887.023231:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17039 00000100:00100000:1.0:1746140887.023241:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:32713:x1830960573766400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.023261:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.023283:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1942 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.023356:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.023363:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140887.023365:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140887.023369:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.023403:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.023415:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 27 pid: 32377 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.023427:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576065792:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.023535:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.025360:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.025363:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576065792:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.025383:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 41 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.025396:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83a00, rc 0) 00000100:00100000:1.0:1746140887.025427:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:32713:x1830960573766400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2190us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.025433:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17039 00000100:00100000:2.0:1746140887.025436:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573766528 00000100:00100000:2.0:1746140887.025442:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573766528 00002000:00100000:2.0:1746140887.025478:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1568767) req@ffff88009f173800 x1830960573766528/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.025487:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173800 with x1830960573766528 ext(1048576->1568767) 00010000:00010000:2.0:1746140887.025493:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 28 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.025505:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 28 pid: 32377 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140887.025510:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f173800 00000100:00100000:2.0:1746140887.025533:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1811 00000100:00100000:2.0:1746140887.025540:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573766528:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140887.032752:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573766528:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7199us (7384us total) trans 21474841417 rc 0/0 00000100:00100000:2.0:1746140887.032767:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1811 00002000:00100000:2.0:1746140887.032779:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1568767) req@ffff88009f173800 x1830960573766528/t21474841417(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.032788:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173800 with x1830960573766528 ext(1048576->1568767) 00010000:00010000:2.0:1746140887.032796:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.032811:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140887.032816:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f173800 00000100:00100000:0.0:1746140887.035475:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.035595:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573766656 00000100:00100000:3.0:1746140887.035604:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573766656 00010000:00010000:3.0:1746140887.035652:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.035688:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8823 00000100:00100000:3.0:1746140887.035695:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1983:x1830960573766656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.035710:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.035731:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.035747:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.035769:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940cbe00/0x8156357b7fdba65f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18e7 expref: 30 pid: 32377 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.035799:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.035801:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.035808:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.035817:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.035852:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.035863:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576065920:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.035943:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140887.037431:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576065920:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.037450:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.037481:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1983:x1830960573766656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1786us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.037490:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8823 00000100:00100000:0.0:1746140887.039331:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.039382:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573766912 00000100:00100000:2.0:1746140887.039391:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573766912 00002000:00100000:3.0:1746140887.039763:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f171f80 x1830960573766912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.039777:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171f80 with x1830960573766912 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.039783:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f171f80 00000100:00100000:3.0:1746140887.039811:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8743 00000100:00100000:3.0:1746140887.039819:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573766912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140887.045809:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573766912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5980us (6498us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.045821:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8743 00002000:00100000:3.0:1746140887.045832:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f171f80 x1830960573766912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.045841:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171f80 with x1830960573766912 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.045847:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f171f80 00000100:00100000:0.0:1746140887.053361:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.053519:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573767040 00000100:00100000:1.0:1746140887.053530:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573767040 00000100:00100000:1.0:1746140887.053582:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17040 00000100:00100000:1.0:1746140887.053589:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573767040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.053607:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.053624:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc82000/0x8156357b7fdba731 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1949 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.053678:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576066048:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140887.053765:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.055288:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576066048:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.055350:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc82000/0x8156357b7fdba731 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1949 expref: 46 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.055364:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc82000/0x8156357b7fdba731 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1949 expref: 46 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.055392:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82000, rc 0) 00000100:00100000:1.0:1746140887.055440:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573767040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1851us (2086us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140887.055447:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17040 00000100:00100000:0.0:1746140887.057371:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.057458:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573767168 00000100:00100000:1.0:1746140887.057466:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573767168 00000100:00100000:1.0:1746140887.057521:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17041 00000100:00100000:1.0:1746140887.057529:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573767168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.057545:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.057561:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc83000/0x8156357b7fdba738 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1950 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.057615:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576066176:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140887.057701:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.059485:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576066176:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.059515:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83000/0x8156357b7fdba738 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1950 expref: 46 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.059527:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83000/0x8156357b7fdba738 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1950 expref: 46 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.059585:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83000, rc 0) 00000100:00100000:1.0:1746140887.059642:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573767168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2112us (2280us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140887.059649:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17041 00000100:00100000:0.0:1746140887.061636:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.061755:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573767296 00000100:00100000:1.0:1746140887.061766:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573767296 00000100:00100000:1.0:1746140887.061875:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17042 00000100:00100000:1.0:1746140887.061884:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573767296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.062197:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.062213:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba73f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1957 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.062263:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576066304:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140887.062508:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.066686:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576066304:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.066724:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba73f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1957 expref: 46 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.066739:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba73f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1957 expref: 46 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.067085:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83400, rc 0) 00000100:00100000:1.0:1746140887.067145:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573767296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5261us (5514us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140887.067154:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17042 00000100:00100000:0.0:1746140887.071029:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.071129:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573767552 00000100:00100000:2.0:1746140887.071139:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573767552 00000100:00100000:2.0:1746140887.071196:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4727 00000100:00100000:2.0:1746140887.071205:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:32713:x1830960573767552:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140887.071448:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:32713:x1830960573767552:12345-192.168.204.16@tcp:35:cat.0 Request processed in 245us (429us total) trans 8589945064 rc 0/0 00000100:00100000:2.0:1746140887.071455:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4727 00000100:00100000:0.0:1746140887.081581:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.081692:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573767680 00000100:00100000:1.0:1746140887.081703:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573767680 00000100:00100000:1.0:1746140887.081770:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10757 00000100:00100000:1.0:1746140887.081779:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32719:x1830960573767680:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140887.081805:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.081823:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83800/0x8156357b7fdba746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a195e expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.081891:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.081903:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.081914:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.081927:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.081933:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.081939:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.082056:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.082079:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 286 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.082085:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.082117:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 286 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.082127:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 286 pid: 14742 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.082141:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576066432:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.082693:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b435e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.083666:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.083700:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576066432:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.083713:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140887.083730:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573767936 00000100:00100000:2.0:1746140887.083736:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573767936 00000100:00100000:2.0:1746140887.083777:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4728 00000100:00100000:2.0:1746140887.083783:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:7722:x1830960573767936:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746140887.083977:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:7722:x1830960573767936:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 193us (312us total) trans 8589945065 rc 0/0 00000100:00100000:2.0:1746140887.083983:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4728 00000100:00100000:0.0:1746140887.084745:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.084819:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573768064 00000100:00100000:3.0:1746140887.084824:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573768064 00010000:00010000:3.0:1746140887.084848:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 288 pid: 14742 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.085014:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8824 00000100:00100000:3.0:1746140887.085026:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:1984:x1830960573768064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.085036:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.085041:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 288 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.085051:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 288 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.085086:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356bc600/0x8156357b7fdba60b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18b6 expref: 288 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.085117:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140887.085122:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.085131:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.085138:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085481:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.085487:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.085487:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140887.085517:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1984:x1830960573768064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 497us (774us total) trans 0 rc 0/0 00000004:00200000:0.0:1746140887.085523:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:3.0:1746140887.085524:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8824 00000004:00200000:0.0:1746140887.085527:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140887.085541:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085551:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085562:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085574:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085580:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085586:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc82200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.085591:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085596:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085605:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140887.085607:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140887.085610:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085618:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82200/0x8156357b7fdba74d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085645:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085649:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085654:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085658:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc82600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.085660:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085664:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085671:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4d400) 00010000:00010000:0.0:1746140887.085673:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140887.085675:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085679:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82600/0x8156357b7fdba754 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.085706:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83800/0x8156357b7fdba746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.085717:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.085726:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140887.085727:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140887.085729:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82e00, rc 0) 00000100:00100000:0.0:1746140887.085908:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32719:x1830960573767680:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4131us (4337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.085915:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10757 00000100:00100000:0.0:1746140887.088148:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.088197:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.088268:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573768192 00000100:00100000:2.0:1746140887.088277:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573768192 00000100:00100000:1.0:1746140887.088344:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573768448 00000100:00100000:1.0:1746140887.088356:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573768448 00000100:00100000:2.0:1746140887.088420:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17043 00000100:00100000:2.0:1746140887.088438:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+15:1983:x1830960573768192:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746140887.088441:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17044 00000100:00100000:1.0:1746140887.088450:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+15:1983:x1830960573768448:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140887.088458:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.088467:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.088474:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e32800/0x8156357b7fdba762 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1965 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.088480:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1973 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.088503:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.088505:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.088513:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 16 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140887.088531:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576066560:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.088533:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 16 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.088543:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83000, rc 0) 00000100:00100000:2.0:1746140887.088601:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409bf00 going to sleep for 11 seconds 00000100:00080000:0.0:1746140887.088662:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746140887.088666:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746140887.089170:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573768448:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 720us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.089172:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.089178:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17044 00000100:00100000:0.0:1746140887.089453:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573768320 00000100:00100000:0.0:1746140887.089458:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573768320 00000100:00100000:2.0:1746140887.089478:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.089517:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573768576 00000100:00100000:1.0:1746140887.089522:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573768576 00000100:00100000:1.0:1746140887.089543:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17045 00000100:00100000:1.0:1746140887.089548:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+16:1983:x1830960573768576:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140887.089556:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140887.089566:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17046 00010000:00010000:1.0:1746140887.089566:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a197a expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.089574:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+17:1983:x1830960573768320:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140887.089581:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.089583:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.089584:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.089588:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 17 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.089595:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a196c expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.089599:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 17 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.089607:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82000, rc 0) 00010000:00010000:3.0:1746140887.089610:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.089612:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.089619:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 18 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140887.089634:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+17:1983:x1830960573768576:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 85us (155us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.089638:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 18 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140887.089640:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17045 00010000:00010000:3.0:1746140887.089647:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e000, rc 0) 00000100:00100000:3.0:1746140887.089670:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+18:1983:x1830960573768320:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 97us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.090137:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576066560:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140887.090160:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e32800/0x8156357b7fdba762 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1965 expref: 18 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.090169:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e32800/0x8156357b7fdba762 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1965 expref: 18 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.090188:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e32800, rc 0) 00000100:00100000:2.0:1746140887.090208:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+17:1983:x1830960573768192:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1773us (2071us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140887.090230:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17046 00000100:00100000:2.0:1746140887.090286:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17043 00000100:00100000:0.0:1746140887.091832:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.091943:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573768832 00000100:00100000:2.0:1746140887.091952:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573768832 00000100:00100000:2.0:1746140887.092002:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10758 00000100:00100000:2.0:1746140887.092009:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32719:x1830960573768832:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140887.092033:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.092069:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32c00/0x8156357b7fdba77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1981 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.092189:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.092206:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.092213:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.092254:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.092267:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.092281:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576066688:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.092421:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b409bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.093719:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576066688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.093744:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140887.093962:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.094102:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573768960 00000100:00100000:3.0:1746140887.094116:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573768960 00010000:00010000:3.0:1746140887.094165:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 11 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.094222:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8825 00000100:00100000:3.0:1746140887.094231:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573768960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.094245:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.094251:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 11 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.094262:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 11 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.094283:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82e00/0x8156357b7fdba75b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a195e expref: 11 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.094343:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140887.094349:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.094359:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.094458:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.094481:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.094538:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573768960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 308us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.094544:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8825 00010000:00010000:2.0:1746140887.094613:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.094622:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140887.094645:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140887.094809:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32c00/0x8156357b7fdba77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.094826:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.094833:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140887.094836:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140887.094839:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e32400, rc 0) 00000100:00100000:2.0:1746140887.094892:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:32719:x1830960573768832:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2884us (3068us total) trans 8589945066 rc 0/0 00000100:00100000:2.0:1746140887.094900:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10758 00000100:00100000:0.0:1746140887.096502:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.096581:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573769088 00000100:00100000:2.0:1746140887.096589:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573769088 00000100:00100000:2.0:1746140887.096623:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10759 00000100:00100000:2.0:1746140887.096628:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:32719:x1830960573769088:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140887.096646:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.096662:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33000/0x8156357b7fdba793 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1988 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.096821:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.096835:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.096842:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.096873:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.096884:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 11 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.096895:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576066816:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.097375:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.100090:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576066816:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.100120:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140887.100784:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.100887:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573769216 00000100:00100000:3.0:1746140887.100895:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573769216 00010000:00010000:3.0:1746140887.100939:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 12 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.100986:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8826 00000100:00100000:3.0:1746140887.100994:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573769216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.101011:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.101016:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 12 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.101025:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 12 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.101048:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32400/0x8156357b7fdba785 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1981 expref: 12 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.101080:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140887.101086:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.101096:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.101102:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.101202:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.101250:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573769216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 253us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.101257:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8826 00010000:00010000:2.0:1746140887.101341:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.101348:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140887.101399:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140887.101403:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746140887.101424:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.101464:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33000/0x8156357b7fdba793 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1988 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.101477:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1988 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.101484:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140887.101486:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140887.101489:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e33200, rc 0) 00000100:00100000:2.0:1746140887.101521:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:32719:x1830960573769088:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4892us (5023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.101527:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10759 00000100:00100000:0.0:1746140887.103093:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.103418:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573769344 00000100:00100000:2.0:1746140887.103425:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573769344 00000100:00100000:2.0:1746140887.103472:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17047 00000100:00100000:2.0:1746140887.103478:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573769344:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140887.103494:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.103509:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e33600/0x8156357b7fdba7a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a198f expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.103558:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576066944:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140887.103647:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.104784:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576066944:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140887.104809:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e33600/0x8156357b7fdba7a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a198f expref: 17 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.104818:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e33600/0x8156357b7fdba7a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a198f expref: 17 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.104827:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e33600, rc 0) 00000100:00100000:2.0:1746140887.104866:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+16:1984:x1830960573769344:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1387us (1775us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140887.104872:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17047 00000100:00100000:0.0:1746140887.105907:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.105960:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573769600 00000100:00100000:2.0:1746140887.105967:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573769600 00000100:00100000:2.0:1746140887.106000:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10760 00000100:00100000:2.0:1746140887.106005:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:32719:x1830960573769600:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140887.106018:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.106032:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33800/0x8156357b7fdba7a8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1996 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.106120:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba7af lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.106132:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba7af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.106142:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba7af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140887.106151:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140887.106252:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33800/0x8156357b7fdba7a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1996 expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.106266:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba7af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1996 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.106273:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140887.106276:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140887.106278:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e33a00, rc 0) 00000100:00100000:2.0:1746140887.106343:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:32719:x1830960573769600:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 337us (441us total) trans 8589945067 rc 0/0 00000100:00100000:2.0:1746140887.106349:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10760 00000100:00100000:2.0:1746140887.107588:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.107628:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.107656:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.107686:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.107702:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573769856 00000100:00100000:3.0:1746140887.107707:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573770112 00000100:00100000:2.0:1746140887.107708:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573769856 00000100:00100000:3.0:1746140887.107711:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573770112 00000100:00100000:2.0:1746140887.107802:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573770368 00000100:00100000:2.0:1746140887.107806:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573770368 00000100:00100000:3.0:1746140887.107807:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573769728 00000100:00100000:3.0:1746140887.107809:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573769728 00000100:00100000:0.0:1746140887.107811:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17048 00000100:00100000:0.0:1746140887.107818:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573769856:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:2.0:1746140887.107822:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17049 00000100:00100000:2.0:1746140887.107826:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+18:1984:x1830960573770112:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:3.0:1746140887.107832:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17050 00000100:00100000:3.0:1746140887.107837:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573770368:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746140887.107850:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.107851:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.107854:0:8459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.107863:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.107864:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.107865:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 17 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.107871:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 18 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.107872:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 44 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.107875:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.107875:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140887.107876:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.107876:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140887.107878:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.107879:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.107879:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.107887:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.107888:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.107890:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.107901:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 18 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.107901:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.107904:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.107911:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 18 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.107911:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 28 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.107912:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 28 pid: 8460 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.107922:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576067328:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.107922:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576067072:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.107924:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576067200:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.107965:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17051 00000100:00100000:0.0:1746140887.107968:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.107970:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+18:1984:x1830960573769728:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746140887.107987:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.107996:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 18 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.108002:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 40 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.108009:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 28 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.108014:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.108015:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.108017:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.108031:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 44 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.108033:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 28 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.108039:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 44 pid: 4785 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.108040:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 28 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.108046:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576067456:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.108052:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576067584:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.108082:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 17 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.108089:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 17 pid: 20960 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.108093:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 40 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.108101:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 40 pid: 4785 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.108102:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576067712:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.108108:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576067840:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.108118:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00010000:00010000:2.0:1746140887.108130:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 18 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.108137:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 18 pid: 4784 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.108143:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576067968:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.108158:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.108158:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.108171:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573769984 00000100:00100000:3.0:1746140887.108175:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573769984 00010000:00010000:2.0:1746140887.108184:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.108190:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17052 00010000:00010000:2.0:1746140887.108192:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 40 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.108194:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+18:1984:x1830960573769984:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:2.0:1746140887.108199:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576068096:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.108200:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140887.108209:0:9872:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.108210:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573770240 00000100:00100000:0.0:1746140887.108213:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573770240 00010000:00010000:3.0:1746140887.108219:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 44 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.108219:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7300 going to sleep for 11 seconds 00010000:00010000:3.0:1746140887.108225:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 18 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.108229:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.108231:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.108233:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.108236:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17053 00000100:00100000:0.0:1746140887.108241:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+19:1984:x1830960573770240:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746140887.108245:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 18 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.108252:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 18 pid: 9872 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.108255:0:20960:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.108263:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576068224:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.108265:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.108271:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 19 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.108278:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.108284:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.108285:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.108287:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.108298:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 44 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.108301:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 40 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.108321:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 44 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.108328:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576068352:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.108331:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 40 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.108339:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576068480:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.108350:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00010000:00010000:0.0:1746140887.108364:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 19 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.108370:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 19 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.108376:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576068608:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.108394:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.108405:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.108412:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576068736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.108430:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1000 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.108853:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576067200:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.109157:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576067072:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.109173:0:32377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.114285:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576067328:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.114286:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.114298:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576067712:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.114340:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.114352:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573770624 00000100:00100000:3.0:1746140887.114358:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573770624 00000100:00100000:3.0:1746140887.114371:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573770496 00000100:00100000:3.0:1746140887.114372:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573770496 00010000:00010000:3.0:1746140887.114398:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 20 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.114410:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576068096:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.114434:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8827 00010000:00010000:1.0:1746140887.114441:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.114442:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+20:1984:x1830960573770496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.114455:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140887.114464:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576067584:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.114475:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576067840:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.114479:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 20 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.114483:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576067968:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.114487:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140887.114495:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 20 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.114500:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.114500:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573770752 00000100:00100000:1.0:1746140887.114503:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573770752 00010000:00010000:3.0:1746140887.114517:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83000/0x8156357b7fdba769 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1973 expref: 21 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.114517:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 21 pid: 4784 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.114534:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140887.114541:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8828 00000100:00100000:1.0:1746140887.114547:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+20:1983:x1830960573770752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.114554:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.114565:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 20 pid: 4784 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.114569:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+20:1984:x1830960573770496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 127us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140887.114572:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 20 pid: 4784 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.114575:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8827 00010000:00010000:1.0:1746140887.114584:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba237 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16a9 expref: 20 pid: 4784 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.114599:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576067456:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.114610:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140887.114617:0:8459:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.114631:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.114640:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+18:1983:x1830960573770752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.114646:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8828 00002000:00100000:3.0:1746140887.114651:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1441792->1589247) req@ffff88012b06aa00 x1830960573770624/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746140887.114656:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573771136 00002000:00100000:3.0:1746140887.114659:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06aa00 with x1830960573770624 ext(1441792->1589247) 00000100:00100000:1.0:1746140887.114659:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573771136 00010000:00010000:3.0:1746140887.114665:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 29 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.114668:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 41 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.114674:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 29 pid: 20960 timeout: 966 lvb_type: 0 00002000:00010000:3.0:1746140887.114680:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b06aa00 00000100:00100000:1.0:1746140887.114691:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8829 00000100:00100000:1.0:1746140887.114696:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1983:x1830960573771136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140887.114701:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1812 00010000:00010000:1.0:1746140887.114702:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140887.114706:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573770624:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:1.0:1746140887.114709:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 41 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.114713:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140887.114717:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 41 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.114728:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83a00/0x8156357b7fdba72a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1942 expref: 41 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.114729:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573770880 00000100:00100000:2.0:1746140887.114732:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573770880 00010000:00010000:1.0:1746140887.114736:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.114739:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.114743:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.114745:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 19 pid: 20960 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.114751:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.114766:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.114768:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8830 00000100:00100000:2.0:1746140887.114772:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+19:1983:x1830960573770880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.114779:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140887.114786:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.114788:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1983:x1830960573771136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (163us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140887.114789:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 19 pid: 20960 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.114793:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8829 00000100:00100000:0.0:1746140887.114794:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573771264 00010000:00010000:2.0:1746140887.114796:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 19 pid: 20960 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.114800:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573771264 00010000:00010000:2.0:1746140887.114807:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a62c600/0x8156357b7fdba24c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16cc expref: 19 pid: 20960 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.114822:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 40 pid: 4785 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.114824:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140887.114833:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.114839:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8831 00000100:00100000:2.0:1746140887.114840:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+18:1983:x1830960573770880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140887.114840:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.114843:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573771264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140887.114846:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8830 00010000:00010000:0.0:1746140887.114851:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.114858:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.114864:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 40 pid: 4785 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.114865:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.114872:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.114872:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 40 pid: 4785 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.114878:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e33c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140887.114882:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.114885:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba2ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16fd expref: 40 pid: 4785 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.114889:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.114898:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.114900:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140887.114902:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e33c00/0x8156357b7fdba7c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.114922:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1982:x1830960573771264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.114926:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8831 00000100:00100000:1.0:1746140887.114936:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573770112:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 7109us (7307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.114942:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17049 00000100:00100000:1.0:1746140887.114994:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576068480:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.114999:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576068224:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.114999:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.115002:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576068608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.115008:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576068352:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.115012:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573771008 00000100:00100000:0.0:1746140887.115012:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.115013:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573771008 00000100:00100000:0.0:1746140887.115018:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573771776 00010000:00010000:3.0:1746140887.115020:0:9872:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.115020:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573771776 00010000:00010000:1.0:1746140887.115022:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 29 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.115029:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 45 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.115043:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8832 00000100:00100000:1.0:1746140887.115048:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573771008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140887.115050:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8833 00000100:00100000:0.0:1746140887.115053:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573771776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.115071:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.115080:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 45 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.115086:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 45 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.115090:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.115094:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83e00/0x8156357b7fdba723 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a193b expref: 45 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.115098:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 29 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.115100:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140887.115110:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 29 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.115111:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573771776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.115116:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8833 00010000:00010000:1.0:1746140887.115121:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5216400/0x8156357b7fdba2bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16da expref: 29 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.115128:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.115129:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.115131:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.115132:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140887.115137:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.115144:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.115156:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573771648 00000100:00100000:2.0:1746140887.115160:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573771648 00000100:00100000:0.0:1746140887.115164:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140887.115171:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 31 pid: 8460 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.115181:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573771520 00000100:00100000:3.0:1746140887.115184:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573771520 00000100:00100000:2.0:1746140887.115188:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8834 00000100:00100000:2.0:1746140887.115192:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573771648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.115196:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 17 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.115198:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.115204:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 31 pid: 8460 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.115208:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8835 00000100:00100000:3.0:1746140887.115212:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+17:1982:x1830960573771520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.115212:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 31 pid: 8460 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.115218:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.115222:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc82400/0x8156357b7fdba2ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a16ef expref: 31 pid: 8460 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.115223:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140887.115226:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 17 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.115229:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140887.115233:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 17 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.115238:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573771008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 190us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.115240:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573771648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (106us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.115242:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc82000/0x8156357b7fdba770 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a197a expref: 17 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.115244:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8832 00000100:00100000:2.0:1746140887.115246:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8834 00010000:00010000:3.0:1746140887.115250:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140887.115260:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.115262:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+16:1982:x1830960573771520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 50us (97us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140887.115266:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.115266:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576068736:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.115267:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8835 00010000:00010000:2.0:1746140887.115279:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.115282:0:20960:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.115285:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.115290:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.115295:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e32c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140887.115298:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.115322:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.115327:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573771904 00000100:00100000:0.0:1746140887.115330:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573771904 00010000:00010000:2.0:1746140887.115331:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.115341:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e32c00/0x8156357b7fdba7d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115342:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 44 pid: 4785 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.115355:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8836 00000100:00100000:0.0:1746140887.115358:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573771904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.115363:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140887.115364:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573769728:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 7394us (7678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.115368:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17051 00010000:00010000:0.0:1746140887.115369:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 44 pid: 4785 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.115375:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 44 pid: 4785 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.115383:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc82800/0x8156357b7fdba309 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1720 expref: 44 pid: 4785 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.115389:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.115390:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.115392:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115430:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115444:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140887.115455:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573771904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (310us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.115456:0:8459:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.115459:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8836 00010000:00010000:3.0:1746140887.115463:0:8459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115476:0:8459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115483:0:8459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.115487:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140887.115489:0:8459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115494:0:8459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8e200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140887.115496:0:8459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115501:0:8459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.115503:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140887.115510:0:8459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115520:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba7cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.115525:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573771392 00000100:00100000:1.0:1746140887.115528:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573771392 00000100:00100000:0.0:1746140887.115529:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140887.115541:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 18 pid: 9872 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.115551:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+18:1984:x1830960573770368:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 7713us (7894us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.115557:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17050 00000100:00100000:1.0:1746140887.115561:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573772032 00000100:00100000:1.0:1746140887.115563:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573772032 00010000:00010000:1.0:1746140887.115572:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 39 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.115584:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573772160 00000100:00100000:1.0:1746140887.115586:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573772160 00000100:00100000:3.0:1746140887.115592:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8837 00010000:00010000:1.0:1746140887.115594:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.115597:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+17:1982:x1830960573771392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.115603:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140887.115607:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8838 00000100:00100000:1.0:1746140887.115611:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1982:x1830960573772032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.115613:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 17 pid: 9872 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.115615:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8839 00010000:00010000:1.0:1746140887.115618:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.115620:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 17 pid: 9872 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.115620:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573772160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.115624:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 39 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.115625:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.115630:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e000/0x8156357b7fdba777 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a196c expref: 17 pid: 9872 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.115631:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.115632:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 39 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.115637:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.115638:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.115638:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.115640:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115645:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.115648:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6800/0x8156357b7fdba5f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a18a8 expref: 39 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.115652:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb6400/0x8156357b7fdba5e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a189a expref: 28 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.115656:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.115658:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.115660:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115661:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140887.115670:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.115676:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.115681:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+16:1982:x1830960573771392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.115685:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8837 00010000:00010000:1.0:1746140887.115688:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.115691:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573772160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.115696:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8839 00000100:00100000:1.0:1746140887.115698:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573772032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (194us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.115699:0:9872:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.115702:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8838 00010000:00010000:3.0:1746140887.115704:0:9872:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115710:0:20960:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115715:0:9872:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115715:0:20960:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115720:0:9872:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115725:0:9872:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115730:0:9872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8ea00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140887.115730:0:20960:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115732:0:9872:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115734:0:20960:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115737:0:9872:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115749:0:9872:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.115754:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba7d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.115777:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573769984:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 7582us (7619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.115781:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17052 00010000:00010000:0.0:1746140887.115830:0:20960:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115836:0:20960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddf200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140887.115838:0:20960:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115846:0:20960:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115853:0:20960:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.115856:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ddf200/0x8156357b7fdba7e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.115886:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573770240:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 7645us (7685us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.115891:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17053 00000100:00100000:3.0:1746140887.118387:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573770624:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3673us (4097us total) trans 17179874134 rc 0/0 00000100:00100000:3.0:1746140887.118399:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1812 00002000:00100000:3.0:1746140887.118409:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1441792->1589247) req@ffff88012b06aa00 x1830960573770624/t17179874134(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.118418:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06aa00 with x1830960573770624 ext(1441792->1589247) 00010000:00010000:3.0:1746140887.118428:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 30 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.118442:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 30 pid: 20960 timeout: 966 lvb_type: 0 00002000:00010000:3.0:1746140887.118449:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b06aa00 00000100:00100000:0.0:1746140887.119238:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.119299:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573772288 00000100:00100000:1.0:1746140887.119322:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573772288 00010000:00010000:1.0:1746140887.119346:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 30 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.119385:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8840 00000100:00100000:1.0:1746140887.119391:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1982:x1830960573772288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.119402:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.119416:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 30 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.119425:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 30 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.119443:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2000/0x8156357b7fdba71c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1589247) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1934 expref: 30 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.119456:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.119458:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.119462:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.119470:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.119497:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140887.119530:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573772288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 140us (296us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.119532:0:32377:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.119535:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8840 00010000:00010000:3.0:1746140887.119546:0:32377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.119560:0:32377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.119567:0:32377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.119573:0:32377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.119579:0:32377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddee00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140887.119583:0:32377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.119589:0:32377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.119599:0:32377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.119603:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ddee00/0x8156357b7fdba7bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.119646:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573769856:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11828us (12061us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.119654:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17048 00000100:00100000:2.0:1746140887.120592:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.120628:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573772544 00000100:00100000:0.0:1746140887.120632:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573772544 00000100:00100000:0.0:1746140887.120660:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10761 00000100:00100000:0.0:1746140887.120666:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:32719:x1830960573772544:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:0.0:1746140887.120702:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.120718:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdba79a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1988 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.120732:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140887.120735:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.120757:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.120770:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 22 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.120776:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 286 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.120782:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 22 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.120787:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 286 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.120793:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.120817:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 286 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.120826:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 286 pid: 27790 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.120838:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094452d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576068864:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.120915:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 22 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.120923:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 22 pid: 27790 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.120936:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576068992:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.121033:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 286 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.121040:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 286 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.121047:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576069120:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.121087:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 22 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.121094:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 22 pid: 27790 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.121101:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576069248:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.121120:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92d1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.122256:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.122287:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094452d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576068864:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.122287:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.122301:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576068992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.122329:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576069120:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.122340:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.122377:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573772672 00000100:00100000:2.0:1746140887.122377:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573772800 00000100:00100000:3.0:1746140887.122381:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573772672 00000100:00100000:2.0:1746140887.122381:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573772800 00010000:00010000:3.0:1746140887.122400:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 287 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.122400:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 23 pid: 27790 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.122420:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573772928 00000100:00100000:2.0:1746140887.122422:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573772928 00000100:00100000:3.0:1746140887.122426:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8841 00010000:00010000:2.0:1746140887.122429:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 288 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.122431:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573772800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140887.122432:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8842 00010000:00010000:3.0:1746140887.122440:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140887.122440:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:1984:x1830960573772672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140887.122442:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8843 00010000:00010000:3.0:1746140887.122444:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 23 pid: 27790 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.122447:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:1984:x1830960573772928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.122449:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.122452:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 23 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.122453:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.122454:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 288 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.122456:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 288 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.122467:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66800/0x8156357b7fdba3e2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1789 expref: 23 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.122469:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 288 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.122477:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 288 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.122487:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140887.122487:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdba36b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1751 expref: 288 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.122491:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.122497:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140887.122502:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140887.122504:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.122504:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66600/0x8156357b7fdba44b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a17ba expref: 287 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.122512:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140887.122512:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140887.122515:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140887.122523:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573772800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.122523:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:1984:x1830960573772928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140887.122524:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.122529:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8841 00000100:00100000:2.0:1746140887.122532:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8843 00000100:00100000:1.0:1746140887.122542:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1984:x1830960573772672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.122548:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8842 00000100:00100000:2.0:1746140887.122552:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576069248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.122573:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140887.122615:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.122647:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573773056 00000100:00100000:1.0:1746140887.122650:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573773056 00010000:00010000:1.0:1746140887.122661:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 22 pid: 27790 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.122683:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8844 00000100:00100000:1.0:1746140887.122688:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573773056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.122693:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.122696:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 22 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.122704:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 22 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.122713:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b48400/0x8156357b7fdba364 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a174a expref: 22 pid: 27790 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.122721:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140887.122724:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.122730:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.122736:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.122774:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140887.122788:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.122794:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140887.122797:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573773056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.122803:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8844 00000040:00080000:2.0:1746140887.123675:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3448, 88 off292088 00000004:00080000:2.0:1746140887.123683:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199377545ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.123737:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3474, 88 off294552 00000004:00080000:2.0:1746140887.123742:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866199437227ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.123768:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3475, 88 off294640 00000004:00080000:2.0:1746140887.123773:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866199467662ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.123780:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3449, 88 off292176 00000004:00080000:2.0:1746140887.123783:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199478337ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.123894:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3450, 88 off292264 00000004:00080000:2.0:1746140887.123898:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199592833ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.123905:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3476, 88 off294728 00000004:00080000:2.0:1746140887.123908:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866199602901ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.123924:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3477, 88 off294816 00000004:00080000:2.0:1746140887.123927:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866199622677ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.123954:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3479, 88 off295000 00000004:00080000:2.0:1746140887.123957:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866199652346ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.123968:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3451, 88 off292352 00000004:00080000:2.0:1746140887.123971:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199666082ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.123986:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3480, 88 off295088 00000004:00080000:2.0:1746140887.123989:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866199684191ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.123997:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3452, 88 off292440 00000004:00080000:2.0:1746140887.124000:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199695013ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.124007:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3481, 88 off295176 00000004:00080000:2.0:1746140887.124010:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866199704886ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.124018:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3453, 88 off292528 00000004:00080000:2.0:1746140887.124020:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199715676ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.124028:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3454, 88 off292616 00000004:00080000:2.0:1746140887.124030:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199725650ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.124038:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3455, 88 off292704 00000004:00080000:2.0:1746140887.124040:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199735306ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.124047:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3456, 88 off292792 00000004:00080000:2.0:1746140887.124049:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866199744401ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.124073:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3482, 88 off295264 00000004:00080000:2.0:1746140887.124076:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866199771490ns, next at 809142599738ns, rc = 0 00000001:00080000:0.0:1746140887.140209:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945062 is committed 00000001:00080000:0.0:1746140887.140224:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945047 is committed 00000004:00010000:3.0:1746140887.140236:0:14785:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094af6300 reply state ffff8800a5227400 transno 8589945068 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000001:00080000:0.0:1746140887.140236:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945063 is committed 00000001:00080000:0.0:1746140887.140242:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945059 is committed 00000100:00100000:3.0:1746140887.140249:0:14785:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746140887.140259:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945049 is committed 00000001:00080000:0.0:1746140887.140267:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945068 is committed 00000004:00080000:0.0:1746140887.140271:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2724 committed 00000004:00080000:0.0:1746140887.140279:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2702 committed 00000004:00080000:0.0:1746140887.140286:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2701 committed 00000004:00080000:0.0:1746140887.140288:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2700 committed 00000004:00080000:0.0:1746140887.140290:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2699 committed 00000004:00080000:0.0:1746140887.140292:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2723 committed 00000004:00080000:0.0:1746140887.140293:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2698 committed 00000004:00080000:0.0:1746140887.140296:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2722 committed 00000004:00080000:0.0:1746140887.140297:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2697 committed 00000004:00080000:0.0:1746140887.140299:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2721 committed 00000004:00080000:0.0:1746140887.140301:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2720 committed 00000004:00080000:0.0:1746140887.140317:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2719 committed 00000004:00080000:0.0:1746140887.140319:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2696 committed 00000004:00080000:0.0:1746140887.140320:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2695 committed 00000004:00080000:0.0:1746140887.140322:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2718 committed 00000004:00080000:0.0:1746140887.140324:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2717 committed 00000004:00080000:0.0:1746140887.140327:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2694 committed 00000001:00080000:0.0:1746140887.140335:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945065 is committed 00010000:00080000:3.0:1746140887.140369:0:14785:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746140887.140385:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32719:x1830960573772544:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 19714us (19790us total) trans 8589945068 rc 0/0 00000100:00100000:3.0:1746140887.140393:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10761 00000100:00100000:2.0:1746140887.140450:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576069504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.140488:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576069376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.140497:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.140526:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.140532:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576070016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.140543:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.140546:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576069504 00000100:00100000:3.0:1746140887.140551:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576069376 00000100:00100000:2.0:1746140887.140551:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576070528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.140552:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576069504 00000100:00100000:3.0:1746140887.140555:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576069376 00010000:00010000:1.0:1746140887.140557:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140887.140561:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746140887.140566:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140887.140570:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576071040:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746140887.140572:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.140577:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ddf600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.140580:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140887.140581:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.140582:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576070016 00000100:00100000:0.0:1746140887.140584:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576070016 00000100:00100000:3.0:1746140887.140586:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576070528 00010000:00010000:1.0:1746140887.140587:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140887.140588:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576070528 00000100:00100000:0.0:1746140887.140594:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576071040 00000100:00100000:0.0:1746140887.140595:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576071040 00010000:00010000:1.0:1746140887.140601:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00000100:00100000:3.0:1746140887.140602:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17054 00010000:00010000:1.0:1746140887.140603:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746140887.140607:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+98:3311:x1830960576069504:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746140887.140607:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.140611:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ddf600/0x8156357b7fdba7e7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140887.140612:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17055 00000100:00100000:0.0:1746140887.140617:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+98:3310:x1830960576069376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.140632:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17056 00000100:00100000:1.0:1746140887.140639:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+98:3311:x1830960576070016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.140675:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17057 00000100:00100000:2.0:1746140887.140678:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576069632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.140680:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+98:3311:x1830960576070528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.140691:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.140694:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17058 00000100:00100000:2.0:1746140887.140698:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576070272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.140700:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:3311:x1830960576071040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.140706:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.140714:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576070656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.140726:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.140737:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576071168:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746140887.140737:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746140887.140740:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746140887.140750:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.140758:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746140887.140762:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576069760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.140776:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.140784:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+100:3311:x1830960576070528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (220us total) trans 21474841418 rc 0/0 00000100:00100000:2.0:1746140887.140784:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576070144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.140790:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17057 00000100:00100000:2.0:1746140887.140799:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.140800:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576069632 00000100:00100000:3.0:1746140887.140802:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576069632 00000100:00100000:1.0:1746140887.140803:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:3311:x1830960576071040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (220us total) trans 17179874135 rc 0/0 00000100:00100000:2.0:1746140887.140806:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576070784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.140809:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576070272 00000100:00100000:1.0:1746140887.140809:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17058 00000100:00100000:3.0:1746140887.140810:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576070272 00000100:00100000:3.0:1746140887.140817:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576070656 00000100:00100000:1.0:1746140887.140817:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576071168 00000100:00100000:2.0:1746140887.140818:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.140819:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576070656 00000100:00100000:1.0:1746140887.140820:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576071168 00000100:00100000:3.0:1746140887.140825:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576069760 00000100:00100000:2.0:1746140887.140825:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576071296:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.140827:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576069760 00000100:00100000:1.0:1746140887.140829:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576070144 00000100:00100000:1.0:1746140887.140830:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576070144 00000100:00100000:3.0:1746140887.140833:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576070784 00000100:00100000:3.0:1746140887.140835:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576070784 00000100:00100000:2.0:1746140887.140837:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.140837:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17059 00000100:00100000:3.0:1746140887.140841:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576071296 00000100:00100000:1.0:1746140887.140841:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+102:3312:x1830960576069632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.140843:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576071296 00000100:00100000:3.0:1746140887.140851:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17060 00000100:00100000:3.0:1746140887.140855:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+102:3312:x1830960576070272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.140858:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17061 00000100:00100000:2.0:1746140887.140865:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3312:x1830960576070656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.140886:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17062 00000100:00100000:1.0:1746140887.140891:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+90:3312:x1830960576071168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.140926:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+103:3312:x1830960576070272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (217us total) trans 21474841420 rc 0/0 00000100:00100000:3.0:1746140887.140937:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17060 00000100:00100000:3.0:1746140887.140946:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17063 00000100:00100000:3.0:1746140887.140951:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+102:3312:x1830960576069760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.140957:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576070656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (228us total) trans 17179874136 rc 0/0 00000100:00100000:2.0:1746140887.140966:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17061 00000100:00100000:2.0:1746140887.140974:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17064 00000100:00100000:2.0:1746140887.140977:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3312:x1830960576070144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.141020:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+103:3312:x1830960576069760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (242us total) trans 21474841421 rc 0/0 00000100:00100000:3.0:1746140887.141025:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17063 00000100:00100000:2.0:1746140887.141028:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17065 00000100:00100000:2.0:1746140887.141031:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576070784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.141033:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17066 00000100:00100000:3.0:1746140887.141037:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576071296:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140887.141125:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a8380/2, rc 0, transno 17179874135 00000100:00100000:2.0:1746140887.141129:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576071040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.141131:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+103:3311:x1830960576070016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 493us (585us total) trans 21474841422 rc 0/0 00000100:00100000:1.0:1746140887.141136:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17056 00000004:00080000:2.0:1746140887.141137:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094af5500/2, rc 0, transno 21474841422 00000100:00100000:2.0:1746140887.141143:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576070016:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140887.141148:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d082a00/2, rc 0, transno 21474841418 00000100:00100000:2.0:1746140887.141151:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576070528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.141151:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576069888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.141169:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+103:3311:x1830960576069504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 561us (671us total) trans 21474841423 rc 0/0 00000100:00100000:1.0:1746140887.141169:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.141174:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17054 00000004:00080000:2.0:1746140887.141178:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094af4700/2, rc 0, transno 21474841421 00000100:00100000:3.0:1746140887.141182:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576069888 00000100:00100000:2.0:1746140887.141182:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576069760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.141183:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576070400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.141185:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576069888 00000004:00080000:2.0:1746140887.141189:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094452d80/2, rc 0, transno 21474841420 00000100:00100000:2.0:1746140887.141192:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576070272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.141195:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17067 00000100:00100000:1.0:1746140887.141196:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746140887.141197:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f24f100/2, rc 0, transno 17179874136 00000100:00100000:3.0:1746140887.141198:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+95:3310:x1830960576069888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.141200:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576070656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.141206:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576070912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.141220:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.141231:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576071424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.141245:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.141262:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576070400 00000004:00080000:2.0:1746140887.141264:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a8000/2, rc 0, transno 17179874138 00000100:00100000:1.0:1746140887.141264:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576070400 00000100:00100000:0.0:1746140887.141266:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+96:3312:x1830960576071168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 374us (514us total) trans 17179874138 rc 0/0 00000100:00100000:2.0:1746140887.141267:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576071168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.141272:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17062 00000100:00100000:3.0:1746140887.141278:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+96:3310:x1830960576069888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (108us total) trans 17179874141 rc 0/0 00000100:00100000:1.0:1746140887.141279:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576070912 00000100:00100000:2.0:1746140887.141281:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576071424 00000100:00100000:1.0:1746140887.141281:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576070912 00000100:00100000:2.0:1746140887.141283:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576071424 00000100:00100000:0.0:1746140887.141288:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17068 00000100:00100000:0.0:1746140887.141293:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+104:3310:x1830960576070400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.141296:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17067 00000100:00100000:2.0:1746140887.141318:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17069 00000100:00100000:2.0:1746140887.141324:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+95:3310:x1830960576070912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.141324:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17070 00000100:00100000:1.0:1746140887.141330:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3310:x1830960576071424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.141372:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3312:x1830960576071296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 334us (534us total) trans 17179874139 rc 0/0 00000100:00100000:3.0:1746140887.141377:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17066 00000100:00100000:0.0:1746140887.141387:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+106:3310:x1830960576070400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (190us total) trans 21474841424 rc 0/0 00000100:00100000:0.0:1746140887.141393:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17068 00000100:00100000:1.0:1746140887.141405:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+105:3312:x1830960576069632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 563us (713us total) trans 21474841425 rc 0/0 00000100:00100000:2.0:1746140887.141406:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+95:3310:x1830960576070912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (184us total) trans 17179874142 rc 0/0 00000100:00100000:1.0:1746140887.141411:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17059 00000100:00100000:2.0:1746140887.141415:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17069 00000100:00100000:3.0:1746140887.141417:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+95:3312:x1830960576070784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 383us (596us total) trans 17179874140 rc 0/0 00000100:00100000:3.0:1746140887.141421:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17065 00000100:00100000:2.0:1746140887.141444:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3312:x1830960576070144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 466us (644us total) trans 17179874137 rc 0/0 00000100:00100000:3.0:1746140887.141449:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+104:3310:x1830960576069376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 832us (922us total) trans 21474841419 rc 0/0 00000100:00100000:2.0:1746140887.141449:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17064 00000100:00100000:3.0:1746140887.141454:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17055 00000004:00080000:2.0:1746140887.141463:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094af5180/2, rc 0, transno 21474841423 00000100:00100000:2.0:1746140887.141465:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576069504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140887.141475:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f24f800/2, rc 0, transno 17179874137 00000100:00100000:2.0:1746140887.141478:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576070144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140887.141482:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cc380/2, rc 0, transno 17179874140 00000100:00100000:2.0:1746140887.141485:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576070784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140887.141490:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a9180/2, rc 0, transno 17179874139 00000100:00100000:2.0:1746140887.141492:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576071296:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140887.141497:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094af4000/2, rc 0, transno 21474841425 00000100:00100000:1.0:1746140887.141497:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3310:x1830960576071424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (250us total) trans 21474841426 rc 0/0 00000100:00100000:2.0:1746140887.141499:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576069632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.141502:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17070 00000004:00080000:1.0:1746140887.141524:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f72b800/2, rc 0, transno 21474841426 00000100:00100000:1.0:1746140887.141527:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576071424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140887.141533:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094af5c00/2, rc 0, transno 21474841419 00000100:00100000:1.0:1746140887.141535:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576069376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140887.141541:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f24e680/2, rc 0, transno 17179874141 00000100:00100000:1.0:1746140887.141544:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576069888:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140887.141549:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d083480/2, rc 0, transno 21474841424 00000100:00100000:1.0:1746140887.141551:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576070400:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140887.141556:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cea00/2, rc 0, transno 17179874142 00000100:00100000:1.0:1746140887.141558:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576070912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.141825:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.141904:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573773184 00000100:00100000:3.0:1746140887.141907:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573773184 00000100:00100000:3.0:1746140887.141937:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10762 00000100:00100000:3.0:1746140887.141942:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32719:x1830960573773184:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140887.141955:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.141967:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a199d expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.142008:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.142019:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.142033:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140887.142035:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140887.142038:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e400, rc 0) 00000100:00100000:3.0:1746140887.142071:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32719:x1830960573773184:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 128us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.142076:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10762 00000100:00100000:0.0:1746140887.143842:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.143887:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573773312 00000100:00100000:3.0:1746140887.143893:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573773312 00000100:00100000:3.0:1746140887.143938:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10763 00000100:00100000:3.0:1746140887.143944:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32719:x1830960573773312:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140887.143958:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.143970:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba7f5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19a4 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.144036:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdba7fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.144045:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdba7fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.144054:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdba7fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140887.144093:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140887.144097:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140887.144110:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdba7fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.144132:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdba7f5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19a4 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.144144:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdba7fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19a4 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.144150:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:3.0:1746140887.144153:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140887.144155:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ec00, rc 0) 00000100:00100000:3.0:1746140887.144199:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32719:x1830960573773312:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 254us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.144207:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10763 00000100:00100000:0.0:1746140887.145724:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.145997:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573773440 00000100:00100000:3.0:1746140887.146004:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573773440 00000100:00100000:3.0:1746140887.146047:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17071 00000100:00100000:3.0:1746140887.146053:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573773440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140887.146081:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.146099:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19ab expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140887.146124:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fed6, atime: 0x6813fed6, ctime: 0x6813fed6, blocks: 0x821 00010000:00010000:3.0:1746140887.146140:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.146142:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.146151:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 15 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.146164:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 15 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.146175:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e800, rc 0) 00000100:00100000:3.0:1746140887.146220:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+15:1984:x1830960573773440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 167us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.146226:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17071 00000100:00100000:0.0:1746140887.146403:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.146420:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.146443:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.146461:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.146480:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.146519:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573773568 00000100:00100000:2.0:1746140887.146523:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573773568 00000100:00100000:1.0:1746140887.146539:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573773696 00000100:00100000:2.0:1746140887.146541:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573773952 00000100:00100000:2.0:1746140887.146543:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573773952 00000100:00100000:1.0:1746140887.146544:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573773696 00000100:00100000:3.0:1746140887.146551:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573773824 00000100:00100000:3.0:1746140887.146561:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573773824 00000100:00100000:2.0:1746140887.146565:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573774080 00000100:00100000:2.0:1746140887.146567:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573774080 00000100:00100000:1.0:1746140887.146577:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17072 00000100:00100000:2.0:1746140887.146582:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17073 00000100:00100000:1.0:1746140887.146583:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573773568:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746140887.146588:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573773952:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140887.146593:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140887.146593:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17074 00010000:00010000:2.0:1746140887.146597:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140887.146600:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573773696:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140887.146606:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19c7 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.146606:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19b2 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.146608:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140887.146611:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17075 00010000:00010000:0.0:1746140887.146616:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19b9 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.146619:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573774080:12345-192.168.204.16@tcp:101:lfs.0 00002000:00010000:2.0:1746140887.146620:0:4186:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fed7, atime: 0x6813fed6, ctime: 0x6813fed7, blocks: 0x1589 00002000:00010000:1.0:1746140887.146625:0:4782:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed7, atime: 0x6813fed7, ctime: 0x6813fed7, blocks: 0x821 00010000:00010000:2.0:1746140887.146629:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.146630:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746140887.146630:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fed7, atime: 0x6813fed7, ctime: 0x6813fed7, blocks: 0x821 00010000:00010000:2.0:1746140887.146634:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 17 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.146635:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.146636:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.146637:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.146637:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.146639:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.146641:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 18 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.146643:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 17 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.146644:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 18 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.146649:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e308800, rc 0) 00010000:00010000:1.0:1746140887.146651:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 18 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.146652:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19ce expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.146654:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 18 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.146658:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83a00, rc 0) 00010000:00010000:0.0:1746140887.146667:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e32e00, rc 0) 00000100:00100000:2.0:1746140887.146670:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+17:1985:x1830960573773952:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 83us (227us total) trans 0 rc 0/0 00002000:00010000:3.0:1746140887.146673:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fed6, atime: 0x6813fed6, ctime: 0x6813fed6, blocks: 0x1029 00000100:00100000:2.0:1746140887.146676:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17073 00000100:00100000:1.0:1746140887.146676:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+18:1985:x1830960573773568:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.146681:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17072 00000100:00100000:0.0:1746140887.146683:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+19:1985:x1830960573773696:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.146688:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17076 00010000:00010000:3.0:1746140887.146690:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.146692:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140887.146692:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17074 00000100:00100000:2.0:1746140887.146693:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+16:1985:x1830960573773824:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140887.146698:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.146699:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 17 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.146705:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19c0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.146713:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 17 pid: 32376 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746140887.146715:0:4186:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed7, atime: 0x6813fed7, ctime: 0x6813fed7, blocks: 0x821 00010000:00010000:3.0:1746140887.146723:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e200, rc 0) 00010000:00010000:2.0:1746140887.146723:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.146724:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.146728:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 17 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.146736:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 17 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.146742:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e308000, rc 0) 00000100:00100000:3.0:1746140887.146765:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+17:1985:x1830960573774080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 147us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.146771:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17075 00000100:00100000:2.0:1746140887.146773:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+17:1985:x1830960573773824:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.146779:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17076 00000100:00100000:0.0:1746140887.151893:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.151993:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573774336 00000100:00100000:3.0:1746140887.152002:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573774336 00000100:00100000:3.0:1746140887.152605:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8744 00000100:00100000:3.0:1746140887.152614:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573774336:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140887.152649:0:21376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.152663:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.152665:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.152669:0:21376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.152682:0:21376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.155137:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.155193:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.155778:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573774592 00000100:00100000:0.0:1746140887.155778:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573774720 00000100:00100000:0.0:1746140887.155785:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573774720 00000100:00100000:1.0:1746140887.155786:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573774592 00000100:00100000:1.0:1746140887.155837:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8745 00000100:00100000:1.0:1746140887.155845:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28b972ba-4133-49d1-b679-ce80456803d9+18:1985:x1830960573774592:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:0.0:1746140887.155845:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8746 00000100:00100000:0.0:1746140887.155851:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+18:1985:x1830960573774720:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140887.155875:0:8465:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.155875:0:8463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.155887:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.155889:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.155893:0:8465:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.155906:0:8465:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.155921:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.155922:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.155925:0:8463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.155934:0:8463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.159957:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.159996:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.160025:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.160065:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.160122:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573775104 00000100:00100000:1.0:1746140887.160133:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573775104 00000100:00100000:3.0:1746140887.160173:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573775744 00000100:00100000:2.0:1746140887.160173:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573775360 00000100:00100000:3.0:1746140887.160183:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573775744 00000100:00100000:2.0:1746140887.160183:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573775360 00000100:00100000:1.0:1746140887.160188:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573775872 00000100:00100000:1.0:1746140887.160191:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573775872 00000100:00100000:1.0:1746140887.160212:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8747 00000100:00100000:1.0:1746140887.160218:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+21:1984:x1830960573775104:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:0.0:1746140887.160220:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8748 00000100:00100000:0.0:1746140887.160227:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+21:1985:x1830960573775872:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:3.0:1746140887.160246:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8749 00000100:00100000:2.0:1746140887.160252:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8750 00000100:00100000:3.0:1746140887.160253:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:28b972ba-4133-49d1-b679-ce80456803d9+21:1985:x1830960573775744:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140887.160254:0:32428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.160255:0:32429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.160263:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:28b972ba-4133-49d1-b679-ce80456803d9+21:1985:x1830960573775360:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140887.160268:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.160268:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.160270:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.160270:0:32428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.160274:0:32429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.160274:0:32428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.160283:0:21689:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.160283:0:21688:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.160286:0:32429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.160286:0:32428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.160296:0:21689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.160296:0:21688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.160298:0:21689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.160298:0:21688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.160302:0:21689:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.160332:0:21688:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.160340:0:21689:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.160342:0:21688:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.161797:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.161942:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573776128 00000100:00100000:1.0:1746140887.161950:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573776128 00000100:00100000:1.0:1746140887.161984:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8751 00000100:00100000:1.0:1746140887.161991:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28b972ba-4133-49d1-b679-ce80456803d9+23:1984:x1830960573776128:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140887.162015:0:8464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.162024:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.162026:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.162029:0:8464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.162039:0:8464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.165938:0:21376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.165958:0:21376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.165967:0:21376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.165974:0:21376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8ea00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140887.165980:0:21376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.165988:0:21376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.166007:0:21376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.166014:0:21376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdba82d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.166123:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:28b972ba-4133-49d1-b679-ce80456803d9+23:1984:x1830960573774336:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 13505us (14240us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.166133:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8744 00010000:00010000:0.0:1746140887.170437:0:8465:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.170452:0:8465:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.170460:0:8465:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.170466:0:8465:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc82a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140887.170470:0:8465:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.170477:0:8465:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.170500:0:8465:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.170505:0:8465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc82a00/0x8156357b7fdba834 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.170587:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28b972ba-4133-49d1-b679-ce80456803d9+23:1985:x1830960573774592:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 14738us (15389us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140887.170596:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8745 00010000:00010000:3.0:1746140887.174458:0:21688:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.174476:0:21688:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.174484:0:21688:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.174491:0:21688:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093904a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140887.174495:0:21688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.174502:0:21688:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.174520:0:21688:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.174526:0:21688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093904a00/0x8156357b7fdba857 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21688 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.174616:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:28b972ba-4133-49d1-b679-ce80456803d9+21:1985:x1830960573775360:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 14351us (14612us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.174626:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8750 00010000:00010000:0.0:1746140887.174796:0:8463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.174804:0:8463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.174809:0:8463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.174814:0:8463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bae2e00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140887.174816:0:8463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.174822:0:8463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.174833:0:8463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.174842:0:8463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bae2e00/0x8156357b7fdba83b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.174874:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28b972ba-4133-49d1-b679-ce80456803d9+21:1985:x1830960573774720:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 19023us (19747us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140887.174880:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8746 00010000:00010000:1.0:1746140887.178222:0:32429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.178235:0:32429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.178243:0:32429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.178249:0:32429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc83800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140887.178253:0:32429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.178260:0:32429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.178277:0:32429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.178282:0:32429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83800/0x8156357b7fdba842 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.178368:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:28b972ba-4133-49d1-b679-ce80456803d9+19:1984:x1830960573775104:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18143us (18417us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.178381:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8747 00010000:00010000:0.0:1746140887.185395:0:32428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.185414:0:32428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.185423:0:32428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.185429:0:32428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bae2600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140887.185434:0:32428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.185441:0:32428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.185460:0:32428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.185466:0:32428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bae2600/0x8156357b7fdba849 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.185538:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:28b972ba-4133-49d1-b679-ce80456803d9+17:1985:x1830960573775872:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 25305us (25474us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140887.185548:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8748 00010000:00010000:3.0:1746140887.186361:0:21689:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.186375:0:21689:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.186382:0:21689:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.186389:0:21689:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8fa00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140887.186392:0:21689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.186399:0:21689:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.186414:0:21689:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.186424:0:21689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8fa00/0x8156357b7fdba850 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21689 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.186493:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:28b972ba-4133-49d1-b679-ce80456803d9+19:1985:x1830960573775744:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 26236us (26462us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.186502:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8749 00010000:00010000:1.0:1746140887.188733:0:8464:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.188749:0:8464:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.188758:0:8464:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.188764:0:8464:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc83400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140887.188768:0:8464:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.188774:0:8464:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.188789:0:8464:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.188797:0:8464:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdba85e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.188886:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28b972ba-4133-49d1-b679-ce80456803d9+17:1984:x1830960573776128:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 26890us (27089us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.188895:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8751 00000100:00100000:0.0:1746140887.196926:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.197020:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573776384 00000100:00100000:1.0:1746140887.197031:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573776384 00000100:00100000:1.0:1746140887.197085:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10764 00000100:00100000:1.0:1746140887.197093:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32719:x1830960573776384:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746140887.197139:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.197168:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ec00/0x8156357b7fdba7fc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19a4 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.197182:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140887.197186:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140887.197321:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.197333:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.197341:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00010000:1.0:1746140887.198255:0:14785:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d083b80 reply state ffff88008ce20000 transno 8589945069 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140887.198263:0:14785:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746140887.198364:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:32719:x1830960573776384:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 1271us (1444us total) trans 8589945069 rc 0/0 00000100:00100000:1.0:1746140887.198371:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10764 00000100:00100000:1.0:1746140887.204891:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.204918:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.204933:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.204946:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.204968:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140887.204990:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.204999:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.205005:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.205011:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc82a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.205015:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.205021:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.205036:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:1.0:1746140887.205038:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.205042:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.205046:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdba865 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140887.205079:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573776640 00000100:00100000:1.0:1746140887.205087:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573776640 00000100:00100000:1.0:1746140887.205116:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573776896 00000100:00100000:1.0:1746140887.205118:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573776896 00000100:00100000:1.0:1746140887.205128:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573777152 00000100:00100000:1.0:1746140887.205130:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573777152 00000100:00100000:1.0:1746140887.205138:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573776512 00000100:00100000:1.0:1746140887.205139:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573776512 00000100:00100000:1.0:1746140887.205147:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573776768 00000100:00100000:1.0:1746140887.205148:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573776768 00000100:00100000:1.0:1746140887.205162:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17077 00000100:00100000:1.0:1746140887.205168:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+19:1984:x1830960573776640:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746140887.205327:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17078 00000100:00100000:1.0:1746140887.205332:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+18:1984:x1830960573776896:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140887.205459:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17079 00000100:00100000:0.0:1746140887.205468:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+20:1984:x1830960573777152:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140887.205482:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17080 00000100:00100000:0.0:1746140887.205487:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+19:1985:x1830960573776512:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746140887.205530:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140887.205533:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.205534:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.205536:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.205538:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140887.205581:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+19:1984:x1830960573776896:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 248us (662us total) trans 21474841427 rc 0/0 00000100:00100000:1.0:1746140887.205587:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17078 00000100:00100000:1.0:1746140887.205601:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17081 00002000:00010000:0.0:1746140887.205618:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140887.205622:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140886 -> 1746140887 00002000:00010000:0.0:1746140887.205624:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140886 -> 1746140887 00002000:00010000:0.0:1746140887.205626:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140886 -> 1746140887 00002000:00010000:0.0:1746140887.205628:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140887.205642:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+20:1985:x1830960573776768:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140887.205648:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+19:1985:x1830960573776512:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 160us (700us total) trans 21474841428 rc 0/0 00000100:00100000:0.0:1746140887.205654:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17080 00002000:00010000:1.0:1746140887.205839:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140887.205842:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.205844:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.205846:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.205847:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2079 00000100:00100000:1.0:1746140887.205958:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+20:1984:x1830960573776640:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 790us (1074us total) trans 17179874143 rc 0/0 00000100:00100000:1.0:1746140887.205963:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17077 00000100:00100000:1.0:1746140887.208137:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746140887.208399:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140887.208404:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140886 -> 1746140887 00002000:00010000:0.0:1746140887.208406:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140886 -> 1746140887 00002000:00010000:0.0:1746140887.208409:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140886 -> 1746140887 00002000:00010000:0.0:1746140887.208411:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746140887.208454:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+20:1984:x1830960573777152:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 2986us (3517us total) trans 17179874144 rc 0/0 00000100:00100000:0.0:1746140887.208468:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17079 00000100:00100000:2.0:1746140887.209376:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573777024 00000100:00100000:2.0:1746140887.209385:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573777024 00000100:00100000:2.0:1746140887.209423:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17082 00000100:00100000:2.0:1746140887.209429:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+19:1985:x1830960573777024:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140887.209592:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:2.0:1746140887.209595:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.209597:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140886 -> 1746140887 00002000:00010000:2.0:1746140887.209599:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.209601:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00002000:00010000:0.0:1746140887.209620:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140887.209623:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.209625:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.209627:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.209629:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2077 00000100:00100000:2.0:1746140887.209647:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+20:1985:x1830960573777024:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 218us (1515us total) trans 21474841429 rc 0/0 00000100:00100000:0.0:1746140887.209649:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+20:1985:x1830960573776768:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 4043us (4679us total) trans 17179874145 rc 0/0 00000100:00100000:2.0:1746140887.209653:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17082 00000100:00100000:0.0:1746140887.209657:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17081 00000100:00100000:1.0:1746140887.214624:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.215758:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573777408 00000100:00100000:2.0:1746140887.215768:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573777408 00000100:00100000:2.0:1746140887.215811:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4729 00000100:00100000:2.0:1746140887.215818:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32719:x1830960573777408:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:2.0:1746140887.215870:0:21104:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x31d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba7af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1996 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.215910:0:21104:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21104 initiator: MDT0 00010000:00010000:2.0:1746140887.215920:0:21104:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.215926:0:21104:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21104 initiator: MDT0 00010000:00010000:2.0:1746140887.215953:0:21104:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.215967:0:21104:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.215979:0:21104:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f728000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:21104:1830960576071552:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.216072:0:21104:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008eef3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.218177:0:21104:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f728000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:21104:1830960576071552:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.218200:0:21104:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00000100:00100000:0.0:1746140887.218818:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.218844:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573777536 00000100:00100000:0.0:1746140887.218850:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573777536 00010000:00010000:0.0:1746140887.218885:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.218916:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8845 00000100:00100000:0.0:1746140887.218923:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573777536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.218936:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.218941:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.218951:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.218971:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdba7ee lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a199d expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.218995:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140887.219000:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00010000:00010000:0.0:1746140887.219007:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21104 initiator: MDT0 00010000:00010000:0.0:1746140887.219013:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21104 initiator: MDT0 00010000:00010000:0.0:1746140887.219026:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140887.219070:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573777536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 146us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.219075:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8845 00010000:00010000:2.0:1746140887.219513:0:21104:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00010000:00010000:2.0:1746140887.219520:0:21104:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00000040:00080000:2.0:1746140887.220099:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3457, 88 off292880 00000004:00080000:2.0:1746140887.220106:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295799891ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220149:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3483, 88 off295352 00000004:00080000:2.0:1746140887.220154:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866295848690ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.220172:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3484, 88 off295440 00000004:00080000:2.0:1746140887.220175:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866295870305ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.220183:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3458, 88 off292968 00000004:00080000:2.0:1746140887.220186:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295880846ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220192:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3459, 88 off293056 00000004:00080000:2.0:1746140887.220194:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295889427ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220201:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3485, 88 off295528 00000004:00080000:2.0:1746140887.220203:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866295898533ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.220210:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3486, 88 off295616 00000004:00080000:2.0:1746140887.220212:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866295906892ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.220217:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3487, 88 off295704 00000004:00080000:2.0:1746140887.220220:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866295915421ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.220226:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3460, 88 off293144 00000004:00080000:2.0:1746140887.220228:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295923156ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220234:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3488, 88 off295792 00000004:00080000:2.0:1746140887.220236:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866295931012ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.220241:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3461, 88 off293232 00000004:00080000:2.0:1746140887.220244:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295938927ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220249:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3489, 88 off295880 00000004:00080000:2.0:1746140887.220251:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866295946703ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.220257:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3462, 88 off293320 00000004:00080000:2.0:1746140887.220259:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295954615ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220265:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3463, 88 off293408 00000004:00080000:2.0:1746140887.220267:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295962343ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220273:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3464, 88 off293496 00000004:00080000:2.0:1746140887.220276:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295971387ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220282:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3465, 88 off293584 00000004:00080000:2.0:1746140887.220285:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866295980131ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.220291:0:21104:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3490, 88 off295968 00000004:00080000:2.0:1746140887.220294:0:21104:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866295988910ns, next at 809142599738ns, rc = 0 00000004:00010000:2.0:1746140887.241932:0:21104:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129e0f100 reply state ffff88009aa1c800 transno 8589945070 ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21104 initiator: MDT0 00000100:00100000:2.0:1746140887.241945:0:21104:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746140887.241954:0:21104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:2.0:1746140887.241957:0:21104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140887.241968:0:21104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba7af lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1996 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.242098:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32719:x1830960573777408:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 26278us (27480us total) trans 8589945070 rc 0/0 00000100:00100000:2.0:1746140887.242109:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4729 00000001:00080000:1.0:1746140887.242392:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945069 is committed 00000001:00080000:1.0:1746140887.242413:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945070 is committed 00000004:00080000:1.0:1746140887.242417:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2732 committed 00000004:00080000:1.0:1746140887.242425:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2711 committed 00000004:00080000:1.0:1746140887.242431:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2710 committed 00000004:00080000:1.0:1746140887.242432:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2709 committed 00000004:00080000:1.0:1746140887.242435:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2708 committed 00000004:00080000:1.0:1746140887.242436:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2731 committed 00010000:00010000:0.0:1746140887.242436:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21104 initiator: MDT0 00000004:00080000:1.0:1746140887.242438:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2707 committed 00000004:00080000:1.0:1746140887.242439:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2730 committed 00000004:00080000:1.0:1746140887.242440:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2706 committed 00000004:00080000:1.0:1746140887.242441:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2729 committed 00000004:00080000:1.0:1746140887.242443:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2728 committed 00000004:00080000:1.0:1746140887.242444:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2727 committed 00000004:00080000:1.0:1746140887.242445:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2705 committed 00000004:00080000:1.0:1746140887.242446:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2704 committed 00010000:00010000:0.0:1746140887.242446:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21104 initiator: MDT0 00000004:00080000:1.0:1746140887.242448:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2726 committed 00000004:00080000:1.0:1746140887.242449:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2725 committed 00000004:00080000:1.0:1746140887.242450:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2703 committed 00010000:00010000:0.0:1746140887.242453:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21104 initiator: MDT0 00010000:00010000:0.0:1746140887.242460:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094616200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.242464:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21104 initiator: MDT0 00010000:00010000:0.0:1746140887.242471:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21104 initiator: MDT0 00010000:00010000:0.0:1746140887.242500:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff8800936f8d00) 00010000:00010000:0.0:1746140887.242504:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140887.242507:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21104 initiator: MDT0 00010000:00010000:0.0:1746140887.242512:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094616200/0x8156357b7fdba86c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21104 initiator: MDT0 00000100:00100000:1.0:1746140887.242589:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576071680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.242637:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.242653:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576071680 00000100:00100000:0.0:1746140887.242659:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576071680 00000100:00100000:1.0:1746140887.242667:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576072192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.242679:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.242683:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17083 00000100:00100000:0.0:1746140887.242686:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+93:3311:x1830960576071680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.242690:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576072704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.242703:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242712:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576073216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.242722:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242735:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746140887.242738:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576072064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.242751:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242759:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576072576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.242768:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242775:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576073088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.242786:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242798:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576073600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.242809:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242825:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576071808:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140887.242836:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746140887.242837:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746140887.242838:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.242840:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.242841:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.242842:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746140887.242845:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576072320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.242858:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242875:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576072832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.242880:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+94:3311:x1830960576071680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (242us total) trans 17179874146 rc 0/0 00000100:00100000:0.0:1746140887.242885:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17083 00000100:00100000:1.0:1746140887.242890:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.242898:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576072192 00000100:00100000:1.0:1746140887.242899:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576073344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.242908:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242917:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746140887.242920:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576071936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.242931:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242936:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576072448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.242945:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.242950:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576072960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.242957:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576072704 00000100:00100000:1.0:1746140887.242960:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.242964:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576072704 00000100:00100000:1.0:1746140887.242965:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576073472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.242974:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.242985:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576073216 00000100:00100000:3.0:1746140887.242987:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576073216 00000100:00100000:0.0:1746140887.242989:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576072192 00000100:00100000:1.0:1746140887.242990:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576072064 00000100:00100000:3.0:1746140887.242993:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576072576 00000100:00100000:1.0:1746140887.242993:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576072064 00000100:00100000:3.0:1746140887.242995:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576072576 00000100:00100000:0.0:1746140887.243002:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576073088 00000100:00100000:3.0:1746140887.243003:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576073600 00000100:00100000:0.0:1746140887.243004:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576073088 00000100:00100000:3.0:1746140887.243005:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576073600 00000100:00100000:1.0:1746140887.243005:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576071808 00000100:00100000:1.0:1746140887.243007:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576071808 00000100:00100000:3.0:1746140887.243012:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576072320 00000100:00100000:3.0:1746140887.243013:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576072320 00000100:00100000:1.0:1746140887.243016:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576073344 00000100:00100000:0.0:1746140887.243016:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576072832 00000100:00100000:1.0:1746140887.243018:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576073344 00000100:00100000:0.0:1746140887.243018:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576072832 00000100:00100000:3.0:1746140887.243021:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576071936 00000100:00100000:3.0:1746140887.243022:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576071936 00000100:00100000:1.0:1746140887.243025:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576072448 00000100:00100000:1.0:1746140887.243026:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576072448 00000100:00100000:0.0:1746140887.243027:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576072960 00000100:00100000:3.0:1746140887.243029:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576073472 00000100:00100000:0.0:1746140887.243029:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576072960 00000100:00100000:3.0:1746140887.243031:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576073472 00000100:00100000:1.0:1746140887.243034:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17084 00000100:00100000:1.0:1746140887.243040:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+111:3311:x1830960576072704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.243042:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17085 00000100:00100000:0.0:1746140887.243047:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+111:3311:x1830960576073216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.243050:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17086 00000100:00100000:3.0:1746140887.243069:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:3311:x1830960576072192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.243176:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+112:3311:x1830960576073216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (452us total) trans 21474841430 rc 0/0 00000100:00100000:0.0:1746140887.243182:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17085 00000100:00100000:0.0:1746140887.243194:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17087 00000100:00100000:0.0:1746140887.243199:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+101:3311:x1830960576072576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.243221:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+101:3311:x1830960576072192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (539us total) trans 17179874147 rc 0/0 00000100:00100000:3.0:1746140887.243227:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17086 00000100:00100000:3.0:1746140887.243240:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17088 00000100:00100000:3.0:1746140887.243244:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:3311:x1830960576072064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.243271:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17089 00000100:00100000:0.0:1746140887.243276:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+112:3311:x1830960576073600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.243288:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17090 00000100:00100000:0.0:1746140887.243290:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+112:3311:x1830960576073088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.243299:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17091 00000100:00100000:0.0:1746140887.243301:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+101:3312:x1830960576071808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.243331:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+101:3311:x1830960576072064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (578us total) trans 17179874148 rc 0/0 00000100:00100000:3.0:1746140887.243335:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17088 00000100:00100000:3.0:1746140887.243342:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17092 00000100:00100000:3.0:1746140887.243345:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:3312:x1830960576072320:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.243369:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d28e00/2, rc 0, transno 17179874148 00000100:00100000:0.0:1746140887.243373:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576072064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.243379:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d2b100/2, rc 0, transno 17179874146 00000100:00100000:0.0:1746140887.243381:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576071680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.243386:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f173100/2, rc 0, transno 17179874147 00000100:00100000:0.0:1746140887.243387:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576072192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.243394:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513d180/2, rc 0, transno 21474841430 00000100:00100000:0.0:1746140887.243398:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576073216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.243407:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+101:3312:x1830960576072320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (548us total) trans 17179874149 rc 0/0 00000100:00100000:3.0:1746140887.243410:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17092 00000100:00100000:3.0:1746140887.243417:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17093 00000100:00100000:3.0:1746140887.243419:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+112:3312:x1830960576073344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.243428:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17094 00000100:00100000:3.0:1746140887.243430:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+112:3312:x1830960576072832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.243430:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746140887.243437:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17095 00000100:00100000:0.0:1746140887.243437:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576073728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.243439:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+100:3312:x1830960576071936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.243457:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746140887.243495:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746140887.243497:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.243498:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.243499:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.243500:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4139 00000100:00100000:0.0:1746140887.243514:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+102:3311:x1830960576072576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 315us (745us total) trans 17179874151 rc 0/0 00000100:00100000:3.0:1746140887.243516:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+102:3312:x1830960576071936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (584us total) trans 17179874150 rc 0/0 00000100:00100000:3.0:1746140887.243519:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17095 00000100:00100000:0.0:1746140887.243522:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17087 00000100:00100000:3.0:1746140887.243525:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576073728 00000100:00100000:3.0:1746140887.243527:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576073728 00000100:00100000:0.0:1746140887.243530:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17096 00000100:00100000:0.0:1746140887.243534:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+100:3312:x1830960576072448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.243535:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17097 00000100:00100000:3.0:1746140887.243538:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+113:3312:x1830960576072960:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140887.243556:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d28000/2, rc 0, transno 17179874150 00000100:00100000:3.0:1746140887.243559:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576071936:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140887.243564:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f173480/2, rc 0, transno 17179874149 00000100:00100000:3.0:1746140887.243566:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576072320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.243595:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+101:3312:x1830960576072448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (649us total) trans 17179874152 rc 0/0 00000100:00100000:0.0:1746140887.243599:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17096 00000004:00080000:3.0:1746140887.243603:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f172a00/2, rc 0, transno 17179874152 00000100:00100000:3.0:1746140887.243605:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576072448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.243607:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17098 00000100:00100000:0.0:1746140887.243609:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+113:3312:x1830960576073472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140887.243651:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140887.243653:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.243655:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.243656:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.243657:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746140887.243674:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+101:3312:x1830960576071808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 372us (836us total) trans 17179874153 rc 0/0 00000100:00100000:0.0:1746140887.243678:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17091 00000100:00100000:0.0:1746140887.243687:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17099 00000100:00100000:0.0:1746140887.243691:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+113:3310:x1830960576073728:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.243710:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d29f80/2, rc 0, transno 17179874153 00000100:00100000:0.0:1746140887.243713:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576071808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.243725:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eeabb80/2, rc 0, transno 17179874151 00000100:00100000:0.0:1746140887.243728:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576072576:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746140887.243796:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746140887.243799:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.243801:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.243803:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.243804:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140887.243828:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:3311:x1830960576072704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 787us (1123us total) trans 21474841431 rc 0/0 00000100:00100000:1.0:1746140887.243834:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17084 00000004:00080000:0.0:1746140887.244027:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea8a80/2, rc 0, transno 21474841431 00000100:00100000:0.0:1746140887.244031:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576072704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.244097:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+114:3311:x1830960576073600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 821us (1286us total) trans 21474841432 rc 0/0 00000100:00100000:0.0:1746140887.244103:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17089 00002000:00010000:1.0:1746140887.244120:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140887.244123:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.244125:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.244127:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.244129:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2081 -> 2079 00000004:00080000:0.0:1746140887.244144:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6e300/2, rc 0, transno 21474841432 00000100:00100000:0.0:1746140887.244148:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576073600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.244152:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+114:3312:x1830960576072832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 719us (1260us total) trans 21474841434 rc 0/0 00000100:00100000:1.0:1746140887.244157:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17094 00000004:00080000:0.0:1746140887.244162:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b1b0700/2, rc 0, transno 21474841434 00000100:00100000:0.0:1746140887.244165:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576072832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.244203:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+113:3311:x1830960576073088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 911us (1416us total) trans 21474841433 rc 0/0 00000100:00100000:0.0:1746140887.244209:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17090 00000004:00080000:0.0:1746140887.244227:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b1b0e00/2, rc 0, transno 21474841433 00000100:00100000:0.0:1746140887.244230:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576073088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.244419:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.244440:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573777664 00000100:00100000:0.0:1746140887.244443:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573777664 00000001:00080000:2.0:1746140887.244508:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874118 is committed 00000001:00080000:2.0:1746140887.244518:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874110 is committed 00000001:00080000:2.0:1746140887.244539:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874073 is committed 00000001:00080000:2.0:1746140887.244574:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874138 is committed 00000100:00100000:0.0:1746140887.244576:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10765 00000100:00100000:0.0:1746140887.244582:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+6:32719:x1830960573777664:12345-192.168.204.16@tcp:101:lfs.0 00000001:00080000:2.0:1746140887.244588:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874100 is committed 00000001:00080000:2.0:1746140887.244593:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874099 is committed 00010000:00010000:0.0:1746140887.244597:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.244610:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19d5 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.244654:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746140887.244655:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874140 is committed 00000001:00080000:2.0:1746140887.244660:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874142 is committed 00000001:00080000:2.0:1746140887.244665:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874133 is committed 00010000:00010000:0.0:1746140887.244665:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746140887.244669:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874131 is committed 00010000:00010000:0.0:1746140887.244681:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140887.244684:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140887.244686:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1dd600, rc 0) 00000001:00080000:2.0:1746140887.244688:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874111 is committed 00000100:00100000:0.0:1746140887.244713:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32719:x1830960573777664:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 131us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.244718:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10765 00000001:00080000:2.0:1746140887.244753:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874134 is committed 00000001:00080000:2.0:1746140887.244757:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874132 is committed 00002000:00010000:0.0:1746140887.244841:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:0.0:1746140887.244844:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.244847:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.244849:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.244851:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5513 00000100:00100000:0.0:1746140887.244874:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+113:3312:x1830960576072960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1334us (1912us total) trans 21474841435 rc 0/0 00000100:00100000:0.0:1746140887.244879:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17097 00000100:00100000:0.0:1746140887.244977:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+113:3312:x1830960576073472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1366us (2002us total) trans 21474841436 rc 0/0 00000100:00100000:0.0:1746140887.244983:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17098 00000004:00080000:0.0:1746140887.245002:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b1b1500/2, rc 0, transno 21474841435 00000100:00100000:0.0:1746140887.245005:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576072960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.245011:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6c380/2, rc 0, transno 21474841436 00000100:00100000:0.0:1746140887.245014:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576073472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.245110:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+113:3310:x1830960576073728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1418us (1651us total) trans 21474841437 rc 0/0 00000100:00100000:0.0:1746140887.245115:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17099 00000004:00080000:0.0:1746140887.245134:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099497800/2, rc 0, transno 21474841437 00000100:00100000:0.0:1746140887.245138:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576073728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.245227:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+113:3312:x1830960576073344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1806us (2316us total) trans 21474841438 rc 0/0 00000100:00100000:0.0:1746140887.245232:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17093 00000004:00080000:0.0:1746140887.245250:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6fb80/2, rc 0, transno 21474841438 00000100:00100000:0.0:1746140887.245253:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576073344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.247438:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.247496:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573777920 00000100:00100000:2.0:1746140887.247505:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573777920 00000100:00100000:2.0:1746140887.247539:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4730 00000100:00100000:2.0:1746140887.247545:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32719:x1830960573777920:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746140887.247737:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32719:x1830960573777920:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 191us (304us total) trans 8589945071 rc 0/0 00000100:00100000:2.0:1746140887.247743:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4730 00000100:00100000:2.0:1746140887.265513:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.265570:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573778176 00000100:00100000:1.0:1746140887.265579:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573778176 00000100:00100000:1.0:1746140887.265628:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10766 00000100:00100000:1.0:1746140887.265636:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:32725:x1830960573778176:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140887.265658:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.265675:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca1000/0x8156357b7fdba87a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19dc expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.265810:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.265822:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.265832:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.265843:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.265848:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.265853:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266033:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266040:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266045:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140887.266065:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140887.266137:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266142:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266148:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266153:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131ca0200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.266156:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266162:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266171:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140887.266174:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.266178:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266193:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0200/0x8156357b7fdba881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266206:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266215:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266219:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266223:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131ca0c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.266225:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266230:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266235:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4d500) 00010000:00010000:1.0:1746140887.266237:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.266239:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266243:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0c00/0x8156357b7fdba888 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.266273:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca1000/0x8156357b7fdba87a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.266284:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.266289:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.266290:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140887.266292:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948cb800, rc 0) 00000100:00100000:1.0:1746140887.266351:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32725:x1830960573778176:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 715us (843us total) trans 8589945072 rc 0/0 00000100:00100000:1.0:1746140887.266357:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10766 00000100:00100000:0.0:1746140887.267753:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.267820:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573778432 00000100:00100000:1.0:1746140887.267827:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573778432 00000100:00100000:1.0:1746140887.267855:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10767 00000100:00100000:1.0:1746140887.267860:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32728:x1830960573778432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.267876:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.267885:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb600/0x8156357b7fdba89d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19e3 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.267954:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.267965:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.267972:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.267982:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.267988:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.267993:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268200:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268208:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268214:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140887.268221:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140887.268273:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268279:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268286:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268291:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948cbc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.268293:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268299:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268325:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140887.268327:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.268331:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268335:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cbc00/0x8156357b7fdba8a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268344:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268349:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268354:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268359:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131ca0800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.268362:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268367:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268376:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4d600) 00010000:00010000:1.0:1746140887.268378:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.268381:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268385:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0800/0x8156357b7fdba8ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.268411:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb600/0x8156357b7fdba89d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.268420:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.268426:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.268428:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140887.268430:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131ca0000, rc 0) 00000100:00100000:1.0:1746140887.268539:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32728:x1830960573778432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 676us (788us total) trans 8589945073 rc 0/0 00000100:00100000:1.0:1746140887.268545:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10767 00000100:00100000:1.0:1746140887.273800:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.273825:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573778560 00000100:00100000:0.0:1746140887.273834:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573778560 00000100:00100000:0.0:1746140887.273878:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17100 00000100:00100000:0.0:1746140887.273886:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:32728:x1830960573778560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.273981:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140887.274024:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.274038:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573778816 00000100:00100000:1.0:1746140887.274041:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573778816 00010000:00010000:0.0:1746140887.274066:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19ea expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.274074:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10768 00000100:00100000:1.0:1746140887.274078:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32726:x1830960573778816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140887.274090:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.274091:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.274093:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.274099:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19f1 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.274101:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 28 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.274115:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 28 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.274124:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e595a00, rc 0) 00010000:00010000:1.0:1746140887.274160:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.274168:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 267 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.274173:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.274177:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.274198:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.274205:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.274213:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576073856:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.274219:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:32728:x1830960573778560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 333us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.274226:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17100 00010000:00010000:1.0:1746140887.274263:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 267 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.274267:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 267 pid: 14742 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.274272:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576073984:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.274282:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.275732:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.275754:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.275754:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573778944 00000100:00100000:0.0:1746140887.275759:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573778944 00010000:00010000:0.0:1746140887.275780:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.275783:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576073856:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.275793:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576073984:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.275801:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573779072 00000100:00100000:0.0:1746140887.275803:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573779072 00010000:00010000:2.0:1746140887.275809:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.275813:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 268 pid: 14742 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.275826:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8846 00000100:00100000:0.0:1746140887.275832:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1982:x1830960573778944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140887.275841:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8847 00010000:00010000:0.0:1746140887.275843:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140887.275847:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1982:x1830960573779072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.275848:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.275855:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.275857:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.275859:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 268 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.275873:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131ca0000/0x8156357b7fdba8b2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19e3 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.276004:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 268 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.276016:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x8156357b7fdba88f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19dc expref: 268 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.276026:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.276030:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.276036:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.276047:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.276068:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.276093:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140887.276097:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.276099:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:1982:x1830960573779072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 252us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.276104:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8847 00000100:00100000:0.0:1746140887.276115:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1982:x1830960573778944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 283us (386us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140887.276121:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140887.276121:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8846 00010000:00010000:2.0:1746140887.276126:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140887.276138:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140887.276230:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.276240:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.276246:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.276248:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140887.276250:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fb7a00, rc 0) 00000100:00100000:2.0:1746140887.276281:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32726:x1830960573778816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2202us (2257us total) trans 8589945074 rc 0/0 00000100:00100000:2.0:1746140887.276287:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10768 00000100:00100000:2.0:1746140887.277214:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.277232:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573779328 00000100:00100000:0.0:1746140887.277237:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573779328 00002000:00100000:0.0:1746140887.277260:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f72a680 x1830960573779328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140887.277269:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f72a680 with x1830960573779328 ext(0->1048575) 00002000:00010000:0.0:1746140887.277272:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f72a680 00000100:00100000:0.0:1746140887.277286:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8752 00000100:00100000:0.0:1746140887.277291:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573779328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140887.284642:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573779328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7344us (7423us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.284653:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8752 00002000:00100000:2.0:1746140887.284664:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f72a680 x1830960573779328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.284678:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f72a680 with x1830960573779328 ext(0->1048575) 00002000:00010000:2.0:1746140887.284683:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f72a680 00000001:00080000:0.0:1746140887.286488:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841419 is committed 00000001:00080000:0.0:1746140887.286499:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841424 is committed 00000001:00080000:0.0:1746140887.286521:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841364 is committed 00000001:00080000:0.0:1746140887.286544:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841315 is committed 00000001:00080000:0.0:1746140887.286556:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841426 is committed 00000001:00080000:0.0:1746140887.286566:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841416 is committed 00000001:00080000:0.0:1746140887.286586:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841376 is committed 00000001:00080000:0.0:1746140887.286623:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841312 is committed 00000001:00080000:0.0:1746140887.286645:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841417 is committed 00000001:00080000:0.0:1746140887.286662:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841390 is committed 00000001:00080000:0.0:1746140887.286771:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841392 is committed 00000100:00100000:0.0:1746140887.292428:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.292512:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573779456 00000100:00100000:2.0:1746140887.292524:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573779456 00000100:00100000:2.0:1746140887.292575:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17101 00000100:00100000:2.0:1746140887.292583:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+5:32728:x1830960573779456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.292600:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.292616:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19f8 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.292639:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.292641:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.292648:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 6 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.292663:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 6 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.292673:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e32400, rc 0) 00000100:00100000:2.0:1746140887.292722:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32728:x1830960573779456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 139us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.292727:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17101 00000100:00100000:0.0:1746140887.298353:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.298393:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573779584 00000100:00100000:2.0:1746140887.298401:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573779584 00000100:00100000:2.0:1746140887.298439:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10769 00000100:00100000:2.0:1746140887.298444:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32728:x1830960573779584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.298462:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.298477:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32800/0x8156357b7fdba8e3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a19ff expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.298518:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32800/0x8156357b7fdba8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ff expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.298528:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32800/0x8156357b7fdba8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ff expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.298539:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.298541:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140887.298543:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e32800, rc 0) 00000100:00100000:2.0:1746140887.298581:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32728:x1830960573779584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 137us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.298587:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10769 00000100:00100000:0.0:1746140887.298710:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.298769:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573779840 00000100:00100000:2.0:1746140887.298773:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573779840 00000100:00100000:2.0:1746140887.298835:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10770 00000100:00100000:2.0:1746140887.298839:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32731:x1830960573779840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.298848:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.298855:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32c00/0x8156357b7fdba8ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a06 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.298933:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.298941:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.298948:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.298960:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.298965:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.298969:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299109:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299114:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299118:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140887.299124:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140887.299180:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299184:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299187:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299191:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e33a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.299193:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299197:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299202:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140887.299204:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140887.299206:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299209:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33a00/0x8156357b7fdba8f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299229:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299233:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299237:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299240:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e32000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.299242:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299246:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299251:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a47f2f00) 00010000:00010000:2.0:1746140887.299253:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140887.299255:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299259:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32000/0x8156357b7fdba8f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.299288:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32c00/0x8156357b7fdba8ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 270 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.299297:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.299322:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.299324:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140887.299326:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948ca800, rc 0) 00000100:00100000:2.0:1746140887.299357:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32731:x1830960573779840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 517us (646us total) trans 8589945075 rc 0/0 00000100:00100000:2.0:1746140887.299363:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10770 00000100:00100000:0.0:1746140887.303734:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.303801:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573779968 00000100:00100000:2.0:1746140887.303810:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573779968 00000100:00100000:2.0:1746140887.303862:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17102 00000100:00100000:2.0:1746140887.303870:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+10:32731:x1830960573779968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.303892:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.303908:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a0d expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.303929:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.303931:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.303937:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 11 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.303951:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 11 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.303965:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948cb600, rc 0) 00000100:00100000:2.0:1746140887.304007:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+11:32731:x1830960573779968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 138us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.304012:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17102 00000100:00100000:0.0:1746140887.304240:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.304272:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573780224 00000100:00100000:2.0:1746140887.304275:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573780224 00002000:00100000:2.0:1746140887.304294:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009abdca80 x1830960573780224/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.304300:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdca80 with x1830960573780224 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.304320:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdca80 00000100:00100000:2.0:1746140887.304334:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8753 00000100:00100000:2.0:1746140887.304339:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1984:x1830960573780224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.310657:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.310759:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573780480 00000100:00100000:1.0:1746140887.310768:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573780480 00002000:00100000:1.0:1746140887.310808:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc36d80 x1830960573780480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.310819:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc36d80 with x1830960573780480 ext(0->1048575) 00002000:00010000:1.0:1746140887.310823:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc36d80 00000100:00100000:1.0:1746140887.310840:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8754 00000100:00100000:1.0:1746140887.310846:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+11:1982:x1830960573780480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140887.312645:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1984:x1830960573780224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8298us (8397us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.312656:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8753 00002000:00100000:2.0:1746140887.312665:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009abdca80 x1830960573780224/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.312674:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdca80 with x1830960573780224 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.312679:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdca80 00000100:00100000:2.0:1746140887.318792:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+11:1982:x1830960573780480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7938us (8139us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.318805:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8754 00002000:00100000:2.0:1746140887.318817:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc36d80 x1830960573780480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.318828:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc36d80 with x1830960573780480 ext(0->1048575) 00002000:00010000:2.0:1746140887.318833:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc36d80 00000100:00100000:0.0:1746140887.320279:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.320329:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573780608 00000100:00100000:2.0:1746140887.320339:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573780608 00000100:00100000:2.0:1746140887.320388:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17103 00000100:00100000:2.0:1746140887.320394:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32728:x1830960573780608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.320409:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.320425:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a14 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.320446:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.320447:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.320455:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.320467:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.320476:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948cbc00, rc 0) 00000100:00100000:2.0:1746140887.320515:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32728:x1830960573780608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.320521:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17103 00000100:00100000:0.0:1746140887.323490:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.323538:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.323625:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573780992 00000100:00100000:2.0:1746140887.323625:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573780736 00000100:00100000:3.0:1746140887.323632:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573780992 00000100:00100000:2.0:1746140887.323632:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573780736 00002000:00100000:3.0:1746140887.323669:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009fc09180 x1830960573780992/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.323677:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc09180 with x1830960573780992 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.323681:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc09180 00000100:00100000:2.0:1746140887.323682:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17104 00000100:00100000:2.0:1746140887.323690:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:32731:x1830960573780736:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140887.323695:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8755 00000100:00100000:3.0:1746140887.323700:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573780992:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140887.323704:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.323719:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a1b expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.323738:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.323739:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.323746:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 18 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.323760:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 18 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.323769:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948ca200, rc 0) 00000100:00100000:2.0:1746140887.324582:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:32731:x1830960573780736:12345-192.168.204.16@tcp:101:cat.0 Request processed in 892us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.324590:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17104 00000100:00100000:0.0:1746140887.333194:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.333237:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.333283:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573781248 00000100:00100000:2.0:1746140887.333296:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573781248 00000100:00100000:0.0:1746140887.333362:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573781504 00000100:00100000:0.0:1746140887.333369:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573781504 00002000:00100000:2.0:1746140887.333380:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092ba4380 x1830960573781248/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.333390:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba4380 with x1830960573781248 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.333395:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba4380 00000100:00100000:0.0:1746140887.333412:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10771 00000100:00100000:0.0:1746140887.333417:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32726:x1830960573781504:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:2.0:1746140887.333421:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8756 00000100:00100000:2.0:1746140887.333427:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1983:x1830960573781248:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746140887.333432:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.333434:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746140887.333457:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e32800/0x8156357b7fdba8e3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ff expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.333471:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140887.333474:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.333482:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb8400/0x8156357b7fdba922 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a22 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.333522:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.333530:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.333535:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.333539:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.333561:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.333572:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 268 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.333581:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576074112:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.333660:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.333667:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 7 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.333674:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576074240:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.333694:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140887.334165:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573780992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10462us (10624us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.334174:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8755 00002000:00100000:3.0:1746140887.334182:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009fc09180 x1830960573780992/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.334191:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc09180 with x1830960573780992 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.334195:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc09180 00000100:00100000:0.0:1746140887.340041:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.340097:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.340182:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573781632 00000100:00100000:3.0:1746140887.340191:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573781632 00010000:00010000:3.0:1746140887.340229:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 269 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.340252:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573781760 00000100:00100000:3.0:1746140887.340254:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573781760 00010000:00010000:3.0:1746140887.340263:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.340274:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576074112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.340279:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8848 00000100:00100000:3.0:1746140887.340285:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1983:x1830960573781632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140887.340290:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576074240:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.340298:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.340322:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 269 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.340333:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 269 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.340349:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.340359:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948ca800/0x8156357b7fdba8ff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a06 expref: 269 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.340386:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140887.340391:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.340397:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.340402:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.340444:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1983:x1830960573781632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.340451:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8848 00000100:00100000:3.0:1746140887.340467:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8849 00000100:00100000:3.0:1746140887.340471:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573781760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.340477:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.340481:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.340489:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.340500:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1dd600/0x8156357b7fdba873 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19d5 expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.340510:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140887.340513:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.340519:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.340526:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.340544:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.340560:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960573781760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.340565:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8849 00010000:00010000:2.0:1746140887.340784:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.340792:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140887.342170:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1983:x1830960573781248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8737us (8981us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.342181:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8756 00002000:00100000:3.0:1746140887.342191:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092ba4380 x1830960573781248/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.342200:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba4380 with x1830960573781248 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.342205:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba4380 00000040:00080000:2.0:1746140887.342290:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3466, 88 off293672 00000004:00080000:2.0:1746140887.342297:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866417992332ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342374:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3491, 88 off296056 00000004:00080000:2.0:1746140887.342377:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866418072686ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.342388:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3492, 88 off296144 00000004:00080000:2.0:1746140887.342390:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866418085676ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.342399:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3467, 88 off293760 00000004:00080000:2.0:1746140887.342401:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866418096707ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342418:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3468, 88 off293848 00000004:00080000:2.0:1746140887.342421:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866418116280ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342438:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3493, 88 off296232 00000004:00080000:2.0:1746140887.342440:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866418135360ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.342447:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3494, 88 off296320 00000004:00080000:2.0:1746140887.342449:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866418144732ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.342456:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3495, 88 off296408 00000004:00080000:2.0:1746140887.342458:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866418153301ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.342465:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3469, 88 off293936 00000004:00080000:2.0:1746140887.342467:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866418162122ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342482:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3496, 88 off296496 00000004:00080000:2.0:1746140887.342485:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866418180332ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.342493:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3470, 88 off294024 00000004:00080000:2.0:1746140887.342495:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866418190821ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342511:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3497, 88 off296584 00000004:00080000:2.0:1746140887.342514:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866418209571ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.342521:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3471, 88 off294112 00000004:00080000:2.0:1746140887.342523:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866418218283ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342538:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3472, 88 off294200 00000004:00080000:2.0:1746140887.342541:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866418235826ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342554:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3473, 88 off294288 00000004:00080000:2.0:1746140887.342557:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866418252781ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342573:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3474, 88 off294376 00000004:00080000:2.0:1746140887.342576:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866418271262ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.342590:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3498, 88 off296672 00000004:00080000:2.0:1746140887.342593:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866418288213ns, next at 809142599738ns, rc = 0 00000100:00100000:0.0:1746140887.344508:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.344601:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573781888 00000100:00100000:2.0:1746140887.344610:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573781888 00000100:00100000:2.0:1746140887.344649:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17105 00000100:00100000:2.0:1746140887.344656:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+6:32728:x1830960573781888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.344672:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.344687:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a29 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.344708:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.344709:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.344715:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.344733:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.344743:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3c800, rc 0) 00000100:00100000:2.0:1746140887.344782:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32728:x1830960573781888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 127us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.344787:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17105 00000100:00100000:1.0:1746140887.349187:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.349275:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573782016 00000100:00100000:2.0:1746140887.349286:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573782016 00000100:00100000:2.0:1746140887.349354:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17106 00000100:00100000:2.0:1746140887.349362:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:32731:x1830960573782016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.349379:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.349397:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a30 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.349422:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.349424:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.349432:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 19 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.349446:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 19 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.349456:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3c200, rc 0) 00000100:00100000:2.0:1746140887.349518:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:32731:x1830960573782016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 157us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.349524:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17106 00000100:00100000:1.0:1746140887.350235:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.350293:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573782144 00000100:00100000:1.0:1746140887.350299:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573782144 00000100:00100000:1.0:1746140887.350359:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10772 00000100:00100000:1.0:1746140887.350366:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32728:x1830960573782144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.350389:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.350404:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a37 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.350451:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.350458:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 13 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.350472:0:14742:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.350482:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 13 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.350761:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.350764:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140887.350768:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 13 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.350775:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67200, rc 0) 00000100:00100000:1.0:1746140887.350810:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32728:x1830960573782144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 445us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.350817:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10772 00000100:00100000:0.0:1746140887.351962:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.351983:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573782272 00000100:00100000:0.0:1746140887.351989:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573782272 00000100:00100000:0.0:1746140887.352017:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10773 00000100:00100000:0.0:1746140887.352023:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32731:x1830960573782272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.352037:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.352050:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a3e expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.352106:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 269 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.352115:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 269 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.352125:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140887.352128:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140887.352132:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 12 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.352138:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce7400, rc 0) 00000100:00100000:0.0:1746140887.352174:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32731:x1830960573782272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 151us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.352180:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10773 00000001:00080000:1.0:1746140887.362033:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945073 is committed 00000001:00080000:1.0:1746140887.362049:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945072 is committed 00000001:00080000:1.0:1746140887.362065:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945076 is committed 00000004:00080000:1.0:1746140887.362069:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2740 committed 00000004:00080000:1.0:1746140887.362076:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2720 committed 00000004:00080000:1.0:1746140887.362082:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2719 committed 00000004:00080000:1.0:1746140887.362084:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2718 committed 00000004:00080000:1.0:1746140887.362086:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2717 committed 00000004:00080000:1.0:1746140887.362088:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2739 committed 00000004:00080000:1.0:1746140887.362089:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2716 committed 00000004:00080000:1.0:1746140887.362091:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2738 committed 00000004:00080000:1.0:1746140887.362092:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2715 committed 00000004:00080000:1.0:1746140887.362094:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2737 committed 00000004:00080000:1.0:1746140887.362095:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2736 committed 00000004:00080000:1.0:1746140887.362097:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2735 committed 00000004:00080000:1.0:1746140887.362098:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2714 committed 00000004:00080000:1.0:1746140887.362100:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2713 committed 00000004:00080000:1.0:1746140887.362101:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2734 committed 00000004:00080000:1.0:1746140887.362103:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2733 committed 00000004:00080000:1.0:1746140887.362105:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2712 committed 00000001:00080000:1.0:1746140887.362109:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945075 is committed 00000001:00080000:1.0:1746140887.362116:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945071 is committed 00010000:00010000:2.0:1746140887.362150:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.362163:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.362166:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746140887.362170:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.362180:0:14785:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.362187:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.362193:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 266 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.362198:0:14785:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 266 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.362204:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 266 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.362207:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576074368:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746140887.362236:0:14785:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 266 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.362248:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576074624:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140887.362274:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.362340:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576075008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.362360:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746140887.362369:0:14785:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.362380:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576075520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.362381:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576075904:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140887.362391:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576074496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.362399:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.362402:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.362414:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576076160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.362417:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.362436:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.362437:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576075136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.362466:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576074368 00000100:00100000:0.0:1746140887.362473:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576074368 00000100:00100000:3.0:1746140887.362479:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576075008 00000100:00100000:3.0:1746140887.362485:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576075008 00000100:00100000:0.0:1746140887.362503:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17107 00000100:00100000:3.0:1746140887.362506:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576075520 00000100:00100000:3.0:1746140887.362508:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576075520 00000100:00100000:0.0:1746140887.362510:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3312:x1830960576074368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.362519:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576074496 00000100:00100000:3.0:1746140887.362521:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576074496 00000100:00100000:2.0:1746140887.362521:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576076160 00000100:00100000:2.0:1746140887.362527:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576076160 00000100:00100000:3.0:1746140887.362533:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17108 00000100:00100000:3.0:1746140887.362538:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3312:x1830960576075008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.362557:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17109 00000100:00100000:2.0:1746140887.362563:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3312:x1830960576075520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.362568:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17110 00000100:00100000:3.0:1746140887.362573:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3313:x1830960576074496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.362648:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17111 00000100:00100000:3.0:1746140887.362654:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3312:x1830960576076160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140887.362691:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140887.362695:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.362697:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.362700:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.362702:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:2.0:1746140887.362721:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140887.362724:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.362726:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00000100:00100000:0.0:1746140887.362727:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3312:x1830960576074368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (453us total) trans 17179874154 rc 0/0 00002000:00010000:2.0:1746140887.362728:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.362729:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2079 00000100:00100000:0.0:1746140887.362733:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17107 00000100:00100000:3.0:1746140887.362760:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3312:x1830960576076160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (323us total) trans 21474841440 rc 0/0 00000100:00100000:2.0:1746140887.362765:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3312:x1830960576075520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (364us total) trans 21474841439 rc 0/0 00000100:00100000:3.0:1746140887.362766:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17111 00000100:00100000:2.0:1746140887.362771:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17109 00000100:00100000:0.0:1746140887.362778:0:3312:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841426 gen 2 00000004:00080000:0.0:1746140887.362782:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf10000, transno 21474841294 00000004:00080000:0.0:1746140887.362787:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355bed80, transno 21474841295 00000004:00080000:0.0:1746140887.362790:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355be300, transno 21474841296 00000004:00080000:0.0:1746140887.362792:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355bc380, transno 21474841297 00000004:00080000:0.0:1746140887.362795:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355bce00, transno 21474841298 00000004:00080000:0.0:1746140887.362797:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355bd500, transno 21474841299 00000004:00080000:0.0:1746140887.362800:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355bc000, transno 21474841300 00000004:00080000:0.0:1746140887.362802:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355bdf80, transno 21474841301 00000004:00080000:0.0:1746140887.362804:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f079c00, transno 21474841302 00002000:00010000:3.0:1746140887.362805:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00000004:00080000:0.0:1746140887.362807:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07b480, transno 21474841303 00002000:00010000:3.0:1746140887.362808:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00000004:00080000:0.0:1746140887.362809:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0c380, transno 21474841304 00002000:00010000:3.0:1746140887.362810:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00000004:00080000:0.0:1746140887.362811:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f079500, transno 21474841305 00002000:00010000:3.0:1746140887.362812:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00000004:00080000:0.0:1746140887.362813:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092610000, transno 21474841306 00002000:00010000:3.0:1746140887.362814:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000004:00080000:0.0:1746140887.362815:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07b800, transno 21474841307 00000004:00080000:0.0:1746140887.362818:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092611f80, transno 21474841308 00000004:00080000:0.0:1746140887.362820:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07b100, transno 21474841309 00000004:00080000:0.0:1746140887.362822:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092612680, transno 21474841310 00000004:00080000:0.0:1746140887.362824:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b891f80, transno 21474841311 00000004:00080000:0.0:1746140887.362826:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bdc00, transno 21474841323 00000004:00080000:0.0:1746140887.362828:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bea00, transno 21474841324 00000004:00080000:0.0:1746140887.362831:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bf100, transno 21474841325 00000100:00100000:3.0:1746140887.362832:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3313:x1830960576074496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (415us total) trans 17179874155 rc 0/0 00000004:00080000:0.0:1746140887.362834:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099495500, transno 21474841326 00000004:00080000:0.0:1746140887.362836:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bc380, transno 21474841327 00000100:00100000:3.0:1746140887.362837:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17110 00000004:00080000:0.0:1746140887.362838:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bc000, transno 21474841328 00000004:00080000:0.0:1746140887.362846:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bd180, transno 21474841329 00000004:00080000:0.0:1746140887.362849:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bed80, transno 21474841330 00000004:00080000:0.0:1746140887.362851:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099495f80, transno 21474841331 00000004:00080000:0.0:1746140887.362854:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baea00, transno 21474841332 00000004:00080000:0.0:1746140887.362857:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baed80, transno 21474841333 00000004:00080000:0.0:1746140887.362859:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bac700, transno 21474841334 00000004:00080000:0.0:1746140887.362862:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bae300, transno 21474841335 00000004:00080000:0.0:1746140887.362864:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6badc00, transno 21474841336 00000004:00080000:0.0:1746140887.362866:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bad500, transno 21474841337 00000004:00080000:0.0:1746140887.362868:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f518000, transno 21474841338 00000004:00080000:0.0:1746140887.362870:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bae680, transno 21474841339 00000004:00080000:0.0:1746140887.362872:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6baca80, transno 21474841340 00000004:00080000:0.0:1746140887.362874:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519880, transno 21474841341 00000004:00080000:0.0:1746140887.362876:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51ad80, transno 21474841342 00000004:00080000:0.0:1746140887.362879:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51b800, transno 21474841343 00000004:00080000:0.0:1746140887.362882:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eeab800, transno 21474841344 00000004:00080000:0.0:1746140887.362884:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51b100, transno 21474841345 00000004:00080000:0.0:1746140887.362886:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519500, transno 21474841346 00000100:00100000:1.0:1746140887.362889:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140887.362889:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519180, transno 21474841347 00000004:00080000:0.0:1746140887.362891:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea9500, transno 21474841348 00000004:00080000:0.0:1746140887.362893:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f51aa00, transno 21474841349 00000004:00080000:0.0:1746140887.362896:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f782300, transno 21474841353 00000004:00080000:0.0:1746140887.362898:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f781500, transno 21474841354 00000004:00080000:0.0:1746140887.362901:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea9c00, transno 21474841355 00000004:00080000:0.0:1746140887.362903:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f781880, transno 21474841356 00000004:00080000:0.0:1746140887.362905:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f780e00, transno 21474841357 00000004:00080000:0.0:1746140887.362908:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f781f80, transno 21474841358 00000004:00080000:0.0:1746140887.362911:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea8e00, transno 21474841359 00000004:00080000:0.0:1746140887.362913:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6bac380, transno 21474841360 00000004:00080000:0.0:1746140887.362915:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f783480, transno 21474841361 00000004:00080000:0.0:1746140887.362917:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135699c00, transno 21474841365 00000004:00080000:0.0:1746140887.362919:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece0000, transno 21474841366 00000004:00080000:0.0:1746140887.362922:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013569a680, transno 21474841367 00000004:00080000:0.0:1746140887.362924:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135699500, transno 21474841368 00000004:00080000:0.0:1746140887.362926:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013569a300, transno 21474841369 00000004:00080000:0.0:1746140887.362929:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b66680, transno 21474841370 00000004:00080000:0.0:1746140887.362931:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135698380, transno 21474841371 00000004:00080000:0.0:1746140887.362934:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135699880, transno 21474841372 00000004:00080000:0.0:1746140887.362936:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece0a80, transno 21474841373 00000004:00080000:0.0:1746140887.362938:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cca80, transno 21474841381 00000004:00080000:0.0:1746140887.362941:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094add180, transno 21474841382 00000004:00080000:0.0:1746140887.362943:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adc000, transno 21474841383 00000004:00080000:0.0:1746140887.362946:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3b5c00, transno 21474841384 00000004:00080000:0.0:1746140887.362948:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adc700, transno 21474841385 00000004:00080000:0.0:1746140887.362949:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adca80, transno 21474841386 00000004:00080000:0.0:1746140887.362952:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c3800, transno 21474841387 00000004:00080000:0.0:1746140887.362954:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ce680, transno 21474841388 00000004:00080000:0.0:1746140887.362956:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adf100, transno 21474841389 00000004:00080000:0.0:1746140887.362958:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3b7b80, transno 21474841393 00000004:00080000:0.0:1746140887.362961:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b1b1c00, transno 21474841394 00000004:00080000:0.0:1746140887.362963:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3b6300, transno 21474841395 00000004:00080000:0.0:1746140887.362965:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b1b3b80, transno 21474841396 00000004:00080000:0.0:1746140887.362967:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3b5880, transno 21474841397 00000004:00080000:0.0:1746140887.362969:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3b5f80, transno 21474841398 00000004:00080000:0.0:1746140887.362971:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3b7100, transno 21474841399 00000004:00080000:0.0:1746140887.362973:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3b4a80, transno 21474841400 00000004:00080000:0.0:1746140887.362976:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b3100, transno 21474841401 00000004:00080000:0.0:1746140887.362978:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093135880, transno 21474841402 00000004:00080000:0.0:1746140887.362980:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093135f80, transno 21474841403 00000004:00080000:0.0:1746140887.362982:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d2b800, transno 21474841404 00000004:00080000:0.0:1746140887.362983:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d2b480, transno 21474841405 00000004:00080000:0.0:1746140887.362986:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093135500, transno 21474841406 00000004:00080000:0.0:1746140887.362989:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d29880, transno 21474841407 00000004:00080000:0.0:1746140887.362991:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093136300, transno 21474841408 00000004:00080000:0.0:1746140887.362994:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d2ad80, transno 21474841409 00000004:00080000:0.0:1746140887.362996:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f123480, transno 21474841410 00000004:00080000:0.0:1746140887.362999:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d082a00, transno 21474841418 00000004:00080000:0.0:1746140887.363001:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094af5c00, transno 21474841419 00000004:00080000:0.0:1746140887.363004:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094452d80, transno 21474841420 00000004:00080000:0.0:1746140887.363006:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094af4700, transno 21474841421 00000004:00080000:0.0:1746140887.363008:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094af5500, transno 21474841422 00000004:00080000:0.0:1746140887.363010:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094af5180, transno 21474841423 00000004:00080000:0.0:1746140887.363012:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d083480, transno 21474841424 00000004:00080000:0.0:1746140887.363014:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094af4000, transno 21474841425 00000004:00080000:0.0:1746140887.363017:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f72b800, transno 21474841426 00000100:00100000:0.0:1746140887.363024:0:3312:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a513d180 x1830960576073216/t21474841430(21474841430) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746140903 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746140887.363034:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09aa00/2, rc 0, transno 21474841440 00000100:00100000:1.0:1746140887.363036:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576075648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.363039:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576076160:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.363061:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f099c00/2, rc 0, transno 21474841439 00000100:00100000:0.0:1746140887.363065:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576075520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.363073:0:3312:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874142 gen 2 00000100:00100000:1.0:1746140887.363074:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140887.363076:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b0e00, transno 17179874021 00000004:00080000:0.0:1746140887.363082:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b0380, transno 17179874022 00000004:00080000:0.0:1746140887.363085:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b2a00, transno 17179874023 00000004:00080000:0.0:1746140887.363088:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b1180, transno 17179874024 00000100:00100000:1.0:1746140887.363089:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576076288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.363090:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b2d80, transno 17179874025 00000004:00080000:0.0:1746140887.363094:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b3b80, transno 17179874026 00000004:00080000:0.0:1746140887.363096:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094452680, transno 17179874027 00000004:00080000:0.0:1746140887.363098:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b2680, transno 17179874028 00000004:00080000:0.0:1746140887.363101:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a513e680, transno 17179874029 00000100:00100000:1.0:1746140887.363103:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140887.363104:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a513ca80, transno 17179874030 00000004:00080000:0.0:1746140887.363107:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a513d880, transno 17179874031 00000004:00080000:0.0:1746140887.363110:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abde680, transno 17179874032 00000004:00080000:0.0:1746140887.363112:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc08380, transno 17179874033 00000004:00080000:0.0:1746140887.363115:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abded80, transno 17179874034 00000004:00080000:0.0:1746140887.363117:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a513f100, transno 17179874035 00000004:00080000:0.0:1746140887.363119:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc09c00, transno 17179874036 00000004:00080000:0.0:1746140887.363122:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354be300, transno 17179874046 00000004:00080000:0.0:1746140887.363124:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bfb80, transno 17179874047 00000004:00080000:0.0:1746140887.363126:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bce00, transno 17179874048 00000004:00080000:0.0:1746140887.363128:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bca80, transno 17179874049 00000004:00080000:0.0:1746140887.363130:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bd500, transno 17179874050 00000004:00080000:0.0:1746140887.363132:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bdf80, transno 17179874051 00000004:00080000:0.0:1746140887.363135:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bc700, transno 17179874052 00000004:00080000:0.0:1746140887.363137:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bd880, transno 17179874053 00000004:00080000:0.0:1746140887.363140:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180e00, transno 17179874054 00000004:00080000:0.0:1746140887.363142:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181500, transno 17179874055 00000004:00080000:0.0:1746140887.363145:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181f80, transno 17179874056 00000004:00080000:0.0:1746140887.363148:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b182d80, transno 17179874057 00000004:00080000:0.0:1746140887.363150:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180380, transno 17179874058 00000004:00080000:0.0:1746140887.363152:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180700, transno 17179874059 00000004:00080000:0.0:1746140887.363154:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b180a80, transno 17179874060 00000004:00080000:0.0:1746140887.363156:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b181c00, transno 17179874061 00000004:00080000:0.0:1746140887.363159:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fcd2680, transno 17179874062 00000004:00080000:0.0:1746140887.363162:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fcd3480, transno 17179874063 00000004:00080000:0.0:1746140887.363164:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fcd2a00, transno 17179874064 00000004:00080000:0.0:1746140887.363167:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fcd3800, transno 17179874065 00000004:00080000:0.0:1746140887.363168:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fcd2d80, transno 17179874066 00000004:00080000:0.0:1746140887.363170:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fcd3b80, transno 17179874067 00000004:00080000:0.0:1746140887.363172:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fcd3100, transno 17179874068 00000004:00080000:0.0:1746140887.363174:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b754000, transno 17179874069 00000004:00080000:0.0:1746140887.363176:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c2d80, transno 17179874074 00000004:00080000:0.0:1746140887.363179:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c2680, transno 17179874075 00000004:00080000:0.0:1746140887.363180:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c2300, transno 17179874076 00000004:00080000:0.0:1746140887.363183:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c0a80, transno 17179874077 00000004:00080000:0.0:1746140887.363185:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c1f80, transno 17179874078 00000004:00080000:0.0:1746140887.363186:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c2a00, transno 17179874079 00000004:00080000:0.0:1746140887.363188:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c3480, transno 17179874080 00000004:00080000:0.0:1746140887.363190:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c3b80, transno 17179874081 00000004:00080000:0.0:1746140887.363192:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f519f80, transno 17179874085 00000004:00080000:0.0:1746140887.363194:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece3b80, transno 17179874086 00000004:00080000:0.0:1746140887.363196:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf13800, transno 17179874087 00000004:00080000:0.0:1746140887.363198:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece1500, transno 17179874088 00000004:00080000:0.0:1746140887.363200:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece2680, transno 17179874089 00000004:00080000:0.0:1746140887.363202:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece0380, transno 17179874090 00000004:00080000:0.0:1746140887.363204:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf12680, transno 17179874091 00000004:00080000:0.0:1746140887.363207:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece1880, transno 17179874092 00000004:00080000:0.0:1746140887.363209:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cd500, transno 17179874101 00000004:00080000:0.0:1746140887.363211:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cf800, transno 17179874102 00000004:00080000:0.0:1746140887.363214:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0f800, transno 17179874103 00000004:00080000:0.0:1746140887.363216:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ce00, transno 17179874104 00000004:00080000:0.0:1746140887.363219:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cdc00, transno 17179874105 00000004:00080000:0.0:1746140887.363221:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0d180, transno 17179874106 00000004:00080000:0.0:1746140887.363224:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ced80, transno 17179874107 00000004:00080000:0.0:1746140887.363226:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0fb80, transno 17179874108 00000004:00080000:0.0:1746140887.363228:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b753100, transno 17179874112 00000004:00080000:0.0:1746140887.363231:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d082680, transno 17179874113 00000004:00080000:0.0:1746140887.363233:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b753800, transno 17179874114 00000004:00080000:0.0:1746140887.363235:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b752a00, transno 17179874115 00000004:00080000:0.0:1746140887.363237:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d081880, transno 17179874116 00000004:00080000:0.0:1746140887.363240:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d082d80, transno 17179874117 00000004:00080000:0.0:1746140887.363242:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b750380, transno 17179874118 00000004:00080000:0.0:1746140887.363245:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b751880, transno 17179874119 00000004:00080000:0.0:1746140887.363247:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092612a00, transno 17179874120 00000004:00080000:0.0:1746140887.363249:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ed80, transno 17179874121 00000004:00080000:0.0:1746140887.363251:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092613100, transno 17179874122 00000004:00080000:0.0:1746140887.363253:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0e300, transno 17179874123 00000004:00080000:0.0:1746140887.363255:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135699f80, transno 17179874124 00000004:00080000:0.0:1746140887.363257:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0d500, transno 17179874125 00000004:00080000:0.0:1746140887.363260:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf11180, transno 17179874126 00000004:00080000:0.0:1746140887.363262:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ea00, transno 17179874127 00000004:00080000:0.0:1746140887.363264:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a8380, transno 17179874135 00000004:00080000:0.0:1746140887.363266:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24f100, transno 17179874136 00000004:00080000:0.0:1746140887.363268:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24f800, transno 17179874137 00000004:00080000:0.0:1746140887.363270:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a8000, transno 17179874138 00000004:00080000:0.0:1746140887.363272:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a9180, transno 17179874139 00000004:00080000:0.0:1746140887.363274:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cc380, transno 17179874140 00000004:00080000:0.0:1746140887.363276:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f24e680, transno 17179874141 00000004:00080000:0.0:1746140887.363278:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cea00, transno 17179874142 00000100:00100000:0.0:1746140887.363284:0:3312:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880130d2b100 x1830960576071680/t17179874146(17179874146) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746140903 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746140887.363290:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f098000/2, rc 0, transno 17179874154 00000100:00100000:3.0:1746140887.363293:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3312:x1830960576075008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 755us (932us total) trans 17179874156 rc 0/0 00000100:00100000:0.0:1746140887.363294:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576074368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.363299:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17108 00000004:00080000:1.0:1746140887.363337:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f098380/2, rc 0, transno 17179874155 00000100:00100000:1.0:1746140887.363341:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576074496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.363354:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576074752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.363373:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.363384:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576075264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.363396:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.363403:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576075776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.363414:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.363422:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576076416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.363434:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.363445:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576075136 00000100:00100000:2.0:1746140887.363451:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576075136 00000100:00100000:1.0:1746140887.363451:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746140887.363466:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576074880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.363468:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576075648 00000100:00100000:3.0:1746140887.363471:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576075648 00000100:00100000:2.0:1746140887.363475:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576076288 00000100:00100000:2.0:1746140887.363477:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576076288 00000100:00100000:1.0:1746140887.363481:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.363488:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576074752 00000100:00100000:3.0:1746140887.363490:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576074752 00000100:00100000:2.0:1746140887.363494:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576075264 00000100:00100000:1.0:1746140887.363494:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576075392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.363496:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576075264 00000100:00100000:3.0:1746140887.363498:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576075776 00000100:00100000:3.0:1746140887.363500:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576075776 00000100:00100000:2.0:1746140887.363504:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576076416 00000100:00100000:1.0:1746140887.363506:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.363507:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576074880 00000100:00100000:2.0:1746140887.363507:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576076416 00000100:00100000:3.0:1746140887.363509:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576074880 00000100:00100000:1.0:1746140887.363513:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576076032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.363515:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576075392 00000100:00100000:2.0:1746140887.363517:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576075392 00000100:00100000:3.0:1746140887.363519:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17112 00000100:00100000:3.0:1746140887.363524:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f09bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3313:x1830960576075136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.363524:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.363527:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576076032 00000100:00100000:2.0:1746140887.363528:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576076032 00000100:00100000:1.0:1746140887.363531:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576076544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.363541:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.363562:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576076544 00000100:00100000:1.0:1746140887.363564:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576076544 00000100:00100000:2.0:1746140887.363570:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17113 00000100:00100000:2.0:1746140887.363576:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3313:x1830960576075648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.363581:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17114 00000100:00100000:1.0:1746140887.363586:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3313:x1830960576076288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.363607:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f09bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3313:x1830960576075136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (718us total) trans 17179874157 rc 0/0 00000100:00100000:3.0:1746140887.363613:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17112 00000100:00100000:3.0:1746140887.363622:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17115 00000100:00100000:3.0:1746140887.363626:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3310:x1830960576074752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.363667:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3313:x1830960576076288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (563us total) trans 21474841441 rc 0/0 00000100:00100000:1.0:1746140887.363672:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17114 00000100:00100000:1.0:1746140887.363681:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17116 00000100:00100000:1.0:1746140887.363685:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576075264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746140887.363687:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746140887.363689:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.363691:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.363693:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.363695:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746140887.363714:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576074752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (340us total) trans 17179874158 rc 0/0 00000100:00100000:3.0:1746140887.363722:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17115 00000100:00100000:3.0:1746140887.363730:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17117 00000100:00100000:3.0:1746140887.363734:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576075776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.363759:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576075264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (362us total) trans 17179874159 rc 0/0 00000100:00100000:1.0:1746140887.363763:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17116 00000100:00100000:1.0:1746140887.363772:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17118 00000100:00100000:1.0:1746140887.363776:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576076416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140887.363802:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:3.0:1746140887.363805:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.363806:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.363808:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.363810:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5513 -> 5521 00000100:00100000:3.0:1746140887.363826:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960576075776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (411us total) trans 21474841442 rc 0/0 00000100:00100000:3.0:1746140887.363830:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17117 00000100:00100000:3.0:1746140887.363839:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17119 00000100:00100000:3.0:1746140887.363843:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3310:x1830960576074880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.363844:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3310:x1830960576076416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (410us total) trans 21474841443 rc 0/0 00000100:00100000:1.0:1746140887.363849:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17118 00000100:00100000:1.0:1746140887.363856:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17120 00000100:00100000:1.0:1746140887.363861:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3310:x1830960576075392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.363915:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576074880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (433us total) trans 17179874160 rc 0/0 00000100:00100000:3.0:1746140887.363920:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17119 00000100:00100000:3.0:1746140887.363930:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17121 00000100:00100000:3.0:1746140887.363934:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576076032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.364008:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3310:x1830960576076032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (483us total) trans 21474841444 rc 0/0 00000100:00100000:3.0:1746140887.364014:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17121 00000100:00100000:3.0:1746140887.364023:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17122 00000100:00100000:3.0:1746140887.364027:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576076544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.364107:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3310:x1830960576076544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (564us total) trans 21474841445 rc 0/0 00000100:00100000:1.0:1746140887.364110:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576075392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 249us (603us total) trans 17179874161 rc 0/0 00000100:00100000:3.0:1746140887.364113:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17122 00000100:00100000:1.0:1746140887.364115:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17120 00000004:00080000:1.0:1746140887.364143:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f098a80/2, rc 0, transno 17179874160 00000100:00100000:1.0:1746140887.364146:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576074880:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140887.364152:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f099880/2, rc 0, transno 17179874161 00000100:00100000:1.0:1746140887.364154:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576075392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140887.364159:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09a680/2, rc 0, transno 21474841444 00000100:00100000:1.0:1746140887.364161:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576076032:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140887.364166:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09b480/2, rc 0, transno 21474841445 00000100:00100000:1.0:1746140887.364168:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576076544:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746140887.364257:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140887.364260:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.364263:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.364264:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.364266:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746140887.364335:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3313:x1830960576075648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 727us (1228us total) trans 21474841446 rc 0/0 00000004:00080000:1.0:1746140887.364341:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f098700/2, rc 0, transno 17179874158 00000100:00100000:2.0:1746140887.364342:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17113 00000100:00100000:1.0:1746140887.364345:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576074752:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140887.364353:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f099500/2, rc 0, transno 17179874159 00000100:00100000:1.0:1746140887.364355:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576075264:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140887.364360:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09a300/2, rc 0, transno 21474841442 00000100:00100000:1.0:1746140887.364362:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576075776:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140887.364367:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09b100/2, rc 0, transno 21474841443 00000100:00100000:1.0:1746140887.364369:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576076416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140887.364384:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f099180/2, rc 0, transno 17179874157 00000100:00100000:1.0:1746140887.364386:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576075136:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140887.364393:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f099f80/2, rc 0, transno 21474841446 00000100:00100000:1.0:1746140887.364396:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576075648:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140887.364401:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09ad80/2, rc 0, transno 21474841441 00000100:00100000:1.0:1746140887.364403:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576076288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.364625:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f098e00/2, rc 0, transno 17179874156 00000100:00100000:0.0:1746140887.364629:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576075008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.365263:0:14783:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 17 in progress, 0 in flight, 99 done 00000100:00100000:1.0:1746140887.365396:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746140887.365409:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576076672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.365443:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.365671:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.365683:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576074624:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.365694:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576075904:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140887.365698:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.365717:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573782400 00000100:00100000:2.0:1746140887.365721:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573782400 00010000:00010000:3.0:1746140887.365733:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb8400/0x8156357b7fdba922 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 10 pid: 14785 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1746140887.365746:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573782528 00000100:00100000:2.0:1746140887.365748:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573782528 00010000:00010000:3.0:1746140887.365751:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.365762:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4731 00000100:00100000:2.0:1746140887.365769:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32731:x1830960573782400:12345-192.168.204.16@tcp:49:cat.0 00010000:00010000:3.0:1746140887.365781:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fb9800, rc 0) 00000100:00100000:2.0:1746140887.365834:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32731:x1830960573782400:12345-192.168.204.16@tcp:49:cat.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.365836:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32726:x1830960573781504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 32417us (32597us total) trans 8589945076 rc 0/0 00000100:00100000:2.0:1746140887.365841:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4731 00000100:00100000:3.0:1746140887.365843:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10771 00000100:00100000:2.0:1746140887.365853:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4732 00000100:00100000:2.0:1746140887.365858:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32728:x1830960573782528:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:2.0:1746140887.365887:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32728:x1830960573782528:12345-192.168.204.16@tcp:49:cat.0 Request processed in 28us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.365892:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4732 00000004:00080000:0.0:1746140887.367074:0:14789:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 16 in progress, 0 in flight, 88 done 00000100:00100000:0.0:1746140887.367093:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576076672 00000100:00100000:0.0:1746140887.367098:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576076672 00000100:00100000:0.0:1746140887.367135:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17123 00000100:00100000:0.0:1746140887.367141:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3313:x1830960576076672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.367396:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3313:x1830960576076672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 255us (1953us total) trans 21474841447 rc 0/0 00000100:00100000:0.0:1746140887.367400:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17123 00000004:00080000:1.0:1746140887.367421:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1edc00/2, rc 0, transno 21474841447 00000100:00100000:1.0:1746140887.367427:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576076672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.371562:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.371877:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573782784 00000100:00100000:2.0:1746140887.371888:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573782784 00002000:00100000:2.0:1746140887.372006:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f1edf80 x1830960573782784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.372018:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1edf80 with x1830960573782784 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.372024:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f1edf80 00000100:00100000:2.0:1746140887.372062:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8757 00000100:00100000:2.0:1746140887.372070:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1983:x1830960573782784:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.373746:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.373790:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.373990:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573783168 00000100:00100000:1.0:1746140887.373997:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573783168 00000100:00100000:1.0:1746140887.374032:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17124 00000100:00100000:1.0:1746140887.374038:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+11:32725:x1830960573783168:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140887.374050:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.374078:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a45 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.374103:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 10 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.374110:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.374111:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.374114:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 12 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.374142:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 10 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.374157:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 10 pid: 4186 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.374168:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576076800:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.374240:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473a780 going to sleep for 11 seconds 00000100:00100000:3.0:1746140887.374426:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573783040 00000100:00100000:3.0:1746140887.374436:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573783040 00002000:00100000:3.0:1746140887.374477:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f1ee300 x1830960573783040/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.374486:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ee300 with x1830960573783040 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.374491:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1ee300 00000100:00100000:3.0:1746140887.374509:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8758 00000100:00100000:3.0:1746140887.374514:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573783040:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140887.376275:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.376340:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576076800:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.376364:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 12 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.376380:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83c00, rc 0) 00000100:00100000:1.0:1746140887.376407:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:32725:x1830960573783168:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2369us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.376415:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17124 00000100:00100000:0.0:1746140887.377045:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573783296 00000100:00100000:0.0:1746140887.377065:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573783296 00010000:00010000:0.0:1746140887.377092:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 11 pid: 4186 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.377125:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8850 00000100:00100000:0.0:1746140887.377131:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573783296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.377142:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.377163:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 11 pid: 4186 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.377395:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 11 pid: 4186 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.377417:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdba811 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c7 expref: 11 pid: 4186 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.377428:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.377430:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.377437:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 11 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.377444:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 11 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.377474:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 11 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.377485:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576076928:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140887.377539:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.383287:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.383426:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573783552 00000100:00100000:2.0:1746140887.383433:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576076928:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140887.383434:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573783552 00010000:00010000:2.0:1746140887.383459:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746140887.383473:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4116480->4120575) req@ffff88009f1eed80 x1830960573783552/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.383482:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1eed80 with x1830960573783552 ext(4116480->4120575) 00002000:00010000:1.0:1746140887.383487:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1eed80 00000100:00100000:2.0:1746140887.383511:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573783296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6378us (7241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.383520:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8850 00000100:00100000:1.0:1746140887.383695:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8759 00000100:00100000:1.0:1746140887.383704:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1985:x1830960573783552:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140887.383869:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1983:x1830960573782784:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11799us (12318us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.383877:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8757 00002000:00100000:3.0:1746140887.383887:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f1edf80 x1830960573782784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.383895:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1edf80 with x1830960573782784 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.383900:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f1edf80 00000100:00100000:1.0:1746140887.383941:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1985:x1830960573783552:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 238us (664us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140887.383949:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8759 00002000:00100000:1.0:1746140887.383955:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4116480->4120575) req@ffff88009f1eed80 x1830960573783552/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.383962:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1eed80 with x1830960573783552 ext(4116480->4120575) 00002000:00010000:1.0:1746140887.383965:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1eed80 00000100:00100000:0.0:1746140887.386852:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.386920:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573783680 00000100:00100000:1.0:1746140887.386929:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573783680 00000100:00100000:1.0:1746140887.386977:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17125 00000100:00100000:3.0:1746140887.386980:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573783040:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12459us (13239us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.386985:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:32731:x1830960573783680:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140887.386990:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8758 00002000:00100000:3.0:1746140887.386999:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f1ee300 x1830960573783040/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746140887.387001:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746140887.387007:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ee300 with x1830960573783040 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.387012:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1ee300 00010000:00010000:1.0:1746140887.387018:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a4c expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.387041:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.387043:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.387050:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.387076:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.387087:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5228000, rc 0) 00000100:00100000:1.0:1746140887.387120:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:32731:x1830960573783680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 137us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.387125:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17125 00000100:00100000:0.0:1746140887.388156:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.388270:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573783808 00000100:00100000:1.0:1746140887.388476:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573783808 00000100:00100000:1.0:1746140887.388504:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17126 00000100:00100000:1.0:1746140887.388510:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:32725:x1830960573783808:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140887.388521:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.388533:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a53 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.388554:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 10 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.388560:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.388561:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.388564:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->3964927] (req 3145728->3964927) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 20 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.388591:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 10 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.388602:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 10 pid: 32376 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.388613:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576077056:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.388689:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.389719:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576077056:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.389748:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->3964927] (req 3145728->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 20 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.389766:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5229000, rc 0) 00000100:00100000:2.0:1746140887.389825:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:32725:x1830960573783808:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1310us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.389833:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17126 00000100:00100000:2.0:1746140887.390177:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.390213:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.390230:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.390254:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.390281:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573784192 00000100:00100000:2.0:1746140887.390287:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573784192 00010000:00010000:2.0:1746140887.390332:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 11 pid: 32376 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.390353:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8851 00000100:00100000:2.0:1746140887.390359:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573784192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.390369:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140887.390378:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573784064 00000100:00100000:3.0:1746140887.390381:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573784064 00010000:00010000:2.0:1746140887.390388:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 11 pid: 32376 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.390397:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 11 pid: 32376 timeout: 966 lvb_type: 1 00002000:00100000:3.0:1746140887.390405:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f72aa00 x1830960573784064/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.390413:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f72aa00 with x1830960573784064 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.390416:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f72aa00 00010000:00010000:2.0:1746140887.390416:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8e200/0x8156357b7fdba81f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ce expref: 11 pid: 32376 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.390428:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.390430:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.390435:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.390438:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8760 00010000:00010000:2.0:1746140887.390442:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.390444:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1984:x1830960573784064:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:2.0:1746140887.390467:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.390476:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576077184:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140887.390515:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573784320 00000100:00100000:2.0:1746140887.390517:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.390523:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573784320 00000100:00100000:2.0:1746140887.390535:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573784448 00000100:00100000:2.0:1746140887.390538:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573784448 00000100:00100000:1.0:1746140887.390559:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17127 00000100:00100000:2.0:1746140887.390565:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17128 00000100:00100000:1.0:1746140887.390566:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32726:x1830960573784320:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:2.0:1746140887.390571:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573784448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.390579:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.390581:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.390589:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4179800/0x8156357b7fdba961 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a61 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.390594:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a5a expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.390614:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140887.390619:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576077312:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.390622:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.390629:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 10 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.390635:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.390636:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.390639:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1548288->2097151] (req 1548288->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.390641:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7526c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746140887.390663:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 10 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.390671:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 10 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.390680:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576077440:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.390735:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 13 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.390747:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 13 pid: 4785 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.390755:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576077568:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.390784:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.390791:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 9 pid: 4186 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.390799:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576077696:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.390830:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.392207:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.392452:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573784576 00000100:00100000:3.0:1746140887.392458:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573784576 00000100:00100000:2.0:1746140887.392478:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576077184:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.392488:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17129 00010000:00010000:2.0:1746140887.392493:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.392494:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1983:x1830960573784576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140887.392504:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.392516:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdba96f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a68 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.392516:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573784192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2158us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.392524:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8851 00000100:00100000:3.0:1746140887.392550:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576077824:192.168.204.16@tcp:106: 00002000:00010000:2.0:1746140887.392581:0:4785:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime: 1746140887 -> 1746140888 00002000:00010000:2.0:1746140887.392584:0:4785:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140887 -> 1746140888 00002000:00010000:2.0:1746140887.392586:0:4785:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime: 1746140887 -> 1746140888 00000100:00100000:3.0:1746140887.392597:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719240 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.392599:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576077312:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140887.392612:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4179800/0x8156357b7fdba961 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a61 expref: 10 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.392621:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4179800/0x8156357b7fdba961 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a61 expref: 10 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.392635:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4179800, rc 0) 00000100:00100000:2.0:1746140887.392650:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573784448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2080us (2396us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140887.392656:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17128 00000100:00100000:1.0:1746140887.396507:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.396568:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.396588:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576077440:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.396605:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576077568:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.396616:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576077696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.396646:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1548288->2097151] (req 1548288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.396663:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5228400, rc 0) 00002000:00010000:3.0:1746140887.396712:0:9872:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime: 1746140887 -> 1746140888 00000100:00100000:2.0:1746140887.396715:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32726:x1830960573784320:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6147us (6481us total) trans 0 rc 0/0 00002000:00010000:3.0:1746140887.396716:0:9872:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140887 -> 1746140888 00002000:00010000:3.0:1746140887.396718:0:9872:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime: 1746140887 -> 1746140888 00000100:00100000:2.0:1746140887.396723:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17127 00000100:00100000:3.0:1746140887.396736:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576077824:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140887.396756:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573784704 00010000:00010000:3.0:1746140887.396758:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdba96f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a68 expref: 8 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140887.396761:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573784704 00010000:00010000:3.0:1746140887.396767:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130889e00/0x8156357b7fdba96f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a68 expref: 8 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.396779:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.396797:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573784832 00000100:00100000:2.0:1746140887.396798:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573784832 00010000:00010000:2.0:1746140887.396806:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 10 pid: 4186 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.396823:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8852 00000100:00100000:2.0:1746140887.396829:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573784704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.396839:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.396851:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.396859:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.396875:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ee3c800/0x8156357b7fdba930 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a29 expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.396883:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140887.396887:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130889e00, rc 0) 00000100:00100000:2.0:1746140887.396898:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573784704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.396904:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8852 00000100:00100000:3.0:1746140887.396909:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1983:x1830960573784576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4415us (4708us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140887.396915:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17129 00000100:00100000:2.0:1746140887.396915:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8853 00000100:00100000:2.0:1746140887.396920:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573784832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.396924:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.396931:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 10 pid: 4186 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.396937:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 10 pid: 4186 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.396951:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e308000/0x8156357b7fdba826 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19c0 expref: 10 pid: 4186 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.396958:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.396972:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573784832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.396977:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8853 00000100:00100000:3.0:1746140887.397537:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1984:x1830960573784064:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7091us (7359us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.397545:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8760 00002000:00100000:3.0:1746140887.397552:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f72aa00 x1830960573784064/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.397563:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f72aa00 with x1830960573784064 ext(1048576->2097151) 00010000:00010000:3.0:1746140887.397568:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 13 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.397579:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 13 pid: 4785 timeout: 966 lvb_type: 0 00002000:00010000:3.0:1746140887.397584:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f72aa00 00000100:00100000:0.0:1746140887.399160:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.399240:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573784960 00000100:00100000:3.0:1746140887.399246:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573784960 00000100:00100000:2.0:1746140887.399411:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17130 00000100:00100000:2.0:1746140887.399420:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32728:x1830960573784960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.399434:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.399450:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a6f expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.399474:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 12 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.399482:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140887.399484:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140887.399487:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.399513:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 12 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.399523:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 12 pid: 4785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.399538:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576077952:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.399597:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.399785:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.399865:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573785216 00000100:00100000:3.0:1746140887.399869:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573785216 00002000:00100000:3.0:1746140887.399892:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3960832->3964927) req@ffff88009f1efb80 x1830960573785216/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.399901:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1efb80 with x1830960573785216 ext(3960832->3964927) 00002000:00010000:3.0:1746140887.399904:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f1efb80 00000100:00100000:3.0:1746140887.399917:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8761 00000100:00100000:3.0:1746140887.399922:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573785216:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140887.400114:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573785216:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 191us (329us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140887.400120:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8761 00002000:00100000:3.0:1746140887.400126:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3960832->3964927) req@ffff88009f1efb80 x1830960573785216/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.400132:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1efb80 with x1830960573785216 ext(3960832->3964927) 00002000:00010000:3.0:1746140887.400135:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f1efb80 00000100:00100000:0.0:1746140887.401527:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.401599:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573785344 00000100:00100000:1.0:1746140887.401604:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573785344 00002000:00100000:1.0:1746140887.401630:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4116480->4194303) req@ffff88009f1ec380 x1830960573785344/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.401637:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ec380 with x1830960573785344 ext(4116480->4194303) 00010000:00010000:1.0:1746140887.401644:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 13 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.401654:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 13 pid: 4785 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.401664:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f1ec380 00000100:00100000:1.0:1746140887.401688:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1813 00000100:00100000:1.0:1746140887.401695:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1983:x1830960573785344:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140887.401779:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576077952:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.401799:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.401812:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547ca00, rc 0) 00000100:00100000:2.0:1746140887.401831:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32728:x1830960573784960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2413us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.401837:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17130 00000100:00100000:0.0:1746140887.403099:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.403131:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.403170:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573785472 00000100:00100000:3.0:1746140887.403176:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573785472 00000100:00100000:0.0:1746140887.403181:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.403182:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573785600 00000100:00100000:2.0:1746140887.403186:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573785600 00010000:00010000:3.0:1746140887.403199:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 16 pid: 4785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.403210:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17131 00000100:00100000:2.0:1746140887.403215:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:32731:x1830960573785600:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140887.403221:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8854 00010000:00010000:2.0:1746140887.403224:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140887.403227:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573785472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.403236:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.403236:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a76 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.403250:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 17 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.403252:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140887.403256:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.403260:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 17 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.403264:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.403272:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547d000, rc 0) 00010000:00010000:3.0:1746140887.403277:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228000/0x8156357b7fdba953 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a4c expref: 17 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.403288:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.403290:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140887.403294:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:32731:x1830960573785600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (162us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.403295:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.403300:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17131 00010000:00010000:3.0:1746140887.403323:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.403343:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573785856 00000100:00100000:2.0:1746140887.403347:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573785856 00010000:00010000:3.0:1746140887.403349:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.403360:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576078080:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140887.403371:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4733 00000100:00100000:2.0:1746140887.403375:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32725:x1830960573785856:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140887.403402:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.403539:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32725:x1830960573785856:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 162us (356us total) trans 8589945077 rc 0/0 00000100:00100000:2.0:1746140887.403545:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4733 00000100:00100000:1.0:1746140887.403911:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960573785344:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2216us (2384us total) trans 21474841448 rc 0/0 00000100:00100000:1.0:1746140887.403918:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1813 00002000:00100000:1.0:1746140887.403926:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4116480->4194303) req@ffff88009f1ec380 x1830960573785344/t21474841448(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.403933:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ec380 with x1830960573785344 ext(4116480->4194303) 00010000:00010000:1.0:1746140887.403938:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 16 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.403949:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 16 pid: 4785 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.403954:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f1ec380 00000100:00100000:3.0:1746140887.404960:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576078080:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.404976:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.405012:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573785472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1784us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.405019:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8854 00000100:00100000:0.0:1746140887.405786:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.405883:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573786112 00000100:00100000:1.0:1746140887.405889:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573786112 00002000:00100000:1.0:1746140887.405921:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1548288->1552383) req@ffff88009f1eca80 x1830960573786112/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.405929:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1eca80 with x1830960573786112 ext(1548288->1552383) 00002000:00010000:1.0:1746140887.405934:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1eca80 00000100:00100000:1.0:1746140887.406010:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8762 00000100:00100000:1.0:1746140887.406019:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573786112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140887.406161:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573786112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 143us (375us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140887.406170:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8762 00002000:00100000:1.0:1746140887.406175:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1548288->1552383) req@ffff88009f1eca80 x1830960573786112/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.406182:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1eca80 with x1830960573786112 ext(1548288->1552383) 00002000:00010000:1.0:1746140887.406185:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1eca80 00000100:00100000:0.0:1746140887.406530:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.406588:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573786240 00000100:00100000:3.0:1746140887.406591:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573786240 00010000:00010000:3.0:1746140887.406609:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 15 pid: 4785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.406644:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8855 00000100:00100000:3.0:1746140887.406650:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573786240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.406658:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.406673:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 15 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.406681:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 15 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.406699:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc83c00/0x8156357b7fdba94c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a45 expref: 15 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.406709:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.406711:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.406717:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.406728:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.406735:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.406736:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.406738:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.406743:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.406765:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.406774:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576078208:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.406853:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.406860:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576078336:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.406878:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140887.411814:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576078208:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.411825:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576078336:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.411844:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.411891:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573786240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5239us (5359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.411900:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8855 00000100:00100000:0.0:1746140887.414891:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.414936:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.414958:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.414981:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.415002:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573786880 00000100:00100000:0.0:1746140887.415003:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573786752 00000100:00100000:0.0:1746140887.415012:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573786752 00000100:00100000:3.0:1746140887.415013:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573786880 00000100:00100000:2.0:1746140887.415015:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573787008 00000100:00100000:2.0:1746140887.415021:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573787008 00002000:00100000:0.0:1746140887.415066:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8800a513e680 x1830960573786752/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.415069:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f1ec000 x1830960573786880/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.415069:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3964928->4194303) req@ffff8800a513ca80 x1830960573787008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140887.415075:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513e680 with x1830960573786752 ext(2097152->3145727) 00002000:00100000:3.0:1746140887.415079:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ec000 with x1830960573786880 ext(2097152->3145727) 00002000:00100000:2.0:1746140887.415079:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ca80 with x1830960573787008 ext(3964928->4194303) 00002000:00010000:0.0:1746140887.415081:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513e680 00002000:00010000:2.0:1746140887.415084:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513ca80 00000100:00100000:0.0:1746140887.415097:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573787392 00000100:00100000:0.0:1746140887.415100:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573787392 00002000:00100000:0.0:1746140887.415110:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a513d880 x1830960573787392/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140887.415117:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8763 00002000:00100000:0.0:1746140887.415117:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d880 with x1830960573787392 ext(3145728->4194303) 00002000:00010000:0.0:1746140887.415120:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513d880 00000100:00100000:2.0:1746140887.415126:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960573786752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.415130:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8764 00000100:00100000:0.0:1746140887.415136:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573787008:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:3.0:1746140887.415197:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f1ec000 00000100:00100000:3.0:1746140887.415219:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8765 00000100:00100000:3.0:1746140887.415226:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573787392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140887.415263:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8766 00000100:00100000:3.0:1746140887.415267:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573786880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.415538:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.415550:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573787264 00000100:00100000:0.0:1746140887.415553:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573787264 00002000:00100000:0.0:1746140887.415568:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8800a513f100 x1830960573787264/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140887.415580:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513f100 with x1830960573787264 ext(2097152->3145727) 00002000:00010000:0.0:1746140887.415583:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513f100 00000100:00100000:0.0:1746140887.415592:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8767 00000100:00100000:0.0:1746140887.415597:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573787264:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140887.427765:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573786880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12485us (12872us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.427778:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8766 00002000:00100000:3.0:1746140887.427788:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f1ec000 x1830960573786880/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.427798:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ec000 with x1830960573786880 ext(2097152->3145727) 00002000:00010000:3.0:1746140887.427804:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f1ec000 00000100:00100000:2.0:1746140887.432478:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573787392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17243us (17485us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.432489:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8765 00002000:00100000:2.0:1746140887.432498:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a513d880 x1830960573787392/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.432507:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d880 with x1830960573787392 ext(3145728->4194303) 00002000:00010000:2.0:1746140887.432511:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513d880 00000100:00100000:3.0:1746140887.432580:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573787008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17443us (17619us total) trans 0 rc 229376/229376 00000100:00100000:3.0:1746140887.432588:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8764 00002000:00100000:3.0:1746140887.432593:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3964928->4194303) req@ffff8800a513ca80 x1830960573787008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 229376/229376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.432605:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ca80 with x1830960573787008 ext(3964928->4194303) 00002000:00010000:3.0:1746140887.432609:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513ca80 00000100:00100000:1.0:1746140887.432790:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573787264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17191us (17251us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.432797:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8767 00002000:00100000:1.0:1746140887.432801:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8800a513f100 x1830960573787264/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.432807:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513f100 with x1830960573787264 ext(2097152->3145727) 00002000:00010000:1.0:1746140887.432809:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513f100 00000100:00100000:1.0:1746140887.435601:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960573786752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20466us (20653us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.435612:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8763 00002000:00100000:1.0:1746140887.435624:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8800a513e680 x1830960573786752/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.435633:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513e680 with x1830960573786752 ext(2097152->3145727) 00002000:00010000:1.0:1746140887.435638:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513e680 00000100:00100000:0.0:1746140887.439632:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.439689:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.439753:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.439912:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573787648 00000100:00100000:3.0:1746140887.439922:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573787648 00000100:00100000:3.0:1746140887.439966:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573787776 00000100:00100000:3.0:1746140887.439967:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573787776 00000100:00100000:3.0:1746140887.439980:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573787904 00000100:00100000:3.0:1746140887.439981:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573787904 00000100:00100000:3.0:1746140887.439996:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17132 00000100:00100000:3.0:1746140887.440003:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32726:x1830960573787648:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140887.440019:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.440035:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a7d expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440074:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440083:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440090:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.440091:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.440095:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440122:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440138:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 14 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.440150:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576078464:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.440236:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440243:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.440251:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576078592:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.440269:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140887.440289:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17133 00000100:00100000:3.0:1746140887.440294:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32728:x1830960573787776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140887.440301:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.440333:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a84 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440349:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440354:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140887.440355:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140887.440358:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 8 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.440400:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17134 00000100:00100000:0.0:1746140887.440406:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1983:x1830960573787904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.440412:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.440419:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a521b600/0x8156357b7fdba992 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a8b expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.440443:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576078720:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140887.440467:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51199c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140887.440578:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 19 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.440586:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 19 pid: 4785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.440594:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576078848:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.440614:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140887.441887:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576078464:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.441899:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576078592:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.441918:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.441932:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130888e00, rc 0) 00000100:00100000:3.0:1746140887.441971:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32726:x1830960573787648:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1967us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.441977:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17132 00002000:00010000:2.0:1746140887.442987:0:24958:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140887 -> 1746140888 00002000:00010000:2.0:1746140887.442991:0:24958:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140887 -> 1746140888 00002000:00010000:2.0:1746140887.442993:0:24958:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140887 -> 1746140888 00000100:00100000:2.0:1746140887.443017:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576078720:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140887.443039:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a521b600/0x8156357b7fdba992 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a8b expref: 15 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.443049:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a521b600/0x8156357b7fdba992 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a8b expref: 15 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140887.443147:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.443179:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576078848:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.443192:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 8 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.443201:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130889200, rc 0) 00000100:00100000:3.0:1746140887.443222:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32728:x1830960573787776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2928us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.443229:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17133 00010000:00010000:2.0:1746140887.443350:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521b600, rc 0) 00000100:00100000:2.0:1746140887.443372:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1983:x1830960573787904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2966us (3619us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140887.443378:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17134 00000100:00100000:3.0:1746140887.443488:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573788160 00000100:00100000:3.0:1746140887.443494:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573788160 00010000:00010000:3.0:1746140887.443647:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.443668:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8856 00000100:00100000:3.0:1746140887.443675:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960573788160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.443686:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.443696:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.443705:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.443721:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547ca00/0x8156357b7fdba976 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a6f expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.443741:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.443766:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573788160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.443841:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8856 00000100:00100000:0.0:1746140887.444145:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.444186:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573788032 00000100:00100000:1.0:1746140887.444190:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573788032 00002000:00100000:1.0:1746140887.444217:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->3964927) req@ffff88012b180700 x1830960573788032/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.444225:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180700 with x1830960573788032 ext(3145728->3964927) 00010000:00010000:1.0:1746140887.444231:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 20 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.444238:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 20 pid: 4785 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.444243:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b180700 00000100:00100000:1.0:1746140887.444510:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1814 00000100:00100000:1.0:1746140887.444516:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1983:x1830960573788032:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140887.445235:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.445299:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.445338:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573788416 00000100:00100000:0.0:1746140887.445342:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573788416 00000100:00100000:3.0:1746140887.445374:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573788288 00000100:00100000:0.0:1746140887.445379:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17135 00000100:00100000:3.0:1746140887.445380:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573788288 00000100:00100000:0.0:1746140887.445385:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:32731:x1830960573788416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140887.445402:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 15 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.445430:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8857 00010000:00010000:0.0:1746140887.445431:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140887.445437:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573788288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.445443:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a92 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.445447:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.445462:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.445464:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.445466:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.445473:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.445489:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.445499:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.445504:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547d000/0x8156357b7fdba97d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a76 expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.445507:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.445509:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.445513:0:24958:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 7 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.445521:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 7 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.445528:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.445546:0:24958:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 7 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.445555:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576078976:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.445576:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573788288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 138us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.445583:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8857 00000100:00100000:0.0:1746140887.445598:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.447875:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576078976:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140887.447894:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521ba00, rc 0) 00000100:00100000:1.0:1746140887.448930:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:32731:x1830960573788416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3541us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.448940:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17135 00000100:00100000:3.0:1746140887.449012:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.449181:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573788672 00000100:00100000:2.0:1746140887.449189:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573788672 00002000:00100000:2.0:1746140887.449226:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2170880->2174975) req@ffff88009f121c00 x1830960573788672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.449238:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121c00 with x1830960573788672 ext(2170880->2174975) 00002000:00010000:2.0:1746140887.449243:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f121c00 00000100:00100000:2.0:1746140887.449267:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8768 00000100:00100000:2.0:1746140887.449273:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573788672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140887.449636:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573788672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 362us (624us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140887.449643:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8768 00002000:00100000:2.0:1746140887.449648:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2170880->2174975) req@ffff88009f121c00 x1830960573788672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.449654:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121c00 with x1830960573788672 ext(2170880->2174975) 00002000:00010000:2.0:1746140887.449657:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f121c00 00000100:00100000:2.0:1746140887.452641:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.452857:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573788928 00000100:00100000:3.0:1746140887.452866:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573788928 00002000:00100000:3.0:1746140887.452900:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f519880 x1830960573788928/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.452910:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519880 with x1830960573788928 ext(4194304->4886527) 00002000:00010000:3.0:1746140887.452915:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f519880 00000100:00100000:3.0:1746140887.452932:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8769 00000100:00100000:3.0:1746140887.452939:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1985:x1830960573788928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140887.455996:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573788032:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11469us (11839us total) trans 17179874162 rc 0/0 00000100:00100000:1.0:1746140887.456010:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1814 00002000:00100000:1.0:1746140887.456021:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->3964927) req@ffff88012b180700 x1830960573788032/t17179874162(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.456203:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180700 with x1830960573788032 ext(3145728->3964927) 00010000:00010000:1.0:1746140887.456214:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 22 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.456229:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 22 pid: 4785 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.456235:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b180700 00000100:00100000:2.0:1746140887.459885:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1985:x1830960573788928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6933us (7240us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140887.459897:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8769 00002000:00100000:2.0:1746140887.459907:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f519880 x1830960573788928/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.459916:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519880 with x1830960573788928 ext(4194304->4886527) 00002000:00010000:2.0:1746140887.459922:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f519880 00000100:00100000:0.0:1746140887.460955:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.461040:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573789056 00000100:00100000:3.0:1746140887.461058:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573789056 00010000:00010000:3.0:1746140887.461089:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 22 pid: 4785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.461129:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8858 00000100:00100000:3.0:1746140887.461136:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573789056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.461149:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.461170:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 22 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.461182:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 22 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.461204:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5229000/0x8156357b7fdba95a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a53 expref: 22 pid: 4785 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.461232:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.461234:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.461240:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 7 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.461248:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 7 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.461279:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 7 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.461292:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576079104:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.461386:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.462431:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.462463:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.462486:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573789184 00000100:00100000:1.0:1746140887.462492:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573789184 00000100:00100000:0.0:1746140887.462498:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.462519:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573789312 00000100:00100000:1.0:1746140887.462521:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573789312 00000100:00100000:1.0:1746140887.462541:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573789440 00000100:00100000:1.0:1746140887.462544:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573789440 00000100:00100000:0.0:1746140887.462549:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17136 00000100:00100000:0.0:1746140887.462558:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573789184:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140887.462563:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17137 00000100:00100000:1.0:1746140887.462568:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573789312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.462572:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.462575:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.462585:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff14c00/0x8156357b7fdba9a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1aa0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.462585:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdba9a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1a99 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.462607:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff14c00/0x8156357b7fdba9a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa0 expref: 17 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.462616:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff14c00/0x8156357b7fdba9a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa0 expref: 17 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140887.462621:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b753100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576079232:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.462628:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff14c00, rc 0) 00000100:00100000:1.0:1746140887.462651:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573789312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (187us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140887.462663:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17137 00000100:00100000:1.0:1746140887.462678:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17138 00000100:00100000:1.0:1746140887.462683:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573789440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.462690:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.462698:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1aa7 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.462707:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746140887.462708:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.462709:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.462715:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 23 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.462725:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 23 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.462732:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099684400, rc 0) 00000100:00100000:1.0:1746140887.462748:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1982:x1830960573789440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.462753:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17138 00000100:00100000:2.0:1746140887.462807:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576079104:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140887.462820:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.462849:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573789056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1714us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.462857:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8858 00000100:00100000:2.0:1746140887.463674:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b753100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576079232:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140887.463692:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdba9a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a99 expref: 15 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.463702:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdba9a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a99 expref: 15 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.463723:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521b200, rc 0) 00000100:00100000:2.0:1746140887.463745:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573789184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1189us (1318us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140887.463750:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17136 00000100:00100000:0.0:1746140887.465129:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.465775:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573789696 00000100:00100000:2.0:1746140887.465783:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573789696 00000100:00100000:0.0:1746140887.465792:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140887.465822:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b753800 x1830960573789696/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746140887.465827:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140887.465831:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b753800 with x1830960573789696 ext(2097152->3145727) 00002000:00010000:2.0:1746140887.465837:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b753800 00000100:00100000:2.0:1746140887.465858:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8770 00000100:00100000:2.0:1746140887.465864:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573789696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140887.465897:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573789952 00000100:00100000:3.0:1746140887.465901:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573789952 00000100:00100000:3.0:1746140887.465927:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573789824 00000100:00100000:3.0:1746140887.465929:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573789824 00000100:00100000:3.0:1746140887.465943:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17139 00000100:00100000:3.0:1746140887.465948:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573789952:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140887.465950:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17140 00010000:00010000:3.0:1746140887.465957:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140887.465959:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573789824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.465966:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.465971:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130888000/0x8156357b7fdba9b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ab5 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.465973:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdba9bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1aae expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.465991:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130888000/0x8156357b7fdba9b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ab5 expref: 17 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.466000:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130888000/0x8156357b7fdba9b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ab5 expref: 17 pid: 4785 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140887.466013:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576079360:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140887.466018:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130888000, rc 0) 00000100:00100000:3.0:1746140887.466047:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573789952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 99us (255us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140887.466062:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17139 00000100:00100000:1.0:1746140887.466152:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473a780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.467575:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576079360:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.467591:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdba9bc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aae expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.467599:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdba9bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aae expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.467617:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099684800, rc 0) 00000100:00100000:1.0:1746140887.467645:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573789824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1688us (1816us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140887.467650:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17140 00000100:00100000:2.0:1746140887.471985:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573789696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6109us (6847us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.471997:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8770 00002000:00100000:2.0:1746140887.472008:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b753800 x1830960573789696/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.472018:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b753800 with x1830960573789696 ext(2097152->3145727) 00002000:00010000:2.0:1746140887.472023:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b753800 00000100:00100000:0.0:1746140887.472806:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.472864:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573790080 00000100:00100000:3.0:1746140887.472872:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573790080 00000100:00100000:3.0:1746140887.472915:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10774 00000100:00100000:3.0:1746140887.472921:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+6:32734:x1830960573790080:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140887.472941:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.472958:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130889e00/0x8156357b7fdba9c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1abc expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.473020:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.473032:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.473042:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.473067:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.473073:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.473078:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.473374:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.473383:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.473390:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.473418:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.473439:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.473451:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576079488:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.473532:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.473806:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.473862:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573790336 00000100:00100000:2.0:1746140887.473866:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573790336 00000100:00100000:2.0:1746140887.473889:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4734 00000100:00100000:2.0:1746140887.473894:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32731:x1830960573790336:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140887.474122:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32731:x1830960573790336:12345-192.168.204.16@tcp:35:cat.0 Request processed in 226us (315us total) trans 8589945078 rc 0/0 00000100:00100000:2.0:1746140887.474128:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4734 00000100:00100000:3.0:1746140887.474579:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576079488:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.474595:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140887.474735:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.474874:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573790592 00000100:00100000:2.0:1746140887.474877:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573790592 00000100:00100000:2.0:1746140887.474893:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4735 00000100:00100000:2.0:1746140887.474899:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:7723:x1830960573790592:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746140887.474972:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:7723:x1830960573790592:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 73us (238us total) trans 8589945079 rc 0/0 00000100:00100000:2.0:1746140887.474978:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4735 00000100:00100000:0.0:1746140887.475646:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.475705:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573790720 00000100:00100000:2.0:1746140887.475708:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573790720 00010000:00010000:2.0:1746140887.475725:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.475744:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8859 00000100:00100000:2.0:1746140887.475749:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573790720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.475760:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.475765:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.475774:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.475795:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fb7a00/0x8156357b7fdba8ce lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f1 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.475808:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.475816:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.475824:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.475829:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.475852:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.475870:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573790720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.475876:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8859 00010000:00010000:3.0:1746140887.475936:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.475942:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140887.475966:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140887.475969:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140887.475980:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.475988:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476152:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476158:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476164:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476170:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130888a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140887.476174:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476180:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476188:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140887.476191:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140887.476194:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476199:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130888a00/0x8156357b7fdba9ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476221:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476226:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476230:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476235:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130889c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140887.476237:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476242:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476248:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f3ee000) 00010000:00010000:3.0:1746140887.476250:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140887.476253:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476257:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130889c00/0x8156357b7fdba9d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.476282:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130889e00/0x8156357b7fdba9c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.476291:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.476297:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140887.476298:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140887.476300:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130889400, rc 0) 00000100:00100000:3.0:1746140887.476399:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32734:x1830960573790080:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3477us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.476405:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10774 00000100:00100000:2.0:1746140887.476534:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.476591:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573790848 00000100:00100000:0.0:1746140887.476595:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573790848 00000100:00100000:0.0:1746140887.476624:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17141 00000100:00100000:0.0:1746140887.476630:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32728:x1830960573790848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.476639:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.476651:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ac3 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.476697:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.476699:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.476706:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.476717:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.476727:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547ce00, rc 0) 00000100:00100000:0.0:1746140887.476756:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32728:x1830960573790848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.476761:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17141 00000100:00100000:0.0:1746140887.479414:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.479436:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.479495:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.479499:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573790976 00000100:00100000:3.0:1746140887.479503:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573791104 00000100:00100000:3.0:1746140887.479507:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573791104 00000100:00100000:1.0:1746140887.479507:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573790976 00000100:00100000:1.0:1746140887.479537:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573791232 00000100:00100000:1.0:1746140887.479538:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573791232 00000100:00100000:3.0:1746140887.479805:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17142 00000100:00100000:3.0:1746140887.479813:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573790976:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140887.479827:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.479843:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ee3dc00/0x8156357b7fdba9e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1aca expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.479849:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17143 00000100:00100000:1.0:1746140887.479857:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573791104:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140887.479864:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.479871:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6a0f400/0x8156357b7fdba9ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ad1 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.479888:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6a0f400/0x8156357b7fdba9ed lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad1 expref: 12 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140887.479890:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576079616:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.479897:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6a0f400/0x8156357b7fdba9ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad1 expref: 12 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.479917:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6a0f400, rc 0) 00000100:00100000:0.0:1746140887.479923:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17144 00000100:00100000:0.0:1746140887.479929:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573791232:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140887.479936:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140887.479940:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573791104:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 84us (502us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140887.479945:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746140887.479945:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ad8 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.479946:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17143 00010000:00010000:0.0:1746140887.479955:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.479957:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.479963:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 11 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.479973:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 11 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.479979:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547ca00, rc 0) 00000100:00100000:0.0:1746140887.480101:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573791232:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 171us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.480107:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17144 00000100:00100000:3.0:1746140887.481266:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576079616:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140887.481288:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ee3dc00/0x8156357b7fdba9e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aca expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.481297:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ee3dc00/0x8156357b7fdba9e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aca expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.481337:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3dc00, rc 0) 00000100:00100000:3.0:1746140887.481365:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573790976:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1554us (1957us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140887.481372:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17142 00000100:00100000:0.0:1746140887.481602:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.481639:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.481696:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573791616 00000100:00100000:2.0:1746140887.481702:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573791616 00002000:00100000:2.0:1746140887.481731:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012bf11180 x1830960573791616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.481739:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11180 with x1830960573791616 ext(3145728->4194303) 00000100:00100000:1.0:1746140887.481743:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573791744 00002000:00010000:2.0:1746140887.481744:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf11180 00000100:00100000:1.0:1746140887.481747:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573791744 00000100:00100000:2.0:1746140887.481765:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8771 00002000:00100000:1.0:1746140887.481769:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012bf10000 x1830960573791744/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140887.481770:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960573791616:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746140887.481777:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf10000 with x1830960573791744 ext(3145728->4194303) 00002000:00010000:1.0:1746140887.481780:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf10000 00000100:00100000:1.0:1746140887.481798:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8772 00000100:00100000:1.0:1746140887.481804:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573791744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.486242:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.486385:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573792000 00000100:00100000:3.0:1746140887.486395:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573792000 00000100:00100000:3.0:1746140887.486442:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10775 00000100:00100000:3.0:1746140887.486450:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32734:x1830960573792000:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140887.486469:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.486487:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3cc00/0x8156357b7fdba9fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1adf expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.486583:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.486597:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.486603:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140887.486633:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.486644:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.486656:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576079744:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.486759:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.487690:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573791744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5883us (6047us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.487700:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8772 00002000:00100000:1.0:1746140887.487710:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012bf10000 x1830960573791744/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.487719:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf10000 with x1830960573791744 ext(3145728->4194303) 00002000:00010000:1.0:1746140887.487724:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf10000 00000100:00100000:0.0:1746140887.488080:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576079744:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.488097:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140887.488521:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.488536:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960573791616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6765us (6935us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.488543:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8771 00000100:00100000:2.0:1746140887.488543:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573792128 00000100:00100000:2.0:1746140887.488547:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573792128 00002000:00100000:3.0:1746140887.488549:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012bf11180 x1830960573791616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.488557:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11180 with x1830960573791616 ext(3145728->4194303) 00002000:00010000:3.0:1746140887.488560:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf11180 00010000:00010000:2.0:1746140887.488567:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.488586:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8860 00000100:00100000:2.0:1746140887.488734:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573792128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.488744:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.488752:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.488762:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.488778:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130889400/0x8156357b7fdba9d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1abc expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.488789:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.488793:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.488800:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.488806:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.488950:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.488965:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573792128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 232us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.488973:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8860 00010000:00010000:1.0:1746140887.489063:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.489069:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140887.489090:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140887.489222:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3cc00/0x8156357b7fdba9fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1adf expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.489248:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1adf expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.489254:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.489255:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746140887.489257:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3ca00, rc 0) 00000100:00100000:1.0:1746140887.489286:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32734:x1830960573792000:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2837us (3054us total) trans 8589945080 rc 0/0 00000100:00100000:1.0:1746140887.489291:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10775 00000100:00100000:0.0:1746140887.490698:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.490800:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573792384 00000100:00100000:1.0:1746140887.490806:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573792384 00000100:00100000:1.0:1746140887.490845:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10776 00000100:00100000:1.0:1746140887.490852:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32734:x1830960573792384:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140887.490872:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.490874:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746140887.490889:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa02 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1adf expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.490900:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.490903:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140887.490912:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e200/0x8156357b7fdbaa10 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ae6 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.490989:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.490997:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.491003:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140887.491011:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140887.491096:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e200/0x8156357b7fdbaa10 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.491107:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.491113:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.491115:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140887.491117:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6a0e400, rc 0) 00000100:00100000:1.0:1746140887.491156:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32734:x1830960573792384:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 304us (461us total) trans 8589945081 rc 0/0 00000100:00100000:1.0:1746140887.491161:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10776 00000100:00100000:0.0:1746140887.492256:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.492329:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573792512 00000100:00100000:1.0:1746140887.492333:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573792512 00000100:00100000:1.0:1746140887.492371:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10777 00000100:00100000:1.0:1746140887.492377:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32734:x1830960573792512:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140887.492388:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.492397:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0f800/0x8156357b7fdbaa25 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1aed expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.492429:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0f800/0x8156357b7fdbaa25 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aed expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.492438:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0f800/0x8156357b7fdbaa25 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aed expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.492452:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.492454:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140887.492456:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6a0f800, rc 0) 00000100:00100000:1.0:1746140887.492480:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:32734:x1830960573792512:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.492485:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10777 00000100:00100000:3.0:1746140887.492500:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.492591:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573792640 00000100:00100000:0.0:1746140887.492594:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573792640 00000100:00100000:0.0:1746140887.492627:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17145 00000100:00100000:0.0:1746140887.492633:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573792640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.492641:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.492652:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094899800/0x8156357b7fdbaa2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1af4 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.492675:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094899800/0x8156357b7fdbaa2c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1af4 expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.492684:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094899800/0x8156357b7fdbaa2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1af4 expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.492695:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094899800, rc 0) 00000100:00100000:0.0:1746140887.492715:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573792640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (215us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140887.492720:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17145 00000100:00100000:2.0:1746140887.494547:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.494573:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.494599:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.494617:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573792896 00000100:00100000:0.0:1746140887.494624:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573792896 00000100:00100000:2.0:1746140887.494630:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.494650:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.494652:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573793152 00000100:00100000:0.0:1746140887.494654:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573793152 00000100:00100000:1.0:1746140887.494661:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573793408 00000100:00100000:0.0:1746140887.494663:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573792768 00000100:00100000:1.0:1746140887.494665:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573793408 00000100:00100000:0.0:1746140887.494665:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573792768 00000100:00100000:2.0:1746140887.494666:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573793024 00000100:00100000:2.0:1746140887.494669:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573793024 00000100:00100000:0.0:1746140887.494679:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17146 00000100:00100000:0.0:1746140887.494685:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573792896:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:1.0:1746140887.494695:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17147 00000100:00100000:1.0:1746140887.494701:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573793152:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140887.494723:0:8458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.494723:0:24958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.494737:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.494737:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 13 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.494744:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140887.494744:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 21 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.494746:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746140887.494748:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17148 00010000:00010000:1.0:1746140887.494750:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.494751:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.494755:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573792768:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140887.494755:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.494756:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.494758:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.494772:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.494779:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.494779:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.494782:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.494789:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.494790:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 8 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.494790:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 7 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.494796:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 8 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.494801:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.494802:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140887.494802:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576079872:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.494802:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576080000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.494804:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.494825:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 8 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.494832:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.494841:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576080128:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.494858:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473a180 going to sleep for 11 seconds 00010000:00010000:2.0:1746140887.494872:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.494874:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17149 00010000:00010000:0.0:1746140887.494874:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 21 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.494880:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 13 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.494880:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573793408:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140887.494882:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 21 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.494889:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f518e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576080256:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.494892:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576080384:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.494897:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.494906:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 7 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.494913:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.494913:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.494920:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 10 pid: 20960 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.494920:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 21 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.494924:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.494925:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.494925:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 13 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140887.494927:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576080512:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.494927:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.494934:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 13 pid: 4782 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.494942:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576080640:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.494945:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746140887.494947:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 21 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.494958:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 21 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.494959:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.494963:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17150 00000100:00100000:1.0:1746140887.494966:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576080768:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.494970:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573793024:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140887.494988:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.494996:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 13 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.495003:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576080896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.495017:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 7 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.495025:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 7 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.495032:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576081024:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.495040:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a473a780 going to sleep for 11 seconds 00010000:00010000:2.0:1746140887.495107:0:32376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.495121:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.495127:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 21 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.495133:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140887.495134:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.495139:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.495140:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.495142:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.495158:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.495166:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.495174:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576081152:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.495198:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 21 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.495209:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 21 pid: 24958 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.495217:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576081280:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.495235:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.495242:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 13 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.495248:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576081408:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.495262:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752180 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.495381:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573793280 00000100:00100000:0.0:1746140887.495385:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573793280 00000100:00100000:0.0:1746140887.495410:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17151 00000100:00100000:0.0:1746140887.495414:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573793280:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140887.495429:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.495438:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 8 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.495439:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140887.495445:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 13 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.495451:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.495456:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746140887.495457:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746140887.495459:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.495472:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.495479:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 8 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.495486:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576081536:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.495494:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573793664 00000100:00100000:3.0:1746140887.495497:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573793664 00002000:00100000:3.0:1746140887.495516:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880092ba5500 x1830960573793664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.495525:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5500 with x1830960573793664 ext(4194304->4886527) 00010000:00010000:3.0:1746140887.495531:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.495531:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 13 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.495538:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 13 pid: 24958 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.495540:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.495546:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576081664:192.168.204.16@tcp:104: 00002000:00010000:3.0:1746140887.495551:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ba5500 00000100:00100000:3.0:1746140887.495562:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1815 00000100:00100000:3.0:1746140887.495567:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1983:x1830960573793664:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746140887.495571:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.495577:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 9 pid: 9872 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.495584:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092613100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576081792:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.495597:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.496875:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576080128:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.500294:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.500423:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576080000:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.500478:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576080384:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.500502:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f518e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576080256:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.500665:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573793792 00000100:00100000:2.0:1746140887.500673:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573793792 00010000:00010000:2.0:1746140887.500704:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 11 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.500734:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8861 00000100:00100000:2.0:1746140887.500740:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573793792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.500753:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.500774:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 11 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.500784:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 11 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.500804:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e595a00/0x8156357b7fdba8c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ea expref: 11 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.500823:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140887.501251:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576080640:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.501275:0:24958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.501363:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.501372:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576079872:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.501389:0:8458:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.501406:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576081536:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.501411:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576080768:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.501419:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576080896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.501426:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576081024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.501434:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576081664:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.501443:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.501451:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.501461:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573794432 00000100:00100000:1.0:1746140887.501463:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573793920 00000100:00100000:0.0:1746140887.501464:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573794432 00000100:00100000:1.0:1746140887.501466:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573793920 00010000:00010000:0.0:1746140887.501478:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 12 pid: 20960 timeout: 966 lvb_type: 1 00002000:00100000:1.0:1746140887.501491:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1548288->2097151) req@ffff880092611f80 x1830960573793920/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746140887.501496:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8862 00002000:00100000:1.0:1746140887.501501:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611f80 with x1830960573793920 ext(1548288->2097151) 00000100:00100000:0.0:1746140887.501501:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573794432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.501506:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.501509:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.501516:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.501519:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 12 pid: 20960 timeout: 966 lvb_type: 1 00002000:00010000:1.0:1746140887.501521:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092611f80 00010000:00010000:0.0:1746140887.501528:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 12 pid: 20960 timeout: 966 lvb_type: 1 00000100:00100000:1.0:1746140887.501543:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1816 00010000:00010000:0.0:1746140887.501546:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140887.501549:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573793920:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140887.501577:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573794432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.501583:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8862 00000100:00100000:0.0:1746140887.501612:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.501623:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573794304 00000100:00100000:0.0:1746140887.501625:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573794304 00010000:00010000:0.0:1746140887.501635:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 22 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.501650:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8863 00000100:00100000:0.0:1746140887.501655:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573794304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.501667:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.501679:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 22 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.501688:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 22 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.501706:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948ca200/0x8156357b7fdba91b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a1b expref: 22 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.501718:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140887.501732:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573794304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.501738:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8863 00010000:00010000:3.0:1746140887.501762:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdba803 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19ab expref: 11 pid: 20960 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.501773:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576080512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.501781:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140887.501787:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.501800:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573794560 00000100:00100000:3.0:1746140887.501802:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573794560 00010000:00010000:3.0:1746140887.501816:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 14 pid: 4782 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.501828:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.501830:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8864 00000100:00100000:3.0:1746140887.501835:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573794560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.501842:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140887.501842:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140887.501851:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 14 pid: 4782 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.501853:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573794688 00000100:00100000:0.0:1746140887.501856:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573794688 00010000:00010000:3.0:1746140887.501859:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 14 pid: 4782 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.501866:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 21 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.501872:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83a00/0x8156357b7fdba80a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b2 expref: 14 pid: 4782 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.501877:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573794816 00000100:00100000:0.0:1746140887.501879:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573794816 00010000:00010000:3.0:1746140887.501881:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.501885:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 14 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.501895:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8865 00000100:00100000:0.0:1746140887.501899:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573794688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140887.501903:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573794560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (121us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140887.501905:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140887.501909:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8864 00010000:00010000:0.0:1746140887.501914:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 21 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.501921:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8866 00000100:00100000:3.0:1746140887.501926:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573794816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.501926:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 21 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.501933:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.501937:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099684400/0x8156357b7fdba9ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aa7 expref: 21 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.501941:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 13 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:0.0:1746140887.501945:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140887.501948:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 13 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.501958:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdba9f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ad8 expref: 13 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:0.0:1746140887.501958:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960573794688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.501963:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8865 00010000:00010000:3.0:1746140887.501966:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.501983:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573794816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.501988:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8866 00000100:00100000:0.0:1746140887.501999:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092613100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4785:1830960576081792:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.502013:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.502070:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573793792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1329us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.502076:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8861 00000100:00100000:0.0:1746140887.502078:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.502099:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573794176 00000100:00100000:3.0:1746140887.502103:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573794176 00000100:00100000:0.0:1746140887.502105:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140887.502115:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.502115:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573795200 00000100:00100000:2.0:1746140887.502117:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573795200 00010000:00010000:2.0:1746140887.502127:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 20 pid: 24958 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.502130:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8867 00000100:00100000:3.0:1746140887.502139:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573794176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.502148:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140887.502151:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8868 00000100:00100000:2.0:1746140887.502155:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573795200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.502157:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.502162:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.502164:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.502166:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140887.502171:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 20 pid: 24958 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.502174:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573794048 00010000:00010000:3.0:1746140887.502175:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948cb600/0x8156357b7fdba90d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a0d expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.502176:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573794048 00010000:00010000:2.0:1746140887.502179:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 20 pid: 24958 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.502184:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.502185:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.502187:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.502189:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.502189:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140887.502197:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.502198:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8869 00000100:00100000:0.0:1746140887.502202:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960573794048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140887.502204:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573795200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (99us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140887.502207:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140887.502209:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8868 00010000:00010000:3.0:1746140887.502214:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.502215:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.502223:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.502235:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576081152:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.502235:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e32400/0x8156357b7fdba8dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19f8 expref: 8 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.502236:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1982:x1830960573794176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.502242:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8867 00010000:00010000:2.0:1746140887.502242:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c200/0x8156357b7fdba937 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a30 expref: 19 pid: 24958 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.502243:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.502245:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.502247:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.502251:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576081280:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140887.502255:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.502258:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.502258:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576081408:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.502265:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502267:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140887.502274:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.502280:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573794048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (114us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.502283:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.502285:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8869 00010000:00010000:3.0:1746140887.502290:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502297:0:24958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.502298:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.502324:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5229000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140887.502328:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502332:0:24958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.502336:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.502346:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502346:0:24958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.502351:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5229000/0x8156357b7fdbaa41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502354:0:24958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502360:0:24958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502365:0:24958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094899600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140887.502368:0:24958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502373:0:24958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502386:0:24958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.502391:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094899600/0x8156357b7fdbaa33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.502514:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573792768:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7759us (7881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.502515:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573792896:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7829us (7974us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.502522:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17146 00000100:00100000:3.0:1746140887.502526:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17148 00000100:00100000:0.0:1746140887.502549:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.502558:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573794944 00000100:00100000:3.0:1746140887.502561:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573794944 00010000:00010000:3.0:1746140887.502572:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.502573:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.502587:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8870 00000100:00100000:3.0:1746140887.502592:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1982:x1830960573794944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.502598:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.502605:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.502612:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.502622:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948cbc00/0x8156357b7fdba914 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a14 expref: 7 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.502630:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.502644:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1982:x1830960573794944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.502649:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8870 00000100:00100000:0.0:1746140887.502684:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.502694:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573795456 00000100:00100000:3.0:1746140887.502697:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573795456 00010000:00010000:3.0:1746140887.502706:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 13 pid: 24958 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.502707:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.502724:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573795072 00000100:00100000:3.0:1746140887.502726:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573795072 00010000:00010000:3.0:1746140887.502735:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 11 pid: 24958 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.502745:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8871 00000100:00100000:0.0:1746140887.502747:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.502749:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+13:1984:x1830960573795456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.502757:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.502765:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 13 pid: 24958 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.502773:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 13 pid: 24958 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.502782:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573795328 00010000:00010000:3.0:1746140887.502784:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a521ba00/0x8156357b7fdba999 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2174976->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a92 expref: 13 pid: 24958 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.502785:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573795328 00010000:00010000:3.0:1746140887.502792:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746140887.502803:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2174975) req@ffff880092613100 x1830960573795328/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140887.502811:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+12:1984:x1830960573795456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (127us total) trans 0 rc 0/0 00002000:00100000:1.0:1746140887.502811:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092613100 with x1830960573795328 ext(2097152->2174975) 00000100:00100000:3.0:1746140887.502816:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8871 00010000:00010000:1.0:1746140887.502816:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 12 pid: 9872 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.502824:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 12 pid: 9872 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.502830:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092613100 00000100:00100000:3.0:1746140887.502838:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573795584 00000100:00100000:3.0:1746140887.502841:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573795584 00000100:00100000:1.0:1746140887.502842:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1817 00000100:00100000:1.0:1746140887.502847:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960573795328:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746140887.502849:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 6 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.503363:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8872 00000100:00100000:3.0:1746140887.503370:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8873 00000100:00100000:2.0:1746140887.503370:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573795072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.503376:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140887.503378:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1984:x1830960573795584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.503385:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.503386:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 11 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.503393:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 6 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.503394:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 11 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.503401:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 6 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.503405:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e32e00/0x8156357b7fdba818 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a19b9 expref: 11 pid: 24958 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.503414:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.503416:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.503418:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503424:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503437:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.503465:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573795072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.503470:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8872 00010000:00010000:2.0:1746140887.503484:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503490:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503501:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503507:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503513:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503517:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4179800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140887.503519:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503526:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503533:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.503537:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4179800/0x8156357b7fdbaa4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.503538:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130889200/0x8156357b7fdba98b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a84 expref: 6 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.503547:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.503549:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.503551:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.503557:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.503564:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573793024:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 8595us (8913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.503569:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17150 00010000:00010000:3.0:1746140887.503572:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.503588:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+5:1984:x1830960573795584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 211us (841us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140887.503592:0:4784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.503593:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8873 00010000:00010000:1.0:1746140887.503601:0:4784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.503615:0:4784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.503616:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573793664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8049us (8178us total) trans 0 rc 692224/692224 00010000:00010000:1.0:1746140887.503621:0:4784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.503622:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1815 00010000:00010000:1.0:1746140887.503627:0:4784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.503637:0:4784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094959200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140887.503639:0:4784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.503645:0:4784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.503653:0:4784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.503659:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094959200/0x8156357b7fdbaa48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.503693:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573793408:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 8812us (9092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.503699:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17149 00002000:00100000:2.0:1746140887.503800:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880092ba5500 x1830960573793664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.503807:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5500 with x1830960573793664 ext(4194304->4886527) 00010000:00010000:2.0:1746140887.503812:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 12 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.503820:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 12 pid: 8458 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140887.503826:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ba5500 00000100:00100000:2.0:1746140887.507415:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960573795328:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4558us (4831us total) trans 21474841449 rc 0/0 00000100:00100000:2.0:1746140887.507426:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1817 00002000:00100000:2.0:1746140887.507436:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2174975) req@ffff880092613100 x1830960573795328/t21474841449(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.507445:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092613100 with x1830960573795328 ext(2097152->2174975) 00010000:00010000:2.0:1746140887.507455:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 12 pid: 9872 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.507467:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 12 pid: 9872 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140887.507472:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092613100 00000100:00100000:0.0:1746140887.508585:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.508623:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.508653:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.508667:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.508686:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573795712 00000100:00100000:0.0:1746140887.508693:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573795712 00000100:00100000:0.0:1746140887.508721:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573795968 00000100:00100000:0.0:1746140887.508723:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573795968 00000100:00100000:0.0:1746140887.508735:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573795840 00000100:00100000:0.0:1746140887.508737:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573795840 00000100:00100000:0.0:1746140887.508746:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573796096 00000100:00100000:0.0:1746140887.508748:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573796096 00000100:00100000:0.0:1746140887.508760:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17152 00000100:00100000:0.0:1746140887.508766:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573795712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.508778:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.508793:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1afb expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140887.508814:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fed7, atime: 0x6813fed7, ctime: 0x6813fed7, blocks: 0x81f 00010000:00010000:0.0:1746140887.508835:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.508837:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.508845:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 14 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140887.508851:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17153 00000100:00100000:2.0:1746140887.508857:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1984:x1830960573795968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.508859:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 14 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.508865:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.508869:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547d200, rc 0) 00010000:00010000:2.0:1746140887.508875:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b09 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140887.508889:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fed7, atime: 0x6813fed7, ctime: 0x6813fed7, blocks: 0x81d 00010000:00010000:2.0:1746140887.508897:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.508899:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.508903:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 7 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.508913:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 7 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.508920:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094958200, rc 0) 00000100:00100000:2.0:1746140887.508946:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573795968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.508955:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17153 00000100:00100000:2.0:1746140887.508968:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17154 00000100:00100000:2.0:1746140887.508972:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+6:1984:x1830960573795840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.508978:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140887.508985:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17155 00010000:00010000:2.0:1746140887.508986:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b02 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.508991:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573796096:12345-192.168.204.16@tcp:101:cat.0 00002000:00010000:2.0:1746140887.508996:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed7, atime: 0x6813fed7, ctime: 0x6813fed7, blocks: 0x81f 00010000:00010000:3.0:1746140887.508997:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.509002:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.509004:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b10 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.509004:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.509007:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 7 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.509015:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 7 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.509021:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094959800, rc 0) 00000100:00100000:2.0:1746140887.509034:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573795840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 62us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.509039:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576081920:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140887.509039:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17154 00000100:00100000:3.0:1746140887.509109:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.509112:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573795712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 174us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.509117:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17152 00000100:00100000:0.0:1746140887.509140:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.509174:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.509188:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573796224 00000100:00100000:2.0:1746140887.509191:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573796224 00000100:00100000:0.0:1746140887.509194:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.509202:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573796352 00000100:00100000:0.0:1746140887.509204:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573796352 00010000:00010000:2.0:1746140887.509209:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.509213:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573796480 00000100:00100000:0.0:1746140887.509214:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573796480 00000100:00100000:0.0:1746140887.509223:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17156 00000100:00100000:2.0:1746140887.509226:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8874 00000100:00100000:0.0:1746140887.509227:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573796352:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140887.509230:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1982:x1830960573796224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.509233:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.509237:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.509238:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013547cc00/0x8156357b7fdbaa79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b17 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.509247:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 17 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.509252:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013547cc00/0x8156357b7fdbaa79 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b17 expref: 17 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.509255:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 17 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.509294:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17157 00000100:00100000:3.0:1746140887.509299:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573796480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140887.509323:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.509332:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b1e expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140887.509344:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fed8, atime: 0x6813fed8, ctime: 0x6813fed8, blocks: 0x102b 00010000:00010000:3.0:1746140887.509351:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.509353:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.509357:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.509365:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 8 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.509371:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3c400, rc 0) 00000100:00100000:3.0:1746140887.509387:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573796480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.509392:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17157 00010000:00010000:0.0:1746140887.509397:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547cc00/0x8156357b7fdbaa79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b17 expref: 19 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.509406:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547cc00, rc 0) 00000100:00100000:1.0:1746140887.509417:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573793920:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7868us (8053us total) trans 21474841450 rc 0/0 00000100:00100000:0.0:1746140887.509420:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573796352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 192us (279us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140887.509425:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1816 00000100:00100000:0.0:1746140887.509425:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17156 00002000:00100000:1.0:1746140887.509432:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1548288->2097151) req@ffff880092611f80 x1830960573793920/t21474841450(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.509440:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611f80 with x1830960573793920 ext(1548288->2097151) 00010000:00010000:1.0:1746140887.509445:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.509450:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547ce00/0x8156357b7fdba9df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ac3 expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.509458:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 15 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.509459:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746140887.509464:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092611f80 00000100:00100000:2.0:1746140887.509474:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960573796224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 243us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.509479:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8874 00000100:00100000:0.0:1746140887.509492:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.509500:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573796608 00000100:00100000:2.0:1746140887.509503:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573796608 00010000:00010000:2.0:1746140887.509512:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 14 pid: 9872 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.509578:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8875 00000100:00100000:2.0:1746140887.509584:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573796608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.509590:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.509599:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 14 pid: 9872 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.509606:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 14 pid: 9872 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.509617:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130888e00/0x8156357b7fdba984 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a7d expref: 14 pid: 9872 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.509625:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.509627:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.509630:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.509638:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.509805:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.509824:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573796608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 240us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.509829:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8875 00010000:00010000:1.0:1746140887.509886:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.509894:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.509911:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.509919:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.509926:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.509932:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e4ca00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140887.509936:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.509944:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.509958:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.509963:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbaa56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.510117:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573793280:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 14700us (14982us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.510124:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17151 00000100:00100000:3.0:1746140887.511119:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576081920:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140887.511140:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa72 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b10 expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.511149:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ee3ca00/0x8156357b7fdbaa72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b10 expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.511156:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3ca00, rc 0) 00000100:00100000:3.0:1746140887.511186:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573796096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2195us (2517us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140887.511192:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17155 00000100:00100000:0.0:1746140887.511619:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.511665:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573796736 00000100:00100000:2.0:1746140887.511669:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573796736 00010000:00010000:2.0:1746140887.511683:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.511699:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8876 00000100:00100000:2.0:1746140887.511704:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573796736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.511715:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.511723:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.511731:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.511742:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5228400/0x8156357b7fdba968 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a5a expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.511751:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.511752:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.511756:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.511764:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.511785:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.511801:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573796736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.511806:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8876 00010000:00010000:1.0:1746140887.511861:0:8458:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.511868:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.511883:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.511894:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.511900:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.511905:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099684800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140887.511908:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.511915:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.511923:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.511928:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099684800/0x8156357b7fdbaa3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.511979:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573793152:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 17277us (17404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.511986:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17147 00000100:00100000:0.0:1746140887.512419:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.512490:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573796864 00000100:00100000:1.0:1746140887.512494:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573796864 00000100:00100000:1.0:1746140887.512588:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17158 00000100:00100000:1.0:1746140887.512595:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32728:x1830960573796864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.512605:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.512614:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b25 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140887.512626:0:8458:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fed8, atime: 0x6813fed8, ctime: 0x6813fed8, blocks: 0x1591 00010000:00010000:1.0:1746140887.512636:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.512638:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.512641:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.512788:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.512798:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a16a00, rc 0) 00000100:00100000:1.0:1746140887.512819:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32728:x1830960573796864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 225us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.512824:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17158 00000100:00100000:0.0:1746140887.513203:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.513488:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573797120 00000100:00100000:2.0:1746140887.513493:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573797120 00000100:00100000:2.0:1746140887.513528:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10778 00000100:00100000:2.0:1746140887.513534:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:32734:x1830960573797120:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:2.0:1746140887.513568:0:14742:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.513586:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0f800/0x8156357b7fdbaa25 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1aed expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.513597:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.513601:0:14742:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140887.513624:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.513633:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.513640:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.513646:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 268 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.513652:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 6/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.513676:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 268 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.513685:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 268 pid: 14743 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.513697:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576082048:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.513768:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.513781:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 8 pid: 14742 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.513789:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576082176:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.513809:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.513815:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.513821:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576082304:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.513833:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.514685:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.514731:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573797248 00000100:00100000:1.0:1746140887.514738:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573797248 00000100:00100000:1.0:1746140887.514774:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17159 00000100:00100000:1.0:1746140887.514779:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573797248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.514788:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.514803:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b2c expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140887.514818:0:8458:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fed8, atime: 0x6813fed7, ctime: 0x6813fed8, blocks: 0x81f 00010000:00010000:1.0:1746140887.514829:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.514831:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.514836:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 12 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.514851:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 12 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.514859:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a16400, rc 0) 00000100:00100000:1.0:1746140887.514893:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573797248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 113us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.514898:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17159 00000100:00100000:0.0:1746140887.515290:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.515408:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573797376 00000100:00100000:3.0:1746140887.515412:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573797376 00010000:00010000:3.0:1746140887.515431:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 269 pid: 14743 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.515451:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8877 00000100:00100000:3.0:1746140887.515455:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1984:x1830960573797376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.515463:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140887.515466:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576082048:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.515468:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 269 pid: 14743 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.515477:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 269 pid: 14743 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.515478:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576082176:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.515484:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576082304:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.515491:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7400/0x8156357b7fdba945 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a3e expref: 269 pid: 14743 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.515503:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.515506:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140887.515510:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.515724:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.515760:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1984:x1830960573797376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 302us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.515766:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8877 00000100:00100000:1.0:1746140887.515874:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.515910:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.515930:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573797504 00000100:00100000:3.0:1746140887.515941:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573797504 00000100:00100000:0.0:1746140887.515968:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573797632 00000100:00100000:0.0:1746140887.515972:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573797632 00010000:00010000:3.0:1746140887.515977:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 10 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.515986:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.516021:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8878 00000100:00100000:3.0:1746140887.516028:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573797504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140887.516034:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8879 00000100:00100000:0.0:1746140887.516040:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573797632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.516047:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.516062:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.516070:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.516082:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135fb9800/0x8156357b7fdba929 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a22 expref: 10 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.516091:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140887.516094:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.516099:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140887.516119:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960573797632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (208us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.516123:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.516130:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 9 pid: 14742 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.516130:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8879 00010000:00010000:3.0:1746140887.516145:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 8 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.516162:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67200/0x8156357b7fdba93e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1a37 expref: 8 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.516175:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140887.516179:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.516185:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.516190:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.516217:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.516260:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960573797504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 232us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.516266:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8878 00010000:00010000:2.0:1746140887.516291:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.516299:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140887.516439:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.516563:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573797888 00000100:00100000:1.0:1746140887.516567:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573797888 00002000:00100000:1.0:1746140887.516593:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff8801354bd180 x1830960573797888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.516602:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd180 with x1830960573797888 ext(4882432->4886527) 00002000:00010000:1.0:1746140887.516605:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bd180 00000100:00100000:1.0:1746140887.516627:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8773 00000100:00100000:1.0:1746140887.516632:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573797888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140887.516748:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573797888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 114us (308us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140887.516754:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8773 00002000:00100000:1.0:1746140887.516759:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff8801354bd180 x1830960573797888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.516766:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd180 with x1830960573797888 ext(4882432->4886527) 00002000:00010000:1.0:1746140887.516768:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bd180 00000040:00080000:2.0:1746140887.517068:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3475, 88 off294464 00000004:00080000:2.0:1746140887.517075:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866592769360ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517118:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3499, 88 off296760 00000004:00080000:2.0:1746140887.517122:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866592817141ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.517146:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3500, 88 off296848 00000004:00080000:2.0:1746140887.517149:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866592844303ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.517157:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3476, 88 off294552 00000004:00080000:2.0:1746140887.517160:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866592855440ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517171:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3477, 88 off294640 00000004:00080000:2.0:1746140887.517173:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866592868416ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517180:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3501, 88 off296936 00000004:00080000:2.0:1746140887.517183:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866592877952ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.517189:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3502, 88 off297024 00000004:00080000:2.0:1746140887.517191:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866592886616ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.517197:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3503, 88 off297112 00000004:00080000:2.0:1746140887.517200:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866592895667ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.517207:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3478, 88 off294728 00000004:00080000:2.0:1746140887.517210:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866592905116ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517350:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3504, 88 off297200 00000004:00080000:2.0:1746140887.517354:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866593048876ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.517365:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3479, 88 off294816 00000004:00080000:2.0:1746140887.517367:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866593062373ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517375:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3505, 88 off297288 00000004:00080000:2.0:1746140887.517378:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866593073232ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140887.517406:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3481, 88 off295000 00000004:00080000:2.0:1746140887.517409:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866593104580ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517417:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3482, 88 off295088 00000004:00080000:2.0:1746140887.517419:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866593114757ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517426:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3483, 88 off295176 00000004:00080000:2.0:1746140887.517429:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866593124072ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517434:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3484, 88 off295264 00000004:00080000:2.0:1746140887.517436:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866593131251ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140887.517441:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3506, 88 off297376 00000004:00080000:2.0:1746140887.517443:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866593138776ns, next at 809142599738ns, rc = 0 00000100:00100000:1.0:1746140887.521228:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.521301:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573798144 00000100:00100000:2.0:1746140887.521329:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573798144 00000100:00100000:2.0:1746140887.521468:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4736 00000100:00100000:2.0:1746140887.521476:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32728:x1830960573798144:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140887.521726:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32728:x1830960573798144:12345-192.168.204.16@tcp:35:cat.0 Request processed in 251us (508us total) trans 8589945083 rc 0/0 00000100:00100000:2.0:1746140887.521733:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4736 00000001:00080000:1.0:1746140887.535100:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945081 is committed 00000001:00080000:1.0:1746140887.535114:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945082 is committed 00000004:00080000:1.0:1746140887.535119:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2748 committed 00000004:00080000:1.0:1746140887.535126:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2729 committed 00000004:00080000:1.0:1746140887.535133:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2728 committed 00000004:00080000:1.0:1746140887.535135:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2727 committed 00000004:00080000:1.0:1746140887.535136:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2726 committed 00000004:00080000:1.0:1746140887.535137:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2747 committed 00000004:00080000:1.0:1746140887.535139:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2725 committed 00000004:00080000:1.0:1746140887.535140:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2746 committed 00000004:00080000:1.0:1746140887.535142:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2724 committed 00000004:00080000:1.0:1746140887.535143:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2745 committed 00000004:00080000:1.0:1746140887.535145:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2744 committed 00000004:00080000:1.0:1746140887.535146:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2743 committed 00000004:00080000:1.0:1746140887.535148:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2723 committed 00000004:00080000:1.0:1746140887.535149:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2722 committed 00000004:00080000:1.0:1746140887.535151:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2742 committed 00000004:00080000:1.0:1746140887.535154:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2741 committed 00000004:00080000:1.0:1746140887.535155:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2721 committed 00000001:00080000:1.0:1746140887.535161:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945079 is committed 00000001:00080000:1.0:1746140887.535166:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945078 is committed 00000004:00010000:2.0:1746140887.535414:0:14742:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801354bf100 reply state ffff880136352800 transno 8589945082 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140887.535425:0:14742:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746140887.535439:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576082432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.535511:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1746140887.535531:0:14742:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746140887.535545:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32734:x1830960573797120:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 22009us (22340us total) trans 8589945082 rc 0/0 00000100:00100000:2.0:1746140887.535553:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10778 00010000:00010000:2.0:1746140887.535586:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.535593:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.535600:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.535605:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f1bea00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.535611:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.535617:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.535642:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.535645:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140887.535649:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.535654:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1bea00/0x8156357b7fdbaa8e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00000100:00100000:1.0:1746140887.536261:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576082944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.536282:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.536373:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576082560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.536400:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576082688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.536884:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576082432 00000100:00100000:2.0:1746140887.536892:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576082432 00000100:00100000:2.0:1746140887.536924:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576082944 00000100:00100000:2.0:1746140887.536926:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576082944 00000100:00100000:2.0:1746140887.536939:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17160 00000100:00100000:2.0:1746140887.536946:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3313:x1830960576082432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.537102:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17161 00000100:00100000:3.0:1746140887.537111:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f09bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3313:x1830960576082944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140887.537342:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140887.537345:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.537348:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.537350:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.537352:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746140887.537562:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f09bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3313:x1830960576082944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 453us (1277us total) trans 17179874163 rc 0/0 00000100:00100000:3.0:1746140887.537569:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17161 00000100:00100000:2.0:1746140887.537608:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3313:x1830960576082432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 662us (2097us total) trans 17179874164 rc 0/0 00000004:00080000:1.0:1746140887.537609:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7dc00/2, rc 0, transno 17179874163 00000100:00100000:1.0:1746140887.537614:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576082944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.537615:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17160 00000100:00100000:1.0:1746140887.537622:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576083456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.537643:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.537656:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576083968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.537658:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576083456 00000100:00100000:2.0:1746140887.537661:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576083456 00000100:00100000:1.0:1746140887.537669:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.537679:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576083968 00000100:00100000:2.0:1746140887.537682:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576083968 00000004:00080000:1.0:1746140887.537687:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7ca80/2, rc 0, transno 17179874164 00000100:00100000:1.0:1746140887.537691:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576082432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.537694:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17162 00000100:00100000:1.0:1746140887.537696:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746140887.537698:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3313:x1830960576083456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.537700:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576082816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.537714:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.537727:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576083328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.537740:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.537751:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576083840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.537765:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.537776:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576084352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.537787:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746140887.537796:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140887.537799:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.537801:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.537802:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.537804:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746140887.537830:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3313:x1830960576083456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (185us total) trans 21474841451 rc 0/0 00000100:00100000:2.0:1746140887.537834:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17162 00000100:00100000:2.0:1746140887.537841:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576082816 00000100:00100000:2.0:1746140887.537843:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576082816 00000100:00100000:2.0:1746140887.537853:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576083328 00000100:00100000:2.0:1746140887.537855:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576083328 00000100:00100000:2.0:1746140887.537863:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576083840 00000100:00100000:2.0:1746140887.537865:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576083840 00000100:00100000:2.0:1746140887.537872:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576084352 00000100:00100000:2.0:1746140887.537874:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576084352 00000100:00100000:2.0:1746140887.537883:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17163 00000100:00100000:2.0:1746140887.537886:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3313:x1830960576083968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.537910:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.537933:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17164 00000100:00100000:1.0:1746140887.537941:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3313:x1830960576082816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.537961:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3313:x1830960576083968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (289us total) trans 21474841452 rc 0/0 00000100:00100000:2.0:1746140887.537966:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17163 00000100:00100000:2.0:1746140887.537975:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17165 00000100:00100000:2.0:1746140887.537985:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3313:x1830960576083328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.538025:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17166 00000100:00100000:1.0:1746140887.538030:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3313:x1830960576083840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.538074:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3313:x1830960576083328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (332us total) trans 17179874166 rc 0/0 00000100:00100000:2.0:1746140887.538079:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17165 00000100:00100000:2.0:1746140887.538087:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17167 00000100:00100000:2.0:1746140887.538091:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3313:x1830960576084352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.538135:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3313:x1830960576083840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (368us total) trans 21474841453 rc 0/0 00000100:00100000:1.0:1746140887.538140:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17166 00000100:00100000:1.0:1746140887.538179:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3313:x1830960576082816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (464us total) trans 17179874165 rc 0/0 00000100:00100000:1.0:1746140887.538183:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17164 00000100:00100000:0.0:1746140887.538223:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.538246:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576083200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.538267:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.538274:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3313:x1830960576084352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (484us total) trans 21474841454 rc 0/0 00000100:00100000:0.0:1746140887.538277:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576083712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.538278:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17167 00000100:00100000:2.0:1746140887.538286:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576082688 00000100:00100000:2.0:1746140887.538289:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576082688 00000100:00100000:0.0:1746140887.538291:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.538299:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576083200 00000100:00100000:2.0:1746140887.538300:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576083200 00000100:00100000:0.0:1746140887.538301:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576084224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.538327:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576083712 00000100:00100000:2.0:1746140887.538329:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576083712 00000100:00100000:2.0:1746140887.538338:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17168 00000100:00100000:0.0:1746140887.538339:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140887.538342:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3311:x1830960576082688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.538361:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576084224 00000100:00100000:0.0:1746140887.538364:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576084224 00000100:00100000:0.0:1746140887.538378:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17169 00000100:00100000:0.0:1746140887.538382:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3311:x1830960576083200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140887.538403:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746140887.538406:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140888 -> 1746140888 00002000:00010000:2.0:1746140887.538407:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140888 -> 1746140888 00002000:00010000:2.0:1746140887.538409:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140888 -> 1746140888 00002000:00010000:2.0:1746140887.538411:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746140887.538433:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3311:x1830960576082688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (210us total) trans 17179874167 rc 0/0 00000100:00100000:2.0:1746140887.538438:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17168 00000100:00100000:2.0:1746140887.538446:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17170 00000100:00100000:2.0:1746140887.538449:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3311:x1830960576083712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.538477:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3311:x1830960576083200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (208us total) trans 17179874168 rc 0/0 00000100:00100000:3.0:1746140887.538483:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17171 00000100:00100000:3.0:1746140887.538491:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3311:x1830960576084224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.538491:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17169 00002000:00010000:2.0:1746140887.538510:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:2.0:1746140887.538512:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140888 -> 1746140888 00002000:00010000:2.0:1746140887.538515:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140888 -> 1746140888 00002000:00010000:2.0:1746140887.538516:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140888 -> 1746140888 00000100:00100000:0.0:1746140887.538516:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746140887.538518:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5521 -> 5521 00000100:00100000:0.0:1746140887.538532:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576083072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.538536:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3311:x1830960576083712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (244us total) trans 21474841455 rc 0/0 00000100:00100000:2.0:1746140887.538540:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17170 00000100:00100000:2.0:1746140887.538546:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576082560 00000100:00100000:2.0:1746140887.538548:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576082560 00000100:00100000:2.0:1746140887.538556:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17172 00000100:00100000:2.0:1746140887.538559:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3310:x1830960576082560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.538564:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.538573:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576083584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.538584:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3311:x1830960576084224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (244us total) trans 21474841456 rc 0/0 00000100:00100000:0.0:1746140887.538587:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.538589:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17171 00000100:00100000:0.0:1746140887.538595:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576084096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.538599:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576083072 00000100:00100000:3.0:1746140887.538602:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576083072 00000100:00100000:0.0:1746140887.538607:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.538612:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576083584 00000100:00100000:3.0:1746140887.538614:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576083584 00002000:00010000:2.0:1746140887.538615:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140887.538618:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:2.0:1746140887.538620:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00000100:00100000:3.0:1746140887.538621:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576084096 00002000:00010000:2.0:1746140887.538621:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00000100:00100000:3.0:1746140887.538623:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576084096 00002000:00010000:2.0:1746140887.538623:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746140887.538624:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17173 00000100:00100000:0.0:1746140887.538628:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3310:x1830960576083072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.538630:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17174 00000100:00100000:3.0:1746140887.538634:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960576083584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.538644:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3310:x1830960576082560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (127us total) trans 17179874169 rc 0/0 00000100:00100000:2.0:1746140887.538648:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17172 00000100:00100000:2.0:1746140887.538656:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17175 00000100:00100000:2.0:1746140887.538659:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3310:x1830960576084096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140887.538700:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746140887.538702:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3310:x1830960576083072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (137us total) trans 17179874170 rc 0/0 00002000:00010000:3.0:1746140887.538703:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140888 -> 1746140888 00002000:00010000:3.0:1746140887.538705:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.538707:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140888 -> 1746140888 00000100:00100000:0.0:1746140887.538707:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17173 00002000:00010000:3.0:1746140887.538709:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746140887.538730:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3310:x1830960576083584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (142us total) trans 21474841457 rc 0/0 00000100:00100000:2.0:1746140887.538731:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3310:x1830960576084096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (123us total) trans 21474841458 rc 0/0 00000004:00080000:0.0:1746140887.538731:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7ce00/2, rc 0, transno 17179874169 00000100:00100000:3.0:1746140887.538735:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17174 00000100:00100000:0.0:1746140887.538735:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576082560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.538740:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7df80/2, rc 0, transno 17179874170 00000100:00100000:0.0:1746140887.538743:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576083072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.538746:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17175 00000004:00080000:0.0:1746140887.538749:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7f100/2, rc 0, transno 21474841457 00000100:00100000:0.0:1746140887.538756:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576083584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.538762:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7ed80/2, rc 0, transno 21474841458 00000100:00100000:0.0:1746140887.538764:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576084096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.538767:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573798272 00000100:00100000:2.0:1746140887.538770:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573798272 00000100:00100000:2.0:1746140887.538790:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10779 00000100:00100000:2.0:1746140887.538794:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:32734:x1830960573798272:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140887.538808:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.538823:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b33 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.538834:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746140887.538840:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576084480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.538858:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746140887.538869:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.538880:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746140887.538893:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7d180/2, rc 0, transno 17179874167 00010000:00010000:2.0:1746140887.538894:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00000100:00100000:0.0:1746140887.538896:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576082688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.538897:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576084480 00010000:00010000:2.0:1746140887.538897:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140887.538900:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427000, rc 0) 00000100:00100000:3.0:1746140887.538901:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576084480 00000004:00080000:0.0:1746140887.538901:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7d880/2, rc 0, transno 17179874168 00000100:00100000:0.0:1746140887.538903:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576083200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.538909:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7f800/2, rc 0, transno 21474841455 00000100:00100000:0.0:1746140887.538911:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576083712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.538917:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7ea00/2, rc 0, transno 21474841456 00000100:00100000:3.0:1746140887.538918:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17176 00000100:00100000:0.0:1746140887.538920:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576084224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.538922:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3312:x1830960576084480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.539003:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3312:x1830960576084480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (144us total) trans 21474841459 rc 0/0 00000100:00100000:3.0:1746140887.539009:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17176 00000100:00100000:2.0:1746140887.539103:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:32734:x1830960573798272:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 307us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.539108:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10779 00000004:00080000:2.0:1746140887.539137:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7d500/2, rc 0, transno 17179874165 00000100:00100000:2.0:1746140887.539140:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576082816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140887.539147:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7c000/2, rc 0, transno 17179874166 00000100:00100000:2.0:1746140887.539149:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576083328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140887.539157:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7f480/2, rc 0, transno 21474841453 00000100:00100000:2.0:1746140887.539159:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576083840:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140887.539164:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7e680/2, rc 0, transno 21474841454 00000100:00100000:2.0:1746140887.539167:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576084352:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140887.539173:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7e300/2, rc 0, transno 21474841451 00000100:00100000:2.0:1746140887.539175:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576083456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140887.539181:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7fb80/2, rc 0, transno 21474841452 00000100:00100000:2.0:1746140887.539182:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576083968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.539498:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948f9c00/2, rc 0, transno 21474841459 00000100:00100000:0.0:1746140887.539501:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576084480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.541278:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.541339:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573798400 00000100:00100000:1.0:1746140887.541347:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573798400 00000100:00100000:1.0:1746140887.541396:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10780 00000100:00100000:1.0:1746140887.541403:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32734:x1830960573798400:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140887.541421:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.541439:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaaa3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b3a expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.541520:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.541532:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.541541:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140887.541562:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140887.541566:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140887.541579:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.541599:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaaa3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.541612:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.541618:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.541621:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140887.541623:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce6800, rc 0) 00000100:00100000:1.0:1746140887.541670:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:32734:x1830960573798400:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 268us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.541675:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10780 00000100:00100000:0.0:1746140887.543388:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.543417:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.543493:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.543508:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.543587:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.543612:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573798528 00000100:00100000:1.0:1746140887.543619:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573798528 00000100:00100000:2.0:1746140887.543634:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573798656 00000100:00100000:2.0:1746140887.543638:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573798656 00000100:00100000:1.0:1746140887.543652:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573798784 00000100:00100000:2.0:1746140887.543653:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573798912 00000100:00100000:2.0:1746140887.543654:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573798912 00000100:00100000:1.0:1746140887.543654:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573798784 00000100:00100000:1.0:1746140887.543662:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573799040 00000100:00100000:1.0:1746140887.543664:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573799040 00000100:00100000:2.0:1746140887.543706:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17177 00000100:00100000:1.0:1746140887.543710:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17178 00000100:00100000:2.0:1746140887.543713:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573798528:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:1.0:1746140887.543715:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573798656:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140887.543724:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.543724:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.543739:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b41 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.543739:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b48 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.543757:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.543757:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.543758:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.543758:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.543766:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 11 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.543766:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 10 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.543779:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 11 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.543779:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 10 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.543788:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e427a00, rc 0) 00010000:00010000:1.0:1746140887.543788:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce7c00, rc 0) 00000100:00100000:3.0:1746140887.543790:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17179 00000100:00100000:3.0:1746140887.543800:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573798784:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140887.543807:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.543815:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b4f expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.543819:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573798528:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 106us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.543819:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573798656:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.543824:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17178 00000100:00100000:2.0:1746140887.543826:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17177 00010000:00010000:3.0:1746140887.543827:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.543829:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.543833:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 10 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140887.543836:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17180 00000100:00100000:2.0:1746140887.543838:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17181 00000100:00100000:1.0:1746140887.543840:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573798912:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746140887.543842:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573799040:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140887.543845:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.543848:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 10 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.543849:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.543852:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b56 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.543854:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b5d expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.543855:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5229e00, rc 0) 00010000:00010000:2.0:1746140887.543861:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.543861:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.543862:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.543863:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.543866:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.543866:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 12 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.543874:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.543874:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 12 pid: 4186 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140887.543875:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573798784:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 77us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.543880:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17179 00010000:00010000:1.0:1746140887.543880:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce7600, rc 0) 00010000:00010000:2.0:1746140887.543881:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e426800, rc 0) 00000100:00100000:2.0:1746140887.543894:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573799040:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.543894:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573798912:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 53us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.543898:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17181 00000100:00100000:1.0:1746140887.543901:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17180 00000100:00100000:0.0:1746140887.544382:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.544431:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573799168 00000100:00100000:2.0:1746140887.544435:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573799168 00000100:00100000:2.0:1746140887.544460:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17182 00000100:00100000:2.0:1746140887.544465:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573799168:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140887.544471:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.544478:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b64 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.544488:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.544490:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.544494:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 11 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.544507:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 11 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.544515:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e426600, rc 0) 00000100:00100000:2.0:1746140887.544533:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573799168:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 68us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.544538:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17182 00000100:00100000:0.0:1746140887.568427:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.568471:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573799424 00000100:00100000:1.0:1746140887.568524:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573799424 00000100:00100000:1.0:1746140887.569806:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10781 00000100:00100000:1.0:1746140887.569815:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32738:x1830960573799424:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140887.569836:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.569853:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbaadb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b6b expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.569962:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.569975:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.569984:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.570000:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.570005:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.570011:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.570125:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.570135:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.570142:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.570171:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.570182:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.570193:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abb8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576084608:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.570299:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b257840 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.571695:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abb8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576084608:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.571715:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140887.572083:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.572246:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573799552 00000100:00100000:3.0:1746140887.572253:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573799552 00010000:00010000:3.0:1746140887.572284:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.572340:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8880 00000100:00100000:0.0:1746140887.572348:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573799552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140887.572360:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.572366:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.572376:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.572396:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6a0e400/0x8156357b7fdbaa17 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ae6 expref: 9 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.572425:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140887.572430:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.572439:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.572446:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.572472:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140887.572512:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573799552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 165us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.572519:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8880 00010000:00010000:1.0:1746140887.572538:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.572545:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140887.573362:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140887.573483:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573490:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573496:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573501:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fce6200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.573505:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573511:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573519:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.573521:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140887.573525:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573529:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6200/0x8156357b7fdbaaf0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573559:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573568:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573572:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573576:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fce7800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.573579:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573584:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573591:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140887.573592:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.573595:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573599:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7800/0x8156357b7fdbaae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573608:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573613:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573618:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573622:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fce7000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.573624:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573633:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573638:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4dd00) 00010000:00010000:1.0:1746140887.573639:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.573641:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573646:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce7000/0x8156357b7fdbaae9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.573691:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbaadb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b6b expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.573697:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbaadb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b6b expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.573705:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce6000, rc 0) 00000100:00100000:1.0:1746140887.573742:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32738:x1830960573799424:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3928us (5327us total) trans 8589945084 rc 301/301 00000100:00100000:1.0:1746140887.573749:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10781 00000100:00100000:0.0:1746140887.588362:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.588404:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573799680 00000100:00100000:1.0:1746140887.588413:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573799680 00000100:00100000:2.0:1746140887.588497:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.588575:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573799936 00000100:00100000:3.0:1746140887.588580:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573799936 00000100:00100000:3.0:1746140887.588666:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10782 00000100:00100000:3.0:1746140887.588674:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:32741:x1830960573799936:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140887.588678:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10783 00000100:00100000:1.0:1746140887.588685:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32738:x1830960573799680:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140887.588697:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.588697:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.588713:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228000/0x8156357b7fdbab05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b79 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.588713:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdbaafe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b72 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.588765:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdbaafe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b72 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.588777:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdbaafe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b72 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.588795:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.588798:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140887.588801:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce6400, rc 0) 00010000:00010000:3.0:1746140887.588815:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.588823:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.588831:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.588844:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589061:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589068:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589162:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589169:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589175:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140887.589183:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140887.589261:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589267:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589272:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589277:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5228a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140887.589281:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589287:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589295:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00000100:00100000:1.0:1746140887.589323:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32738:x1830960573799680:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 619us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.589329:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10783 00010000:00010000:3.0:1746140887.589739:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140887.589747:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589751:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228a00/0x8156357b7fdbab1a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589778:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589782:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589786:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589790:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5229800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140887.589792:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589796:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589802:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140887.589804:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140887.589805:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589809:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229800/0x8156357b7fdbab0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589816:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589821:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589825:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589829:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5228e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140887.589831:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589836:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589840:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a69ac300) 00010000:00010000:3.0:1746140887.589842:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140887.589844:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589848:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228e00/0x8156357b7fdbab13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.589885:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228000/0x8156357b7fdbab05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b79 expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.589891:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228000/0x8156357b7fdbab05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b79 expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.589897:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5228000, rc 0) 00000100:00100000:3.0:1746140887.589930:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32741:x1830960573799936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1257us (1432us total) trans 8589945085 rc 301/301 00000100:00100000:3.0:1746140887.589939:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10782 00000100:00100000:0.0:1746140887.591102:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.591175:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573800192 00000100:00100000:3.0:1746140887.591181:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573800192 00000100:00100000:3.0:1746140887.591517:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10784 00000100:00100000:3.0:1746140887.591523:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32738:x1830960573800192:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140887.591537:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.591540:0:14742:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746140887.591556:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6400/0x8156357b7fdbaafe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b72 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.591569:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140887.591572:0:14742:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140887.591579:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228400/0x8156357b7fdbab28 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b80 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.591619:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.591629:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.591635:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.591641:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 5/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140887.591670:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.591682:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 7 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.591693:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576084736:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.591769:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.591776:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 7 pid: 14742 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.591783:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576084864:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.591894:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.592351:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573800320 00000100:00100000:1.0:1746140887.592356:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573800320 00000100:00100000:1.0:1746140887.592383:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10785 00000100:00100000:1.0:1746140887.592388:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32741:x1830960573800320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.592397:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.592404:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdbab36 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b87 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.592463:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.592470:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.592475:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.592488:0:14785:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.592496:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140887.592549:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.593840:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.593920:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.593946:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573800448 00000100:00100000:2.0:1746140887.593951:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573800448 00000100:00100000:3.0:1746140887.593974:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576084736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.593974:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 8 pid: 14742 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.593991:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573800576 00000100:00100000:2.0:1746140887.593993:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573800576 00000100:00100000:3.0:1746140887.594023:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576084864:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.594037:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8881 00010000:00010000:3.0:1746140887.594040:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00000100:00100000:1.0:1746140887.594056:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573800448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.594067:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.594072:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 9 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.594084:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 9 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.594100:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427000/0x8156357b7fdbaa9c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b33 expref: 9 pid: 14742 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.594114:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.594119:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.594125:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.594129:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140887.594133:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.594139:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140887.594180:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573800448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 137us (343us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140887.594346:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.594364:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8882 00000100:00100000:2.0:1746140887.594370:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573800576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.594377:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.594381:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 8 pid: 14785 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.594416:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8881 00010000:00010000:2.0:1746140887.594468:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 7 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.594479:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6800/0x8156357b7fdbaaaa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b3a expref: 7 pid: 14785 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.594490:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.594493:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.594498:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.594503:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.594509:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.594515:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.594521:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140887.594537:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.594556:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:1985:x1830960573800576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 187us (636us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.594561:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140887.594562:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8882 00010000:00010000:3.0:1746140887.594568:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00000040:00080000:3.0:1746140887.595221:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3485, 88 off295352 00000004:00080000:3.0:1746140887.595228:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866670922810ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595275:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3507, 88 off297464 00000004:00080000:3.0:1746140887.595279:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866670974096ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140887.595295:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3508, 88 off297552 00000004:00080000:3.0:1746140887.595297:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866670992466ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140887.595319:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3486, 88 off295440 00000004:00080000:3.0:1746140887.595323:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866671017795ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595331:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3487, 88 off295528 00000004:00080000:3.0:1746140887.595334:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866671029505ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595343:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3509, 88 off297640 00000004:00080000:3.0:1746140887.595345:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866671040293ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140887.595352:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3510, 88 off297728 00000004:00080000:3.0:1746140887.595354:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866671049755ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140887.595362:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3511, 88 off297816 00000004:00080000:3.0:1746140887.595364:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866671059782ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140887.595372:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3488, 88 off295616 00000004:00080000:3.0:1746140887.595374:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866671069647ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595382:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3512, 88 off297904 00000004:00080000:3.0:1746140887.595385:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866671080086ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140887.595392:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3489, 88 off295704 00000004:00080000:3.0:1746140887.595395:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866671089797ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595402:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3513, 88 off297992 00000004:00080000:3.0:1746140887.595405:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866671100072ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140887.595412:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3490, 88 off295792 00000004:00080000:3.0:1746140887.595415:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866671110492ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595422:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3491, 88 off295880 00000004:00080000:3.0:1746140887.595425:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866671120131ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595432:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3492, 88 off295968 00000004:00080000:3.0:1746140887.595435:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866671130091ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595443:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3493, 88 off296056 00000004:00080000:3.0:1746140887.595445:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 866671140063ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140887.595452:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3514, 88 off298080 00000004:00080000:3.0:1746140887.595455:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 866671149817ns, next at 809142599738ns, rc = 0 00000001:00080000:0.0:1746140887.609479:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945084 is committed 00000001:00080000:0.0:1746140887.609496:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945086 is committed 00000004:00080000:0.0:1746140887.609499:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2756 committed 00000004:00080000:0.0:1746140887.609505:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2738 committed 00000004:00080000:0.0:1746140887.609510:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2737 committed 00000004:00080000:0.0:1746140887.609511:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2736 committed 00000004:00080000:0.0:1746140887.609513:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2735 committed 00000004:00080000:0.0:1746140887.609514:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2755 committed 00000004:00080000:0.0:1746140887.609515:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2734 committed 00000004:00080000:0.0:1746140887.609516:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2754 committed 00000004:00080000:0.0:1746140887.609517:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2733 committed 00000004:00080000:0.0:1746140887.609518:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2753 committed 00000004:00080000:0.0:1746140887.609519:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2752 committed 00000004:00080000:0.0:1746140887.609520:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2751 committed 00000004:00080000:0.0:1746140887.609521:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2732 committed 00000004:00080000:0.0:1746140887.609523:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2731 committed 00000004:00080000:0.0:1746140887.609524:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2750 committed 00000004:00080000:0.0:1746140887.609526:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2749 committed 00000004:00080000:0.0:1746140887.609527:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2730 committed 00000001:00080000:0.0:1746140887.609531:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945085 is committed 00000100:00100000:3.0:1746140887.609625:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746140887.609642:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576085376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.609650:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576084992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.609696:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.609699:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576085120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.609718:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.609719:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576085248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.609741:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576085632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140887.609753:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576085376 00000100:00100000:0.0:1746140887.609754:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.609761:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576085376 00000100:00100000:0.0:1746140887.609766:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576086144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.609781:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.609805:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576086656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.609821:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746140887.609838:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.609845:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576085120 00000100:00100000:1.0:1746140887.609848:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576085120 00000100:00100000:3.0:1746140887.609850:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576085632 00010000:00010000:2.0:1746140887.609851:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00000100:00100000:0.0:1746140887.609852:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1746140887.609853:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1746140887.609855:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576085632 00010000:00010000:2.0:1746140887.609856:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140887.609856:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576086528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.609863:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576086144 00010000:00010000:2.0:1746140887.609864:0:14742:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140887.609866:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576086144 00010000:00010000:2.0:1746140887.609868:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140887.609872:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.609882:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576086656 00000100:00100000:3.0:1746140887.609883:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576086656 00000100:00100000:1.0:1746140887.609883:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576086528 00000100:00100000:1.0:1746140887.609885:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576086528 00000100:00100000:3.0:1746140887.609894:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17183 00000100:00100000:0.0:1746140887.609895:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576085760:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746140887.609897:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5228400/0x8156357b7fdbab28 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 8 pid: 14742 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1746140887.609899:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3313:x1830960576085376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.609912:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746140887.609913:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.609924:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576086272:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746140887.609938:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5229000, rc 0) 00000100:00100000:0.0:1746140887.609938:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.609948:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576086784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140887.609957:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576085760 00000100:00100000:1.0:1746140887.609960:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576085760 00000100:00100000:0.0:1746140887.609962:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140887.609968:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576086272 00000100:00100000:1.0:1746140887.609970:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576086272 00000100:00100000:1.0:1746140887.609975:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576086784 00000100:00100000:1.0:1746140887.609977:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576086784 00000100:00100000:1.0:1746140887.609987:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17184 00000100:00100000:1.0:1746140887.609992:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3311:x1830960576085120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.610103:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746140887.610106:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576085888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.610117:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32738:x1830960573800192:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 18593us (19016us total) trans 8589945086 rc 0/0 00000100:00100000:0.0:1746140887.610118:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.610123:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576086400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.610125:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10784 00000100:00100000:0.0:1746140887.610131:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.610135:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576086912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.610142:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746140887.610147:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:3.0:1746140887.610150:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140888 -> 1746140888 00000100:00100000:2.0:1746140887.610151:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576085888 00002000:00010000:3.0:1746140887.610152:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140888 -> 1746140888 00002000:00010000:3.0:1746140887.610153:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140888 -> 1746140888 00000100:00100000:0.0:1746140887.610153:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576086400 00002000:00010000:3.0:1746140887.610154:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5521 -> 5521 00000100:00100000:2.0:1746140887.610154:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576085888 00000100:00100000:0.0:1746140887.610155:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576086400 00000100:00100000:2.0:1746140887.610165:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576086912 00000100:00100000:2.0:1746140887.610167:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576086912 00000100:00100000:0.0:1746140887.610167:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17185 00000100:00100000:0.0:1746140887.610171:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960576085632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.610174:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3313:x1830960576085376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (477us total) trans 21474841460 rc 0/0 00000100:00100000:2.0:1746140887.610176:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17186 00000100:00100000:3.0:1746140887.610179:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17183 00000100:00100000:2.0:1746140887.610180:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3311:x1830960576086144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.610190:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17187 00000100:00100000:3.0:1746140887.610193:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3311:x1830960576086656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140887.610222:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17188 00000100:00100000:2.0:1746140887.610227:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3311:x1830960576086528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.610243:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960576085632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (488us total) trans 21474841461 rc 0/0 00000100:00100000:0.0:1746140887.610247:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17185 00000100:00100000:0.0:1746140887.610255:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17189 00000100:00100000:0.0:1746140887.610259:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3312:x1830960576085760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.610268:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17190 00000100:00100000:0.0:1746140887.610271:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3312:x1830960576086272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.610276:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3311:x1830960576086656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (454us total) trans 17179874171 rc 0/0 00000100:00100000:3.0:1746140887.610282:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17187 00000100:00100000:3.0:1746140887.610288:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17191 00000100:00100000:3.0:1746140887.610291:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3312:x1830960576086784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.610302:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17192 00000100:00100000:3.0:1746140887.610323:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3312:x1830960576085888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.610332:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17193 00000100:00100000:2.0:1746140887.610338:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3312:x1830960576086400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.610351:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.610359:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576085504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.610371:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140887.610375:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576086016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.610384:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.610390:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3312:x1830960576085888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (271us total) trans 21474841463 rc 0/0 00000100:00100000:3.0:1746140887.610394:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17192 00000100:00100000:0.0:1746140887.610396:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.610402:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576084992 00000100:00100000:3.0:1746140887.610403:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576084992 00000100:00100000:3.0:1746140887.610409:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576085504 00000100:00100000:3.0:1746140887.610411:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576085504 00000004:00080000:0.0:1746140887.610413:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f783480/2, rc 0, transno 21474841460 00000100:00100000:3.0:1746140887.610417:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576086016 00000100:00100000:0.0:1746140887.610417:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576085376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.610418:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576086016 00000100:00100000:3.0:1746140887.610424:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17194 00000100:00100000:3.0:1746140887.610428:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3312:x1830960576086912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.610436:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576087040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.610439:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576085248 00000100:00100000:3.0:1746140887.610441:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576085248 00000100:00100000:0.0:1746140887.610446:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140887.610449:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576087040 00000100:00100000:3.0:1746140887.610450:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576087040 00000100:00100000:3.0:1746140887.610458:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17195 00000100:00100000:3.0:1746140887.610462:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3310:x1830960576084992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.610475:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17196 00000100:00100000:3.0:1746140887.610478:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+41:3310:x1830960576085504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.610513:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3311:x1830960576086528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 286us (640us total) trans 17179874172 rc 0/0 00000100:00100000:2.0:1746140887.610519:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17188 00000100:00100000:0.0:1746140887.610520:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3312:x1830960576085760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 260us (607us total) trans 21474841464 rc 0/0 00000100:00100000:0.0:1746140887.610527:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17189 00000100:00100000:2.0:1746140887.610531:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17197 00000100:00100000:2.0:1746140887.610535:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3310:x1830960576086016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.610540:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17198 00000100:00100000:0.0:1746140887.610544:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3313:x1830960576085248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140887.610567:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+42:3310:x1830960576085504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (194us total) trans 21474841465 rc 0/0 00000100:00100000:3.0:1746140887.610576:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17196 00000100:00100000:3.0:1746140887.610586:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17199 00000100:00100000:3.0:1746140887.610590:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+42:3310:x1830960576087040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140887.610612:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3310:x1830960576086016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (226us total) trans 21474841466 rc 0/0 00002000:00010000:0.0:1746140887.610613:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140887.610615:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140888 -> 1746140888 00000100:00100000:2.0:1746140887.610617:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17197 00002000:00010000:0.0:1746140887.610617:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.610619:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140888 -> 1746140888 00002000:00010000:0.0:1746140887.610621:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140887.610641:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3313:x1830960576085248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (243us total) trans 21474841467 rc 0/0 00000100:00100000:0.0:1746140887.610646:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17198 00000100:00100000:3.0:1746140887.610662:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+42:3310:x1830960576087040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (214us total) trans 21474841468 rc 0/0 00000004:00080000:0.0:1746140887.610664:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f781f80/2, rc 0, transno 21474841467 00000100:00100000:3.0:1746140887.610667:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17199 00000100:00100000:0.0:1746140887.610667:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576085248:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.610681:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093132300/2, rc 0, transno 17179874172 00000100:00100000:0.0:1746140887.610684:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576086528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.610689:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc08380/2, rc 0, transno 17179874171 00000004:00080000:3.0:1746140887.610691:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f2c0700/2, rc 0, transno 21474841468 00000100:00100000:0.0:1746140887.610692:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576086656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140887.610694:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576087040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.610698:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f780a80/2, rc 0, transno 21474841461 00000100:00100000:0.0:1746140887.610700:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576085632:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140887.610702:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f783b80/2, rc 0, transno 21474841465 00000100:00100000:3.0:1746140887.610704:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576085504:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140887.610711:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece2680/2, rc 0, transno 21474841466 00000004:00080000:0.0:1746140887.610712:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece1500/2, rc 0, transno 21474841463 00000100:00100000:3.0:1746140887.610714:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576086016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140887.610715:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576085888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140887.610721:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ece3b80/2, rc 0, transno 21474841464 00000100:00100000:0.0:1746140887.610723:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ece3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576085760:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140887.610779:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746140887.610782:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.610784:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.610786:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:1.0:1746140887.610788:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746140887.610818:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3311:x1830960576085120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 825us (1099us total) trans 21474841462 rc 0/0 00000100:00100000:1.0:1746140887.610823:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17184 00000004:00080000:0.0:1746140887.610830:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f780e00/2, rc 0, transno 21474841462 00000100:00100000:0.0:1746140887.610834:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576085120:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746140887.610850:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.610857:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140887.610882:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140887.610885:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140887.610898:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.610920:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6600/0x8156357b7fdbab36 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.610931:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 267 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.610936:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.610938:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746140887.610940:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fce6000, rc 0) 00000100:00100000:2.0:1746140887.610968:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3312:x1830960576086784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 675us (1003us total) trans 17179874175 rc 0/0 00000100:00100000:1.0:1746140887.610968:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32741:x1830960573800320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 18580us (19074us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.610973:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17191 00000100:00100000:1.0:1746140887.610977:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10785 00000100:00100000:2.0:1746140887.611123:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3312:x1830960576086400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 785us (990us total) trans 17179874176 rc 0/0 00000100:00100000:2.0:1746140887.611127:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17193 00000004:00080000:0.0:1746140887.611160:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abbad80/2, rc 0, transno 17179874176 00000100:00100000:0.0:1746140887.611164:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576086400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140887.611172:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc09c00/2, rc 0, transno 17179874175 00000100:00100000:0.0:1746140887.611175:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576086784:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746140887.611201:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746140887.611203:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140888 -> 1746140888 00002000:00010000:3.0:1746140887.611212:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140888 -> 1746140888 00002000:00010000:3.0:1746140887.611213:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140888 -> 1746140888 00002000:00010000:3.0:1746140887.611215:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746140887.611239:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3312:x1830960576086272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 966us (1299us total) trans 17179874173 rc 0/0 00000100:00100000:3.0:1746140887.611244:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17190 00000004:00080000:0.0:1746140887.611289:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abbaa00/2, rc 0, transno 17179874173 00000100:00100000:0.0:1746140887.611293:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576086272:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746140887.611460:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140887.611462:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.611464:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.611466:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:3.0:1746140887.611468:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746140887.611496:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960576086144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1315us (1713us total) trans 17179874174 rc 0/0 00000100:00100000:3.0:1746140887.611501:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17186 00000004:00080000:1.0:1746140887.611536:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abba300/2, rc 0, transno 17179874174 00000100:00100000:1.0:1746140887.611541:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576086144:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140887.611621:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140887.611624:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.611626:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.611628:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140887 -> 1746140887 00002000:00010000:0.0:1746140887.611629:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140887.611653:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3310:x1830960576084992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1189us (1300us total) trans 17179874178 rc 0/0 00000100:00100000:0.0:1746140887.611657:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17195 00000100:00100000:2.0:1746140887.611730:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3312:x1830960576086912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1301us (1585us total) trans 17179874177 rc 0/0 00000100:00100000:2.0:1746140887.611735:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17194 00000004:00080000:1.0:1746140887.611743:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc09500/2, rc 0, transno 17179874177 00000100:00100000:1.0:1746140887.611747:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576086912:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140887.611789:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abb8700/2, rc 0, transno 17179874178 00000100:00100000:3.0:1746140887.611792:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576084992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140887.612854:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.612914:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573800704 00000100:00100000:2.0:1746140887.612921:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573800704 00000100:00100000:2.0:1746140887.612946:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17200 00000100:00100000:2.0:1746140887.612953:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32738:x1830960573800704:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140887.612963:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.612977:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b8e expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.612999:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 13 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.613006:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.613012:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.613013:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.613016:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3506176->3866623] (req 3506176->3866623) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.613037:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.613060:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 10 pid: 9872 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.613071:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576087168:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.613156:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 13 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.613163:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 13 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.613170:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576087296:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.613184:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.613485:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.613533:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573800832 00000100:00100000:1.0:1746140887.613537:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573800832 00000100:00100000:1.0:1746140887.613573:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10786 00000100:00100000:1.0:1746140887.613578:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:32741:x1830960573800832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.613587:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.613596:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b95 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.613632:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.613642:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.613656:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.613659:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140887.613661:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547d800, rc 0) 00000100:00100000:1.0:1746140887.613684:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32741:x1830960573800832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 106us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.613689:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10786 00000100:00100000:2.0:1746140887.614199:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576087168:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140887.615119:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.615152:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.615195:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573800960 00000100:00100000:3.0:1746140887.615200:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573800960 00000100:00100000:2.0:1746140887.615205:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573801088 00000100:00100000:2.0:1746140887.615209:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573801088 00010000:00010000:3.0:1746140887.615224:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 11 pid: 9872 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.615224:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 14 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.615254:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8883 00000100:00100000:3.0:1746140887.615259:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8884 00000100:00100000:2.0:1746140887.615259:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573801088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140887.615265:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573800960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.615268:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.615271:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.615285:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 11 pid: 9872 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.615285:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 14 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.615294:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 11 pid: 9872 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.615325:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 14 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.615343:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e426800/0x8156357b7fdbaacd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b5d expref: 11 pid: 9872 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.615349:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.615351:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.615352:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a16a00/0x8156357b7fdbaa87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4882432->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b25 expref: 14 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.615357:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 14 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.615365:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140887.615368:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576087296:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.615373:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.615388:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.615392:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 13 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.615395:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e426c00, rc 0) 00000100:00100000:3.0:1746140887.615397:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573800960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 132us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.615403:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8884 00000100:00100000:2.0:1746140887.615407:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576087424:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140887.615413:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32738:x1830960573800704:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2460us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.615418:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17200 00000100:00100000:2.0:1746140887.615457:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.616400:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.616426:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.616441:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.616456:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.616458:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573801344 00000100:00100000:2.0:1746140887.616462:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573801344 00000100:00100000:0.0:1746140887.616466:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.616478:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.616627:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573801600 00000100:00100000:2.0:1746140887.616629:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573801600 00000100:00100000:3.0:1746140887.616631:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573801216 00000100:00100000:1.0:1746140887.616631:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573801856 00000100:00100000:3.0:1746140887.616635:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573801216 00000100:00100000:1.0:1746140887.616635:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573801856 00000100:00100000:2.0:1746140887.616646:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573801472 00000100:00100000:2.0:1746140887.616648:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573801472 00000100:00100000:3.0:1746140887.616651:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573801728 00000100:00100000:3.0:1746140887.616653:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573801728 00000100:00100000:1.0:1746140887.616661:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17201 00000100:00100000:2.0:1746140887.616665:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17202 00000100:00100000:1.0:1746140887.616666:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573801344:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140887.616669:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17203 00000100:00100000:2.0:1746140887.616671:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1985:x1830960573801600:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140887.616673:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1985:x1830960573801216:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140887.616678:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.616678:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.616678:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.616688:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1b9c expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.616688:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bb1 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.616689:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ba3 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.616699:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.616699:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.616699:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.616700:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.616701:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.616701:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.616704:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 16 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.616705:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.616705:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 22 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.616711:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 16 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.616714:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.616714:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 22 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.616716:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009963e600, rc 0) 00010000:00010000:3.0:1746140887.616721:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3d800, rc 0) 00010000:00010000:1.0:1746140887.616721:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547ca00, rc 0) 00000100:00100000:2.0:1746140887.616736:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573801600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.616737:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573801216:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.616737:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573801344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 72us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.616740:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17202 00000100:00100000:3.0:1746140887.616743:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17203 00000100:00100000:1.0:1746140887.616745:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17201 00000100:00100000:2.0:1746140887.616749:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17204 00000100:00100000:2.0:1746140887.616751:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573801856:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140887.616752:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17205 00010000:00010000:2.0:1746140887.616755:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140887.616755:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17206 00000100:00100000:3.0:1746140887.616756:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573801472:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140887.616758:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1985:x1830960573801728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140887.616759:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bbf expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.616761:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.616762:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.616764:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.616765:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.616766:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1baa expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.616766:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013547c800/0x8156357b7fdbab6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bb8 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.616768:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 22 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.616773:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 22 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.616777:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009963e400, rc 0) 00010000:00010000:3.0:1746140887.616779:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.616780:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.616783:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 23 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140887.616788:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576087552:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140887.616789:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573801856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 37us (347us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140887.616791:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 23 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140887.616792:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17204 00010000:00010000:3.0:1746140887.616797:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3d000, rc 0) 00000100:00100000:3.0:1746140887.616808:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573801472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 52us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.616813:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17205 00000100:00100000:1.0:1746140887.616813:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.616814:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576087424:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140887.616823:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.616831:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b752a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573801088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1574us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.616835:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8883 00000100:00100000:0.0:1746140887.616972:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.617107:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573802112 00000100:00100000:1.0:1746140887.617111:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573802112 00002000:00100000:1.0:1746140887.617132:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (3506176->3510271) req@ffff88009f09bb80 x1830960573802112/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.617137:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f09bb80 with x1830960573802112 ext(3506176->3510271) 00002000:00010000:1.0:1746140887.617140:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f09bb80 00000100:00100000:1.0:1746140887.617158:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8774 00000100:00100000:1.0:1746140887.617162:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f09bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573802112:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140887.617290:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f09bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573802112:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 127us (317us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140887.617296:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8774 00002000:00100000:1.0:1746140887.617300:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (3506176->3510271) req@ffff88009f09bb80 x1830960573802112/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.617328:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f09bb80 with x1830960573802112 ext(3506176->3510271) 00002000:00010000:1.0:1746140887.617331:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f09bb80 00000100:00100000:1.0:1746140887.618137:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576087552:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140887.618153:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013547c800/0x8156357b7fdbab6e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb8 expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.618161:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547c800/0x8156357b7fdbab6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb8 expref: 15 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140887.618169:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547c800, rc 0) 00000100:00100000:1.0:1746140887.618197:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1985:x1830960573801728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1437us (1716us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140887.618201:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17206 00000100:00100000:0.0:1746140887.621197:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.621270:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573802368 00000100:00100000:3.0:1746140887.621277:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573802368 00002000:00100000:3.0:1746140887.621365:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3862528->3866623) req@ffff8801354bfb80 x1830960573802368/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.621374:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bfb80 with x1830960573802368 ext(3862528->3866623) 00002000:00010000:3.0:1746140887.621379:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bfb80 00000100:00100000:3.0:1746140887.621403:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8775 00000100:00100000:3.0:1746140887.621410:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573802368:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140887.621674:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573802368:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 264us (485us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140887.621680:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8775 00002000:00100000:3.0:1746140887.621685:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3862528->3866623) req@ffff8801354bfb80 x1830960573802368/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.621692:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bfb80 with x1830960573802368 ext(3862528->3866623) 00002000:00010000:3.0:1746140887.621695:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bfb80 00000100:00100000:0.0:1746140887.624009:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.624143:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573802624 00000100:00100000:2.0:1746140887.624155:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573802624 00000100:00100000:2.0:1746140887.624219:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4737 00000100:00100000:2.0:1746140887.624226:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:32738:x1830960573802624:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140887.624485:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32738:x1830960573802624:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 259us (487us total) trans 8589945087 rc 0/0 00000100:00100000:2.0:1746140887.624491:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4737 00000100:00100000:0.0:1746140887.624821:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.624848:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.624866:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573802880 00000100:00100000:3.0:1746140887.624871:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573802880 00000100:00100000:0.0:1746140887.624875:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746140887.624898:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801354be300 x1830960573802880/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140887.624899:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573803136 00000100:00100000:1.0:1746140887.624906:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573803136 00002000:00100000:3.0:1746140887.624910:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354be300 with x1830960573802880 ext(0->1048575) 00002000:00010000:3.0:1746140887.624914:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354be300 00000100:00100000:2.0:1746140887.624919:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573803520 00000100:00100000:2.0:1746140887.624923:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573803520 00000100:00100000:3.0:1746140887.624931:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8776 00000100:00100000:3.0:1746140887.624937:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1984:x1830960573802880:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746140887.624942:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801354bd500 x1830960573803520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.624947:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff8801354bc700 x1830960573803136/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.624948:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd500 with x1830960573803520 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.624951:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bd500 00002000:00100000:1.0:1746140887.624956:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bc700 with x1830960573803136 ext(1048576->2097151) 00002000:00010000:1.0:1746140887.624960:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bc700 00000100:00100000:2.0:1746140887.624964:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8777 00000100:00100000:2.0:1746140887.624969:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573803520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140887.624982:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8778 00000100:00100000:1.0:1746140887.624990:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573803136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.625015:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.625035:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573803648 00000100:00100000:0.0:1746140887.625039:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573803648 00002000:00100000:0.0:1746140887.625069:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8801354bca80 x1830960573803648/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140887.625080:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bca80 with x1830960573803648 ext(1048576->2097151) 00002000:00010000:0.0:1746140887.625083:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bca80 00000100:00100000:0.0:1746140887.625095:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8779 00000100:00100000:0.0:1746140887.625100:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573803648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140887.627893:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.627945:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573803904 00000100:00100000:0.0:1746140887.627955:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573803904 00000100:00100000:0.0:1746140887.627998:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10787 00000100:00100000:0.0:1746140887.628006:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:32743:x1830960573803904:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140887.628022:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.628041:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdbab7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bc6 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.628148:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628160:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628170:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628181:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628187:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628192:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628289:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628296:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628301:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:0.0:1746140887.628333:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140887.628405:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628411:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628417:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628422:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e427200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.628426:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628431:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628440:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140887.628442:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140887.628446:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628450:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427200/0x8156357b7fdbab91 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628467:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628472:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628477:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628481:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008feef400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.628482:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628486:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628491:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140887.628493:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140887.628495:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628499:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feef400/0x8156357b7fdbab83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628505:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628510:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628514:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628518:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e427e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.628521:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628526:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628531:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880131034500) 00010000:00010000:0.0:1746140887.628533:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140887.628535:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628539:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e427e00/0x8156357b7fdbab8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140887.628622:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdbab7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bc6 expref: 270 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.628631:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008feeec00/0x8156357b7fdbab7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bc6 expref: 270 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.628639:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008feeec00, rc 0) 00000100:00100000:0.0:1746140887.628680:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32743:x1830960573803904:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 675us (795us total) trans 8589945088 rc 301/301 00000100:00100000:0.0:1746140887.628687:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10787 00000100:00100000:2.0:1746140887.632499:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573803648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7391us (7476us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.632510:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8779 00002000:00100000:2.0:1746140887.632521:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8801354bca80 x1830960573803648/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.632530:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bca80 with x1830960573803648 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.632538:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bca80 00000100:00100000:3.0:1746140887.634781:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1984:x1830960573802880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9834us (9950us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.634791:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8776 00002000:00100000:3.0:1746140887.634801:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801354be300 x1830960573802880/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.634810:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354be300 with x1830960573802880 ext(0->1048575) 00002000:00010000:3.0:1746140887.634815:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354be300 00000100:00100000:2.0:1746140887.637417:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573803136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12420us (12560us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.637428:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8778 00002000:00100000:2.0:1746140887.637438:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff8801354bc700 x1830960573803136/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.637452:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bc700 with x1830960573803136 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.637456:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bc700 00000100:00100000:2.0:1746140887.640765:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573803520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15788us (15885us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.640775:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8777 00002000:00100000:2.0:1746140887.640785:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801354bd500 x1830960573803520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.640791:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd500 with x1830960573803520 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.640795:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bd500 00000100:00100000:2.0:1746140887.653674:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.653779:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573804032 00000100:00100000:1.0:1746140887.653789:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573804032 00000100:00100000:1.0:1746140887.653836:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17207 00000100:00100000:1.0:1746140887.653842:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:32741:x1830960573804032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.653856:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.653872:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bcd expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.653900:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 11 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.653905:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140887.653906:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140887.653908:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 15 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.653932:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 11 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.653939:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 11 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:1.0:1746140887.653948:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576087680:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.654281:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.659243:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576087680:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140887.659271:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 15 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.659285:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013547c400, rc 0) 00000100:00100000:1.0:1746140887.659501:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:32741:x1830960573804032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5657us (5837us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.659510:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17207 00000100:00100000:0.0:1746140887.661939:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.662074:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573804160 00000100:00100000:2.0:1746140887.662085:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573804160 00002000:00100000:2.0:1746140887.662129:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3506176->3866623) req@ffff8801354bea00 x1830960573804160/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.662139:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bea00 with x1830960573804160 ext(3506176->3866623) 00010000:00010000:2.0:1746140887.662148:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 12 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.662163:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 12 pid: 8459 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140887.662169:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801354bea00 00000100:00100000:2.0:1746140887.662202:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1818 00000100:00100000:2.0:1746140887.662210:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573804160:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140887.670090:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573804160:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7868us (8148us total) trans 21474841469 rc 0/0 00000100:00100000:2.0:1746140887.670105:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1818 00002000:00100000:2.0:1746140887.670117:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3506176->3866623) req@ffff8801354bea00 x1830960573804160/t21474841469(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.670127:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bea00 with x1830960573804160 ext(3506176->3866623) 00010000:00010000:2.0:1746140887.670137:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.670155:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00002000:00010000:2.0:1746140887.670161:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801354bea00 00000100:00100000:0.0:1746140887.673463:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.673565:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573804288 00000100:00100000:2.0:1746140887.673576:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573804288 00010000:00010000:2.0:1746140887.673614:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.674178:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8885 00000100:00100000:2.0:1746140887.674188:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573804288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.674204:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.674227:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.674239:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.674261:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e426c00/0x8156357b7fdbab44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3866623) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b8e expref: 14 pid: 8459 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.674294:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.674296:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.674329:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.674339:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.674370:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 14 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.674381:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f729180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576087808:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140887.674457:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9000 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.680835:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f729180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576087808:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140887.680856:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.680921:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573804288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6734us (7467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.680932:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8885 00010000:00010000:2.0:1746140887.683616:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140887.689877:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.689947:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.690023:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.690024:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573804544 00000100:00100000:1.0:1746140887.690034:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573804544 00002000:00100000:1.0:1746140887.690089:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8801354bc380 x1830960573804544/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140887.690090:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573804800 00000100:00100000:3.0:1746140887.690095:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573804800 00002000:00100000:1.0:1746140887.690099:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bc380 with x1830960573804544 ext(2097152->3145727) 00002000:00010000:1.0:1746140887.690104:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bc380 00002000:00100000:3.0:1746140887.690115:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801354bed80 x1830960573804800/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.690122:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bed80 with x1830960573804800 ext(3145728->4194303) 00000100:00100000:1.0:1746140887.690123:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573805056 00002000:00010000:3.0:1746140887.690125:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bed80 00000100:00100000:1.0:1746140887.690125:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573805056 00002000:00100000:1.0:1746140887.690138:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8801354bdf80 x1830960573805056/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.690144:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bdf80 with x1830960573805056 ext(2097152->3145727) 00002000:00010000:1.0:1746140887.690147:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bdf80 00000100:00100000:3.0:1746140887.690148:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8780 00000100:00100000:3.0:1746140887.690154:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573804544:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140887.690156:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8781 00000100:00100000:2.0:1746140887.690167:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573804800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140887.690181:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8782 00000100:00100000:1.0:1746140887.690187:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573805056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.697421:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.697545:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573805312 00000100:00100000:2.0:1746140887.697562:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573805312 00002000:00100000:2.0:1746140887.697615:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8801354bd880 x1830960573805312/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.697625:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd880 with x1830960573805312 ext(3145728->4194303) 00002000:00010000:2.0:1746140887.697631:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bd880 00000100:00100000:2.0:1746140887.697665:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8783 00000100:00100000:2.0:1746140887.697672:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573805312:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140887.719368:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960573804800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29196us (29414us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.719379:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8781 00002000:00100000:2.0:1746140887.719390:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801354bed80 x1830960573804800/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.719398:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bed80 with x1830960573804800 ext(3145728->4194303) 00002000:00010000:2.0:1746140887.719404:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bed80 00000100:00100000:1.0:1746140887.722201:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573805056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 32001us (32166us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.722216:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8782 00002000:00100000:1.0:1746140887.722229:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8801354bdf80 x1830960573805056/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.722238:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bdf80 with x1830960573805056 ext(2097152->3145727) 00002000:00010000:1.0:1746140887.722245:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bdf80 00000100:00100000:3.0:1746140887.722410:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573804544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 32252us (32543us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.722419:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8780 00002000:00100000:3.0:1746140887.722427:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8801354bc380 x1830960573804544/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.722436:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bc380 with x1830960573804544 ext(2097152->3145727) 00002000:00010000:3.0:1746140887.722440:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bc380 00000100:00100000:2.0:1746140887.727625:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960573805312:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29943us (30209us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.727638:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8783 00002000:00100000:2.0:1746140887.727650:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8801354bd880 x1830960573805312/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.727661:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd880 with x1830960573805312 ext(3145728->4194303) 00002000:00010000:2.0:1746140887.727667:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bd880 00000100:00100000:0.0:1746140887.740595:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.740742:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573805568 00000100:00100000:2.0:1746140887.740751:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573805568 00002000:00100000:2.0:1746140887.740793:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8801354bdc00 x1830960573805568/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.740809:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bdc00 with x1830960573805568 ext(4194304->4886527) 00002000:00010000:2.0:1746140887.740815:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bdc00 00000100:00100000:2.0:1746140887.740846:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8784 00000100:00100000:2.0:1746140887.740853:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1984:x1830960573805568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.751773:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.752967:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573805824 00000100:00100000:1.0:1746140887.752980:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573805824 00000100:00100000:1.0:1746140887.753057:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10788 00000100:00100000:1.0:1746140887.753067:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32749:x1830960573805824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.753093:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.753116:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc200/0x8156357b7fdbaba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bd4 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.753286:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753298:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753330:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753342:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753348:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753353:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753527:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753535:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753541:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140887.753549:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:3.0:1746140887.753578:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1984:x1830960573805568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12719us (12990us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140887.753590:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8784 00002000:00100000:3.0:1746140887.753602:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8801354bdc00 x1830960573805568/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.753611:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bdc00 with x1830960573805568 ext(4194304->4886527) 00002000:00010000:3.0:1746140887.753617:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bdc00 00010000:00010000:1.0:1746140887.753621:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753627:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753633:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753638:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1cda00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.753641:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753646:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753655:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.753657:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140887.753661:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753665:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cda00/0x8156357b7fdbabbb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753683:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753692:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753696:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753700:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1cc400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.753702:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753706:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753710:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140887.753712:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.753714:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753718:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc400/0x8156357b7fdbabad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753724:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753728:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753732:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753735:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1cd800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140887.753737:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753745:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753750:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4d700) 00010000:00010000:1.0:1746140887.753751:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140887.753753:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753757:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd800/0x8156357b7fdbabb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.753784:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc200/0x8156357b7fdbaba6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bd4 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.753791:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc200/0x8156357b7fdbaba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bd4 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.753797:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1cc200, rc 0) 00000100:00100000:1.0:1746140887.753840:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32749:x1830960573805824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 776us (2082us total) trans 8589945089 rc 301/301 00000100:00100000:1.0:1746140887.753846:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10788 00000100:00100000:0.0:1746140887.756100:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.756895:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573805952 00000100:00100000:1.0:1746140887.756907:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573805952 00000100:00100000:1.0:1746140887.757691:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10789 00000100:00100000:1.0:1746140887.757704:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32749:x1830960573805952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140887.757730:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140887.757752:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd200/0x8156357b7fdbabc9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bdb expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.757851:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.757867:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.757877:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140887.757908:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140887.757914:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140887.757931:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140887.757960:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cd200/0x8156357b7fdbabc9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.758012:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.758021:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140887.758024:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140887.758027:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1cc000, rc 0) 00000100:00100000:1.0:1746140887.758100:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32749:x1830960573805952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 400us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.758106:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10789 00000100:00100000:2.0:1746140887.759100:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.759721:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573806208 00000100:00100000:0.0:1746140887.759729:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573806208 00000100:00100000:0.0:1746140887.760100:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10790 00000100:00100000:0.0:1746140887.760108:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32748:x1830960573806208:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140887.760122:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.760137:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c400/0x8156357b7fdbabd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1be2 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.760242:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760252:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760260:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760271:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760275:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760280:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760393:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760400:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760407:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140887.760415:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140887.760499:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760507:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760512:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760518:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e4d000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.760522:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760528:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760540:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140887.760542:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140887.760546:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760551:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbabec lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760578:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760583:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760592:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760596:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a519c600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.760598:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760603:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760610:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140887.760612:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140887.760616:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760620:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c600/0x8156357b7fdbabde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760629:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760634:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760639:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760643:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e4ca00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140887.760645:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760649:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760659:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4ae6200) 00010000:00010000:0.0:1746140887.760661:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140887.760663:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760667:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbabe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140887.760708:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c400/0x8156357b7fdbabd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be2 expref: 12 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.760716:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a519c400/0x8156357b7fdbabd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be2 expref: 12 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.760724:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a519c400, rc 0) 00000100:00100000:2.0:1746140887.762431:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.762845:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32748:x1830960573806208:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2732us (3741us total) trans 8589945090 rc 301/301 00000100:00100000:0.0:1746140887.762857:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10790 00000100:00100000:2.0:1746140887.763040:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.763145:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573806464 00000100:00100000:3.0:1746140887.763155:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573806464 00000100:00100000:3.0:1746140887.763196:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4738 00000100:00100000:3.0:1746140887.763202:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:32741:x1830960573806464:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140887.763430:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32741:x1830960573806464:12345-192.168.204.16@tcp:35:cat.0 Request processed in 228us (1005us total) trans 8589945091 rc 0/0 00000100:00100000:3.0:1746140887.763436:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4738 00000100:00100000:0.0:1746140887.763962:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573806592 00000100:00100000:0.0:1746140887.763967:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573806592 00000100:00100000:0.0:1746140887.763997:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17208 00000100:00100000:0.0:1746140887.764003:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573806592:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140887.764014:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140887.764031:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1be9 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.764067:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.764069:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.764079:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 14 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.764097:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 14 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140887.764109:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d600, rc 0) 00000100:00100000:0.0:1746140887.764133:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573806592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 131us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140887.764139:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17208 00000100:00100000:0.0:1746140887.778820:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.778879:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.778900:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573806848 00000100:00100000:3.0:1746140887.778914:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573806848 00002000:00100000:3.0:1746140887.778965:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8800948fb100 x1830960573806848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.778974:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fb100 with x1830960573806848 ext(0->1048575) 00002000:00010000:3.0:1746140887.778980:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948fb100 00000100:00100000:3.0:1746140887.779013:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573807104 00000100:00100000:3.0:1746140887.779015:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573807104 00002000:00100000:3.0:1746140887.779025:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff8800948fad80 x1830960573807104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.779032:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fad80 with x1830960573807104 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.779035:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948fad80 00000100:00100000:3.0:1746140887.779053:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8785 00000100:00100000:3.0:1746140887.779059:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573806848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.779251:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.779268:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573807360 00000100:00100000:0.0:1746140887.779271:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573807360 00002000:00100000:0.0:1746140887.779285:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f3c3100 x1830960573807360/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140887.779293:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c3100 with x1830960573807360 ext(1048576->2097151) 00002000:00010000:0.0:1746140887.779296:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c3100 00000100:00100000:0.0:1746140887.779328:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8786 00000100:00100000:0.0:1746140887.779334:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573807104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140887.779846:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8787 00000100:00100000:3.0:1746140887.779851:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573807360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140887.781360:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.781639:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573807616 00000100:00100000:3.0:1746140887.781648:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573807616 00002000:00100000:3.0:1746140887.781688:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f3c2d80 x1830960573807616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.781697:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c2d80 with x1830960573807616 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.781703:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c2d80 00000100:00100000:3.0:1746140887.781728:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8788 00000100:00100000:3.0:1746140887.781736:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573807616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140887.792105:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573807104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12759us (13213us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.792118:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8786 00002000:00100000:2.0:1746140887.792129:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff8800948fad80 x1830960573807104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.792138:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fad80 with x1830960573807104 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.792143:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948fad80 00000100:00100000:3.0:1746140887.800034:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573807360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19240us (19841us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.800064:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8787 00002000:00100000:3.0:1746140887.800080:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f3c3100 x1830960573807360/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.800090:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c3100 with x1830960573807360 ext(1048576->2097151) 00002000:00010000:3.0:1746140887.800097:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c3100 00000100:00100000:2.0:1746140887.804112:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573807616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22365us (22743us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140887.804126:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8788 00002000:00100000:2.0:1746140887.804137:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f3c2d80 x1830960573807616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.804146:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c2d80 with x1830960573807616 ext(1048576->2097151) 00002000:00010000:2.0:1746140887.804151:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c2d80 00000100:00100000:1.0:1746140887.804753:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573806848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25689us (25940us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.804761:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8785 00002000:00100000:1.0:1746140887.804768:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8800948fb100 x1830960573806848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.804774:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fb100 with x1830960573806848 ext(0->1048575) 00002000:00010000:1.0:1746140887.804779:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948fb100 00000100:00100000:0.0:1746140887.811757:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.811956:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573807744 00000100:00100000:2.0:1746140887.811965:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573807744 00000100:00100000:2.0:1746140887.812007:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17209 00000100:00100000:2.0:1746140887.812015:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:32743:x1830960573807744:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140887.812039:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.812067:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bf0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.812100:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 16 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.812109:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.812115:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.812117:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.812120:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2887680->3145727] (req 2887680->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.812668:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.812680:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 13 pid: 8458 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.812693:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576087936:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.812844:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 16 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.812857:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.812864:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576088064:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.812882:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.815124:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.815224:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573807872 00000100:00100000:3.0:1746140887.815234:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573807872 00010000:00010000:3.0:1746140887.815278:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 14 pid: 8458 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.815288:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576087936:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.815297:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576088064:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.815349:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8886 00000100:00100000:3.0:1746140887.815356:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573807872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.815369:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.815392:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 14 pid: 8458 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.815401:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 14 pid: 8458 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.815421:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e4d600/0x8156357b7fdbabfa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1be9 expref: 14 pid: 8458 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.815452:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.815508:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573807872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.815518:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8886 00010000:00010000:2.0:1746140887.815614:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2887680->3145727] (req 2887680->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.815631:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2eee00, rc 0) 00000100:00100000:2.0:1746140887.815665:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:32743:x1830960573807744:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3651us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.815672:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17209 00000100:00100000:2.0:1746140887.819428:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.819480:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.819525:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573808000 00000100:00100000:3.0:1746140887.819540:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573808000 00000100:00100000:0.0:1746140887.819543:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573808128 00000100:00100000:0.0:1746140887.819548:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573808128 00010000:00010000:3.0:1746140887.819584:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.819598:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17210 00000100:00100000:0.0:1746140887.819606:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32749:x1830960573808128:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140887.819614:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8887 00010000:00010000:0.0:1746140887.819621:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140887.819622:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960573808000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.819636:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140887.819638:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bf7 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.819658:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.819663:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2887680->3145727] (req 2887680->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.819669:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140887.819673:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.819687:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.819699:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.819718:0:20960:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2887680->3145727] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.819721:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547c400/0x8156357b7fdbab9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bcd expref: 16 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:0.0:1746140887.819730:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.819738:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.819739:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140887.819744:0:20960:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.819750:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.819760:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140887.819765:0:20960:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140887.819775:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:0.0:1746140887.819786:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576088320:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.819820:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1984:x1830960573808000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 199us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.819826:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8887 00000100:00100000:0.0:1746140887.819852:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.820937:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576088320:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140887.820989:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4c400, rc 0) 00000100:00100000:0.0:1746140887.821162:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.821203:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32749:x1830960573808128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1596us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.821211:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17210 00000100:00100000:1.0:1746140887.821244:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573808384 00000100:00100000:1.0:1746140887.821250:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573808384 00002000:00100000:1.0:1746140887.821289:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2887680->2891775) req@ffff88008f3c3480 x1830960573808384/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.821333:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c3480 with x1830960573808384 ext(2887680->2891775) 00010000:00010000:1.0:1746140887.821342:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.821355:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.821362:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c3480 00000100:00100000:1.0:1746140887.821387:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1819 00000100:00100000:1.0:1746140887.821394:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573808384:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140887.822058:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960573808384:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 663us (895us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140887.822065:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1819 00002000:00100000:1.0:1746140887.822071:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2887680->2891775) req@ffff88008f3c3480 x1830960573808384/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.822079:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c3480 with x1830960573808384 ext(2887680->2891775) 00010000:00010000:1.0:1746140887.822084:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.822095:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.822101:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c3480 00000100:00100000:0.0:1746140887.824829:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.825086:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573808640 00000100:00100000:2.0:1746140887.825095:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573808640 00000100:00100000:0.0:1746140887.825207:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.825247:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17211 00000100:00100000:2.0:1746140887.825255:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:32743:x1830960573808640:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140887.825272:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.825291:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1bfe expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.825352:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 7 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.825361:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 23 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.825368:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 10 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.825374:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.825376:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.825379:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->2846719] (req 2097152->2846719) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.825413:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 10 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.825423:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 10 pid: 4784 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.825434:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b752a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576088448:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140887.825788:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573808768 00000100:00100000:1.0:1746140887.825793:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573808768 00002000:00100000:1.0:1746140887.825820:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2887680->3145727) req@ffff88008f3c3b80 x1830960573808768/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.825829:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c3b80 with x1830960573808768 ext(2887680->3145727) 00010000:00010000:1.0:1746140887.825836:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.825845:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.825851:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c3b80 00000100:00100000:1.0:1746140887.825864:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1820 00000100:00100000:1.0:1746140887.825869:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573808768:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:2.0:1746140887.826224:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 23 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.826240:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 23 pid: 8459 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.826251:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576088576:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.826343:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 7 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140887.826361:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 7 pid: 20960 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.826392:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576088704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.826445:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.827489:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b752a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576088448:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140887.828132:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.828188:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573808896 00000100:00100000:2.0:1746140887.828193:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576088576:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.828195:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573808896 00000100:00100000:2.0:1746140887.828201:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576088704:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.828221:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 11 pid: 4784 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.828227:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [2097152->2846719] (req 2097152->2846719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.828241:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090221e00, rc 0) 00000100:00100000:2.0:1746140887.828267:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:32743:x1830960573808640:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3014us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.828275:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17211 00000100:00100000:1.0:1746140887.828352:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8888 00000100:00100000:1.0:1746140887.828360:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573808896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.828370:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.828391:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 11 pid: 4784 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.828406:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 11 pid: 4784 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.828425:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e426600/0x8156357b7fdbaad4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b64 expref: 11 pid: 4784 timeout: 966 lvb_type: 1 00010000:00010000:1.0:1746140887.828448:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140887.828470:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573808896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.828476:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8888 00000100:00100000:0.0:1746140887.828710:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.828739:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.828771:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573809152 00000100:00100000:2.0:1746140887.828775:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573809152 00000100:00100000:2.0:1746140887.828798:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17212 00000100:00100000:2.0:1746140887.828803:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32748:x1830960573809152:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746140887.828804:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573809024 00000100:00100000:3.0:1746140887.828807:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573809024 00010000:00010000:2.0:1746140887.828813:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.828820:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 9 pid: 20960 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.828822:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c05 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.828837:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140887.828838:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8889 00010000:00010000:2.0:1746140887.828839:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140887.828843:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573809024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.828843:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2899968->3145727] (req 2899968->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.828849:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.828852:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [2899968->3145727] (req 2899968->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 10 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.828856:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 10 pid: 20960 timeout: 966 lvb_type: 1 00010000:00010000:2.0:1746140887.828859:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a4fe00, rc 0) 00010000:00010000:3.0:1746140887.828863:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 10 pid: 20960 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.828874:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbaa80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b1e expref: 10 pid: 20960 timeout: 966 lvb_type: 1 00000100:00100000:2.0:1746140887.828876:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32748:x1830960573809152:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 74us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.828882:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17212 00010000:00010000:3.0:1746140887.828892:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.828908:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573809024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.828914:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8889 00000100:00100000:2.0:1746140887.829034:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.829077:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573809280 00000100:00100000:3.0:1746140887.829081:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573809280 00010000:00010000:3.0:1746140887.829091:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 23 pid: 8459 timeout: 966 lvb_type: 1 00000100:00100000:3.0:1746140887.829111:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8890 00000100:00100000:3.0:1746140887.829115:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573809280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.829121:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.829127:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 23 pid: 8459 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.829135:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 23 pid: 8459 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.829146:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009963e400/0x8156357b7fdbab67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bbf expref: 23 pid: 8459 timeout: 966 lvb_type: 1 00010000:00010000:3.0:1746140887.829154:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.829156:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.829160:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 22 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.829168:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 22 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.829175:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.829176:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.829179:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.829185:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.829209:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.829220:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576088832:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.829289:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 22 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.829297:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576088960:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.830026:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47193c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140887.830891:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1982:x1830960573808768:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5014us (5676us total) trans 21474841470 rc 0/0 00000100:00100000:1.0:1746140887.830901:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1820 00002000:00100000:1.0:1746140887.830910:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2887680->3145727) req@ffff88008f3c3b80 x1830960573808768/t21474841470(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.830918:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c3b80 with x1830960573808768 ext(2887680->3145727) 00010000:00010000:1.0:1746140887.830926:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 17 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.830940:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 17 pid: 20960 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.830947:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c3b80 00000100:00100000:3.0:1746140887.832076:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576088832:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.832087:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576088960:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.832105:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.832149:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573809280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3032us (3114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.832159:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8890 00000100:00100000:0.0:1746140887.833274:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.833359:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573809536 00000100:00100000:1.0:1746140887.833372:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573809536 00002000:00100000:1.0:1746140887.833422:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2899968->2904063) req@ffff88008ece0380 x1830960573809536/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.833431:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0380 with x1830960573809536 ext(2899968->2904063) 00002000:00010000:1.0:1746140887.833435:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece0380 00000100:00100000:1.0:1746140887.833623:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8789 00000100:00100000:1.0:1746140887.833631:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573809536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140887.833801:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960573809536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 170us (529us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140887.833807:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8789 00002000:00100000:1.0:1746140887.833812:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2899968->2904063) req@ffff88008ece0380 x1830960573809536/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.833819:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0380 with x1830960573809536 ext(2899968->2904063) 00002000:00010000:1.0:1746140887.833822:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece0380 00000100:00100000:0.0:1746140887.834640:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.834691:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.834694:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573809664 00000100:00100000:3.0:1746140887.834701:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573809664 00010000:00010000:3.0:1746140887.834723:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 17 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.834762:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8891 00000100:00100000:3.0:1746140887.834767:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960573809664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.834778:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.834794:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 17 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.834805:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 17 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.834825:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2eee00/0x8156357b7fdbac01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf0 expref: 17 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.834838:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.834839:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.834846:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 13 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.834853:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 13 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.834882:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 13 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.834893:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576089088:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.834965:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140887.834983:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573809920 00000100:00100000:3.0:1746140887.834986:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573809920 00002000:00100000:3.0:1746140887.835005:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2842624->2846719) req@ffff88009b754000 x1830960573809920/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.835011:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754000 with x1830960573809920 ext(2842624->2846719) 00002000:00010000:3.0:1746140887.835015:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754000 00000100:00100000:3.0:1746140887.835024:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8790 00000100:00100000:3.0:1746140887.835028:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573809920:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140887.835994:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573809920:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 962us (1300us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140887.836004:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8790 00002000:00100000:3.0:1746140887.836010:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2842624->2846719) req@ffff88009b754000 x1830960573809920/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.836017:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754000 with x1830960573809920 ext(2842624->2846719) 00002000:00010000:3.0:1746140887.836020:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754000 00000100:00100000:3.0:1746140887.838138:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576089088:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140887.838158:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.838228:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573809664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3460us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.838237:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8891 00000100:00100000:0.0:1746140887.838430:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.838573:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573810176 00000100:00100000:3.0:1746140887.838579:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573810176 00000100:00100000:3.0:1746140887.838611:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4739 00000100:00100000:3.0:1746140887.838617:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:32743:x1830960573810176:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140887.839419:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32743:x1830960573810176:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 800us (988us total) trans 8589945092 rc 0/0 00000100:00100000:3.0:1746140887.839426:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4739 00000100:00100000:0.0:1746140887.839706:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.839983:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573810432 00000100:00100000:3.0:1746140887.839988:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573810432 00002000:00100000:3.0:1746140887.840014:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099497b80 x1830960573810432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.840022:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497b80 with x1830960573810432 ext(2097152->3145727) 00002000:00010000:3.0:1746140887.840027:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497b80 00000100:00100000:3.0:1746140887.840057:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8791 00000100:00100000:3.0:1746140887.840063:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960573810432:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140887.846854:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960573810432:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6782us (7138us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.846865:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8791 00002000:00100000:3.0:1746140887.846877:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099497b80 x1830960573810432/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.846885:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497b80 with x1830960573810432 ext(2097152->3145727) 00002000:00010000:3.0:1746140887.846892:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497b80 00000100:00100000:0.0:1746140887.853549:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.853615:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.853753:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573810688 00000100:00100000:2.0:1746140887.853765:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573810688 00000100:00100000:2.0:1746140887.853829:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573810560 00000100:00100000:2.0:1746140887.853831:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573810560 00000100:00100000:2.0:1746140887.854418:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17213 00000100:00100000:2.0:1746140887.854428:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32748:x1830960573810688:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140887.854444:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.854459:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c13 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.854483:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.854488:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.854489:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.854492:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->3555327] (req 3145728->3555327) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.854516:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.854524:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.854528:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17214 00000100:00100000:2.0:1746140887.854532:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576089216:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.854537:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:32749:x1830960573810560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140887.854546:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.854556:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c0c expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.854573:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.854581:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.854591:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746140887.854593:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746140887.854596:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.854600:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b99c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140887.854615:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.854623:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.854630:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576089344:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.854659:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.854664:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 21 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.854669:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576089472:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.854680:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.856978:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576089216:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140887.857005:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->3555327] (req 3145728->3555327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.857021:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a4ec00, rc 0) 00000100:00100000:2.0:1746140887.857119:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32748:x1830960573810688:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2690us (3581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.857127:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17213 00000100:00100000:3.0:1746140887.857184:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576089344:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.857202:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576089472:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.857217:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.857231:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3d600, rc 0) 00000100:00100000:3.0:1746140887.857248:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:32749:x1830960573810560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2715us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.857254:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17214 00000100:00100000:0.0:1746140887.857716:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.857889:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573810816 00000100:00100000:3.0:1746140887.857894:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573810816 00002000:00100000:3.0:1746140887.857924:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2899968->3145727) req@ffff88012b06b800 x1830960573810816/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.857932:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06b800 with x1830960573810816 ext(2899968->3145727) 00010000:00010000:3.0:1746140887.857939:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.857949:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 9 pid: 8458 timeout: 966 lvb_type: 0 00002000:00010000:3.0:1746140887.857955:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b06b800 00000100:00100000:3.0:1746140887.857981:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1821 00000100:00100000:3.0:1746140887.857987:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573810816:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140887.861216:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.861287:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.861399:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573810944 00000100:00100000:3.0:1746140887.861408:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573810944 00000100:00100000:1.0:1746140887.861435:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573811072 00000100:00100000:1.0:1746140887.861443:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573811072 00010000:00010000:3.0:1746140887.861445:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00002000:00100000:1.0:1746140887.861480:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2846719) req@ffff8800a6baea00 x1830960573811072/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.861490:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baea00 with x1830960573811072 ext(2097152->2846719) 00010000:00010000:1.0:1746140887.861498:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 22 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.861510:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 22 pid: 20960 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.861522:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6baea00 00000100:00100000:3.0:1746140887.861524:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8892 00000100:00100000:3.0:1746140887.861533:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573810944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140887.861551:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1822 00000100:00100000:1.0:1746140887.861558:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573811072:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:3.0:1746140887.861562:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.861581:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.861591:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.861617:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e4c400/0x8156357b7fdbac08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bf7 expref: 15 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.861636:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.861638:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.861644:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.861651:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.861738:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140887.861750:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576089600:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140887.861844:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.863909:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576089600:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140887.863931:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.863956:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573810944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2424us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.863966:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8892 00000100:00100000:3.0:1746140887.865848:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573810816:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7851us (8123us total) trans 17179874179 rc 0/0 00000100:00100000:3.0:1746140887.865859:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1821 00002000:00100000:3.0:1746140887.865871:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2899968->3145727) req@ffff88012b06b800 x1830960573810816/t17179874179(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.865880:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06b800 with x1830960573810816 ext(2899968->3145727) 00010000:00010000:3.0:1746140887.865890:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:3.0:1746140887.865903:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00002000:00010000:3.0:1746140887.865910:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b06b800 00000100:00100000:0.0:1746140887.866950:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.867025:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573811328 00000100:00100000:3.0:1746140887.867033:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573811328 00002000:00100000:3.0:1746140887.867074:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3551232->3555327) req@ffff8800a6baed80 x1830960573811328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.867082:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baed80 with x1830960573811328 ext(3551232->3555327) 00002000:00010000:3.0:1746140887.867085:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baed80 00000100:00100000:3.0:1746140887.867112:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8792 00000100:00100000:3.0:1746140887.867118:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573811328:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140887.867542:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573811328:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 423us (597us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140887.867548:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8792 00002000:00100000:3.0:1746140887.867552:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3551232->3555327) req@ffff8800a6baed80 x1830960573811328/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.867558:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baed80 with x1830960573811328 ext(3551232->3555327) 00002000:00010000:3.0:1746140887.867561:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baed80 00000100:00100000:0.0:1746140887.870325:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140887.870363:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.870486:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573811712 00000100:00100000:2.0:1746140887.870494:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573811712 00010000:00010000:2.0:1746140887.870527:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.870562:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8893 00000100:00100000:2.0:1746140887.870568:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573811712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.870581:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.870731:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.870744:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.870765:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a4fe00/0x8156357b7fdbac16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2899968->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c05 expref: 11 pid: 8458 timeout: 966 lvb_type: 0 00000100:00100000:3.0:1746140887.870784:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573811584 00010000:00010000:2.0:1746140887.870785:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.870795:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573811584 00000100:00100000:2.0:1746140887.870836:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573811712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 267us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.870842:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8893 00000100:00100000:3.0:1746140887.870855:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4740 00000100:00100000:3.0:1746140887.870863:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32748:x1830960573811584:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140887.871063:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32748:x1830960573811584:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 200us (763us total) trans 8589945093 rc 0/0 00000100:00100000:3.0:1746140887.871070:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4740 00000100:00100000:1.0:1746140887.873084:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573811072:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 11518us (11788us total) trans 17179874180 rc 0/0 00000100:00100000:1.0:1746140887.873094:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1822 00002000:00100000:1.0:1746140887.873104:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2846719) req@ffff8800a6baea00 x1830960573811072/t17179874180(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/448 e 0 to 0 dl 1746140898 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.873114:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baea00 with x1830960573811072 ext(2097152->2846719) 00010000:00010000:1.0:1746140887.873122:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 24 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:1.0:1746140887.873137:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 24 pid: 20960 timeout: 966 lvb_type: 0 00002000:00010000:1.0:1746140887.873144:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6baea00 00000100:00100000:0.0:1746140887.878157:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.878479:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573811840 00000100:00100000:2.0:1746140887.878491:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573811840 00010000:00010000:2.0:1746140887.878533:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 24 pid: 20960 timeout: 966 lvb_type: 0 00000100:00100000:2.0:1746140887.878575:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8894 00000100:00100000:2.0:1746140887.878583:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573811840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.878597:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.878620:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 24 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.878632:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 24 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.878653:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090221e00/0x8156357b7fdbac0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->2899967] (req 2097152->2846719) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bfe expref: 24 pid: 20960 timeout: 966 lvb_type: 0 00010000:00010000:2.0:1746140887.878684:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.878686:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140887.878693:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.878760:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.878799:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 9 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140887.878811:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576089728:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140887.878904:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1746140887.886180:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576089728:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140887.886201:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.886261:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573811840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7679us (8110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.886271:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8894 00000100:00100000:2.0:1746140887.886550:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.886646:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573812224 00000100:00100000:1.0:1746140887.886653:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573812224 00002000:00100000:1.0:1746140887.886693:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b181f80 x1830960573812224/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.886702:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181f80 with x1830960573812224 ext(2097152->3145727) 00002000:00010000:1.0:1746140887.886707:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b181f80 00000100:00100000:1.0:1746140887.886731:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8793 00000100:00100000:1.0:1746140887.886738:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573812224:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140887.887499:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.887525:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573812352 00000100:00100000:0.0:1746140887.887532:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.887536:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573812352 00000100:00100000:0.0:1746140887.887547:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573812608 00000100:00100000:0.0:1746140887.887551:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573812608 00002000:00100000:0.0:1746140887.887571:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3555328->4194303) req@ffff8800a6bae680 x1830960573812608/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.887579:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8800a6bad500 x1830960573812352/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140887.887579:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bae680 with x1830960573812608 ext(3555328->4194303) 00002000:00010000:0.0:1746140887.887582:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6bae680 00002000:00100000:3.0:1746140887.887589:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bad500 with x1830960573812352 ext(3145728->4194303) 00002000:00010000:3.0:1746140887.887593:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6bad500 00000100:00100000:0.0:1746140887.887610:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8794 00000100:00100000:0.0:1746140887.887616:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573812608:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140887.887618:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8795 00000100:00100000:3.0:1746140887.887625:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573812352:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140887.901369:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573812352:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 13732us (13859us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140887.901381:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8795 00002000:00100000:3.0:1746140887.901392:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8800a6bad500 x1830960573812352/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140887.901401:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bad500 with x1830960573812352 ext(3145728->4194303) 00002000:00010000:3.0:1746140887.901407:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6bad500 00000100:00100000:1.0:1746140887.902534:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573812224:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15790us (15978us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140887.902544:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8793 00002000:00100000:1.0:1746140887.902551:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b181f80 x1830960573812224/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140887.902560:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181f80 with x1830960573812224 ext(2097152->3145727) 00002000:00010000:1.0:1746140887.902565:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b181f80 00000100:00100000:0.0:1746140887.902887:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.902928:0:14739:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573812736 00000100:00100000:1.0:1746140887.902935:0:14739:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573812736 00000100:00100000:1.0:1746140887.902978:0:14739:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 220 00000100:00100000:1.0:1746140887.902986:0:14739:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009953b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d247991d-e844-4b62-b954-6487bd25e6e9+15:1984:x1830960573812736:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1746140887.903017:0:14739:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009953b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d247991d-e844-4b62-b954-6487bd25e6e9+15:1984:x1830960573812736:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.903022:0:14739:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 220 00000100:00100000:2.0:1746140887.903186:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573812608:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15568us (15651us total) trans 0 rc 638976/638976 00000100:00100000:2.0:1746140887.903193:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8794 00002000:00100000:2.0:1746140887.903199:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3555328->4194303) req@ffff8800a6bae680 x1830960573812608/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 638976/638976 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.903206:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6bae680 with x1830960573812608 ext(3555328->4194303) 00002000:00010000:2.0:1746140887.903210:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6bae680 00000100:00100000:0.0:1746140887.910599:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.910732:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573812992 00000100:00100000:2.0:1746140887.910743:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573812992 00002000:00100000:2.0:1746140887.910789:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8800a6baca80 x1830960573812992/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.910799:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baca80 with x1830960573812992 ext(4194304->4886527) 00002000:00010000:2.0:1746140887.910806:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baca80 00000100:00100000:2.0:1746140887.910838:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8796 00000100:00100000:2.0:1746140887.910846:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573812992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140887.919011:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573812992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8148us (8405us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140887.919026:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8796 00002000:00100000:2.0:1746140887.919039:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8800a6baca80 x1830960573812992/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:303/0 lens 488/440 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.919059:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6baca80 with x1830960573812992 ext(4194304->4886527) 00002000:00010000:2.0:1746140887.919067:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6baca80 00000100:00100000:0.0:1746140887.923831:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.923958:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573813248 00000100:00100000:3.0:1746140887.923968:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573813248 00000100:00100000:3.0:1746140887.924029:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4741 00000100:00100000:3.0:1746140887.924038:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32749:x1830960573813248:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140887.924709:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32749:x1830960573813248:12345-192.168.204.16@tcp:35:cat.0 Request processed in 671us (887us total) trans 8589945094 rc 0/0 00000100:00100000:3.0:1746140887.924717:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4741 00000100:00100000:0.0:1746140887.956779:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.956919:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573813504 00000100:00100000:2.0:1746140887.956928:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573813504 00000100:00100000:2.0:1746140887.956989:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10791 00000100:00100000:2.0:1746140887.956997:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:32756:x1830960573813504:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140887.957030:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.957059:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c1a expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.957186:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957198:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957210:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957223:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957229:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957233:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957380:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957388:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957394:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140887.957403:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140887.957494:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957500:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957506:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957512:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800934b6200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.957516:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957522:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957532:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.957536:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140887.957539:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957545:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac40 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957575:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957581:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957585:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957591:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a4f800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.957594:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957598:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957605:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140887.957607:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140887.957610:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957616:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957626:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957630:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957635:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957639:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a4e000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.957641:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957645:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957651:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f900) 00010000:00010000:2.0:1746140887.957653:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140887.957654:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957659:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4e000/0x8156357b7fdbac39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.957712:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c1a expref: 273 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.957719:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c1a expref: 273 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.957728:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a4fa00, rc 0) 00000100:00100000:2.0:1746140887.957795:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32756:x1830960573813504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 798us (1027us total) trans 8589945095 rc 301/301 00000100:00100000:2.0:1746140887.957802:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10791 00000100:00100000:0.0:1746140887.969523:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.969593:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573813632 00000100:00100000:3.0:1746140887.969602:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573813632 00000100:00100000:3.0:1746140887.969658:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17215 00000100:00100000:3.0:1746140887.969665:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:32756:x1830960573813632:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140887.969682:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140887.969699:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c21 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.969730:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.969738:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 17 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.969745:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 9 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.969750:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.969752:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140887.969754:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [663552->946175] (req 663552->946175) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.969785:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 9 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.969797:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 9 pid: 9872 timeout: 967 lvb_type: 1 00000100:00100000:3.0:1746140887.969809:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576089856:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.969927:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 17 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.969935:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 17 pid: 4784 timeout: 967 lvb_type: 1 00000100:00100000:3.0:1746140887.969944:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576089984:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.969970:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 13 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140887.969977:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 13 pid: 24958 timeout: 967 lvb_type: 1 00000100:00100000:3.0:1746140887.969984:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576090112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.970000:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b257840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.971558:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.971767:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576089856:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.971780:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576089984:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140887.971788:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576090112:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140887.971819:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [663552->946175] (req 663552->946175) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140887.971836:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e2e00, rc 0) 00000100:00100000:2.0:1746140887.971839:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573813760 00000100:00100000:2.0:1746140887.971845:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573813760 00010000:00010000:2.0:1746140887.971877:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 10 pid: 9872 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140887.972021:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8895 00000100:00100000:2.0:1746140887.972029:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573813760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140887.972051:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140887.972073:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 10 pid: 9872 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140887.972085:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 10 pid: 9872 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140887.972283:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e427a00/0x8156357b7fdbaab8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b41 expref: 10 pid: 9872 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140887.972509:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140887.972530:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573813760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 502us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140887.972537:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8895 00000100:00100000:3.0:1746140887.972583:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:32756:x1830960573813632:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2786us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.972591:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17215 00000100:00100000:0.0:1746140887.972674:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.972749:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573813888 00000100:00100000:3.0:1746140887.972754:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573813888 00010000:00010000:3.0:1746140887.972766:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 17 pid: 4784 timeout: 967 lvb_type: 1 00000100:00100000:3.0:1746140887.972780:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8896 00000100:00100000:3.0:1746140887.972785:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1982:x1830960573813888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140887.972792:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140887.972801:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 17 pid: 4784 timeout: 967 lvb_type: 1 00010000:00010000:3.0:1746140887.972810:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 17 pid: 4784 timeout: 967 lvb_type: 1 00010000:00010000:3.0:1746140887.972822:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ee3d800/0x8156357b7fdbab59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b9c expref: 17 pid: 4784 timeout: 967 lvb_type: 1 00010000:00010000:3.0:1746140887.972841:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140887.972857:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573813888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140887.972862:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8896 00000100:00100000:0.0:1746140887.973617:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140887.973710:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573814016 00000100:00100000:1.0:1746140887.973721:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573814016 00010000:00010000:1.0:1746140887.973947:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 14 pid: 24958 timeout: 967 lvb_type: 1 00000100:00100000:1.0:1746140887.973989:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8897 00000100:00100000:1.0:1746140887.973995:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573814016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140887.974007:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140887.974028:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 14 pid: 24958 timeout: 967 lvb_type: 1 00010000:00010000:1.0:1746140887.974055:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 14 pid: 24958 timeout: 967 lvb_type: 1 00010000:00010000:1.0:1746140887.974076:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013547d200/0x8156357b7fdbaa5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1afb expref: 14 pid: 24958 timeout: 967 lvb_type: 1 00010000:00010000:1.0:1746140887.974103:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.974105:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140887.974111:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 15 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.974119:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 15 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140887.974148:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 15 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140887.974160:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abde680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576090240:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140887.975265:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140887.977726:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.977788:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573814272 00000100:00100000:2.0:1746140887.977797:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573814272 00002000:00100000:2.0:1746140887.977840:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (663552->667647) req@ffff880135699500 x1830960573814272/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.977850:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699500 with x1830960573814272 ext(663552->667647) 00002000:00010000:2.0:1746140887.977855:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135699500 00000100:00100000:2.0:1746140887.978322:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8797 00000100:00100000:2.0:1746140887.978331:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573814272:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140887.978384:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abde680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576090240:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140887.978404:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140887.978460:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573814016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4464us (4844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140887.978467:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8897 00000100:00100000:2.0:1746140887.979002:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573814272:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 671us (1286us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140887.979009:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8797 00002000:00100000:2.0:1746140887.979015:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (663552->667647) req@ffff880135699500 x1830960573814272/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.979023:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699500 with x1830960573814272 ext(663552->667647) 00002000:00010000:2.0:1746140887.979027:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135699500 00000100:00100000:0.0:1746140887.987097:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.987258:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573814528 00000100:00100000:2.0:1746140887.987267:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573814528 00002000:00100000:2.0:1746140887.987332:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (942080->946175) req@ffff88013569a300 x1830960573814528/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/0 e 0 to 0 dl 1746140898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.987343:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569a300 with x1830960573814528 ext(942080->946175) 00002000:00010000:2.0:1746140887.987348:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569a300 00000100:00100000:2.0:1746140887.987369:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8798 00000100:00100000:2.0:1746140887.987376:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573814528:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140887.987556:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960573814528:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 180us (469us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140887.987562:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8798 00002000:00100000:2.0:1746140887.987568:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (942080->946175) req@ffff88013569a300 x1830960573814528/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746140898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140887.987575:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569a300 with x1830960573814528 ext(942080->946175) 00002000:00010000:2.0:1746140887.987577:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569a300 00000100:00100000:0.0:1746140887.988019:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140887.988478:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573814784 00000100:00100000:2.0:1746140887.988483:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573814784 00000100:00100000:2.0:1746140887.988561:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10792 00000100:00100000:2.0:1746140887.988567:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32758:x1830960573814784:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140887.988584:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140887.988602:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fe00/0x8156357b7fdbac55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c28 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.988912:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.988924:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.988933:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989240:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989248:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989255:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989543:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989552:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989558:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140887.989570:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140887.989652:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989658:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989664:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989670:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800934b6200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.989675:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989681:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989692:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140887.989694:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140887.989698:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.989703:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800934b6200/0x8156357b7fdbac6a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140887.989725:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140887.989812:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573815040 00000100:00100000:3.0:1746140887.989818:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573815040 00000100:00100000:3.0:1746140887.989862:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4742 00000100:00100000:3.0:1746140887.989869:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:32756:x1830960573815040:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140887.990006:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:32756:x1830960573815040:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 137us (282us total) trans 8589945097 rc 0/0 00000100:00100000:3.0:1746140887.990013:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4742 00010000:00010000:2.0:1746140887.990882:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990889:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990894:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990902:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a4f800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.990905:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990911:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990919:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140887.990922:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140887.990924:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990929:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4f800/0x8156357b7fdbac5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990937:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990941:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990946:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990949:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a4fa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140887.990951:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990955:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990960:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f200) 00010000:00010000:2.0:1746140887.990962:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140887.990964:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.990968:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140887.991002:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fe00/0x8156357b7fdbac55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c28 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.991008:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a4fe00/0x8156357b7fdbac55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c28 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140887.991014:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a4fe00, rc 0) 00000100:00100000:2.0:1746140887.991059:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32758:x1830960573814784:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2491us (3039us total) trans 8589945096 rc 301/301 00000100:00100000:2.0:1746140887.991066:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10792 00000100:00100000:0.0:1746140888.001637:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.003032:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573815296 00000100:00100000:2.0:1746140888.003053:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573815296 00000100:00080000:0.0:1746140888.003824:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746140888.003893:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10793 00000100:00100000:3.0:1746140888.003904:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:32762:x1830960573815296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.003929:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.003946:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbac78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c2f expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.004073:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004302:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004420:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004435:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004441:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004447:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004565:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004573:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004578:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140888.004588:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140888.004667:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004673:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004679:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004684:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e2400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140888.004689:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004695:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004704:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140888.004707:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140888.004710:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.004714:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2400/0x8156357b7fdbac8d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005118:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005125:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005130:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005134:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e2800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140888.005136:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005141:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005147:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140888.005149:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140888.005153:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005157:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbac7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005165:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005170:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005175:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005178:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e3c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140888.005181:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005185:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005190:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388800) 00010000:00010000:3.0:1746140888.005192:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140888.005193:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005197:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbac86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.005243:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbac78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c2f expref: 275 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.005252:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbac78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c2f expref: 275 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.005260:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e2200, rc 0) 00000100:00100000:3.0:1746140888.005423:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32762:x1830960573815296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1519us (3793us total) trans 8589945098 rc 301/301 00000100:00100000:3.0:1746140888.005431:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10793 00000100:00100000:2.0:1746140888.009563:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.009593:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.009614:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573815424 00000100:00100000:2.0:1746140888.009622:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573815424 00000100:00100000:2.0:1746140888.009661:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573815552 00000100:00100000:2.0:1746140888.009663:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573815552 00000100:00100000:2.0:1746140888.009686:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17216 00000100:00100000:2.0:1746140888.009698:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573815424:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140888.009699:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17217 00000100:00100000:1.0:1746140888.009710:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1982:x1830960573815552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.009712:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.009719:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.009729:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c36 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.009730:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c3d expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.009752:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.009754:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.009761:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 24 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140888.009780:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576090368:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140888.009783:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 24 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.009794:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1c00, rc 0) 00000100:00100000:1.0:1746140888.009835:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1982:x1830960573815552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.009841:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17217 00000100:00100000:2.0:1746140888.009894:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.011178:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576090368:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140888.011200:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac9b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c36 expref: 17 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.011211:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbac9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c36 expref: 17 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.011235:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a4fa00, rc 0) 00000100:00100000:2.0:1746140888.012818:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573815424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3119us (3258us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140888.012828:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17216 00000100:00100000:0.0:1746140888.017252:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.017443:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573815808 00000100:00100000:2.0:1746140888.017453:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573815808 00002000:00100000:2.0:1746140888.017642:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8800a51cf800 x1830960573815808/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 504/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.017653:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cf800 with x1830960573815808 ext(0->1048575) 00002000:00010000:2.0:1746140888.017658:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cf800 00000100:00100000:2.0:1746140888.017686:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8799 00000100:00100000:2.0:1746140888.017693:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573815808:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.028394:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960573815808:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10689us (11138us total) trans 0 rc 765952/765952 00000100:00100000:3.0:1746140888.028407:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8799 00002000:00100000:3.0:1746140888.028422:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8800a51cf800 x1830960573815808/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 504/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.028438:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cf800 with x1830960573815808 ext(0->1048575) 00002000:00010000:3.0:1746140888.028445:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cf800 00000100:00100000:0.0:1746140888.042685:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.042839:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573815936 00000100:00100000:2.0:1746140888.042851:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573815936 00000100:00100000:2.0:1746140888.042903:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17218 00000100:00100000:2.0:1746140888.042911:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:32762:x1830960573815936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.042928:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.042947:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c44 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.042978:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 12 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.042986:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.042987:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.042990:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.043020:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 12 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.043032:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 12 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.043057:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576090496:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.043157:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.043341:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.043388:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573816192 00000100:00100000:3.0:1746140888.043392:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573816192 00000100:00100000:3.0:1746140888.043437:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10794 00000100:00100000:3.0:1746140888.043442:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:32765:x1830960573816192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.043455:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.043467:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2000/0x8156357b7fdbacb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c4b expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746140888.043575:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746140888.043622:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043632:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043642:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043654:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043660:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043665:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043770:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043780:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043786:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140888.043793:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140888.043867:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043874:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043879:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043884:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e2800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140888.043889:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043894:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043902:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140888.043905:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140888.043909:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043914:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2800/0x8156357b7fdbacc5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043971:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043981:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043986:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043990:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e2200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140888.043992:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.043997:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044004:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140888.044006:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140888.044008:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044013:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2200/0x8156357b7fdbacb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044020:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044024:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044028:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044032:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e3c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140888.044034:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044052:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044058:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388f00) 00010000:00010000:3.0:1746140888.044060:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140888.044062:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044066:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x8156357b7fdbacbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.044100:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2000/0x8156357b7fdbacb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c4b expref: 16 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.044104:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2000/0x8156357b7fdbacb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c4b expref: 16 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.044109:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e2000, rc 0) 00000100:00100000:3.0:1746140888.044143:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32765:x1830960573816192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 700us (801us total) trans 8589945099 rc 301/301 00000100:00100000:3.0:1746140888.044149:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10794 00000100:00100000:2.0:1746140888.044285:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576090496:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140888.044328:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.044339:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a4f800, rc 0) 00000100:00100000:2.0:1746140888.044365:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:32762:x1830960573815936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1456us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.044371:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17218 00000100:00100000:0.0:1746140888.045747:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.045795:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573816320 00000100:00100000:3.0:1746140888.045800:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573816320 00000100:00080000:0.0:1746140888.045838:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1746140888.045846:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->3555327) req@ffff8800a51ced80 x1830960573816320/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.045856:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ced80 with x1830960573816320 ext(3145728->3555327) 00010000:00010000:3.0:1746140888.045862:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 13 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.045878:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 13 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.045884:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51ced80 00000100:00100000:3.0:1746140888.045898:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1823 00000100:00100000:3.0:1746140888.045905:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573816320:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140888.046630:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.046664:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.046717:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573816448 00000100:00100000:2.0:1746140888.046719:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573816576 00000100:00100000:2.0:1746140888.046722:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573816576 00000100:00100000:1.0:1746140888.046722:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573816448 00000100:00100000:1.0:1746140888.046745:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17219 00000100:00100000:1.0:1746140888.046750:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1982:x1830960573816448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.046759:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.046771:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0000/0x8156357b7fdbacd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c52 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.046782:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17220 00000100:00100000:2.0:1746140888.046787:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573816576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.046791:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.046797:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbacda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c59 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.046812:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576090624:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140888.046814:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576090752:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140888.046932:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.046998:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.051015:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576090752:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140888.051064:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbacda lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c59 expref: 18 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.051079:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a4fa00/0x8156357b7fdbacda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c59 expref: 18 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.051089:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a4fa00, rc 0) 00000100:00100000:3.0:1746140888.051146:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573816576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4357us (4480us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140888.051154:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17220 00002000:00010000:1.0:1746140888.052897:0:20960:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime: 1746140887 -> 1746140888 00002000:00010000:1.0:1746140888.052902:0:20960:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime: 1746140887 -> 1746140888 00002000:00010000:1.0:1746140888.052904:0:20960:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime: 1746140887 -> 1746140888 00000100:00100000:1.0:1746140888.052923:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576090624:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140888.052949:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0000/0x8156357b7fdbacd3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c52 expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.052961:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a0000/0x8156357b7fdbacd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c52 expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.052984:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a0000, rc 0) 00000100:00100000:1.0:1746140888.053016:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573816448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6265us (6387us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140888.053023:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17219 00000100:00100000:0.0:1746140888.056381:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.056466:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573816704 00000100:00100000:1.0:1746140888.056475:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573816704 00000100:00100000:1.0:1746140888.056653:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17221 00000100:00100000:1.0:1746140888.056661:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32765:x1830960573816704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.056676:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.056694:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c60 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.056723:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 16 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.056735:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140888.056737:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140888.056740:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.056771:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 16 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.056781:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 16 pid: 8458 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.056791:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576090880:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.057392:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573816320:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11486us (11645us total) trans 21474841471 rc 0/0 00000100:00100000:3.0:1746140888.057402:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1823 00002000:00100000:3.0:1746140888.057412:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->3555327) req@ffff8800a51ced80 x1830960573816320/t21474841471(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.057420:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ced80 with x1830960573816320 ext(3145728->3555327) 00010000:00010000:3.0:1746140888.057428:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 17 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.057437:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 17 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.057443:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51ced80 00000100:00100000:1.0:1746140888.057503:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.058699:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576090880:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.058722:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.058735:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1200, rc 0) 00000100:00100000:1.0:1746140888.058763:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32765:x1830960573816704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2103us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.058769:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17221 00000100:00100000:0.0:1746140888.060469:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.060525:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.060545:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573816832 00000100:00100000:3.0:1746140888.060555:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573816832 00000100:00100000:1.0:1746140888.060594:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573816960 00000100:00100000:1.0:1746140888.060598:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573816960 00002000:00100000:3.0:1746140888.060601:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (663552->946175) req@ffff8800a51ce680 x1830960573816832/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.060610:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ce680 with x1830960573816832 ext(663552->946175) 00010000:00010000:3.0:1746140888.060618:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 17 pid: 8458 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.060619:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.060632:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 17 pid: 8458 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.060638:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51ce680 00000100:00100000:1.0:1746140888.060661:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8898 00000100:00100000:1.0:1746140888.060667:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573816960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140888.060678:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140888.060699:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.060709:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.060722:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1824 00000100:00100000:3.0:1746140888.060729:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960573816832:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746140888.060730:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a4ec00/0x8156357b7fdbac1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c13 expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.060756:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.060757:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.060764:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.060771:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.060799:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.060810:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576091008:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140888.060869:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.068367:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576091008:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140888.068392:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140888.068479:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573816960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7809us (7950us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140888.068490:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8898 00000100:00100000:0.0:1746140888.074271:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.074328:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.074354:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.074380:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573817216 00000100:00100000:0.0:1746140888.074385:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.074389:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573817216 00002000:00100000:2.0:1746140888.074432:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b1b3b80 x1830960573817216/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.074443:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b3b80 with x1830960573817216 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.074448:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b1b3b80 00000100:00100000:2.0:1746140888.075122:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573817472 00000100:00100000:2.0:1746140888.075126:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573817472 00002000:00100000:2.0:1746140888.075140:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012d3b5c00 x1830960573817472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.075146:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b5c00 with x1830960573817472 ext(3145728->4194303) 00002000:00010000:2.0:1746140888.075149:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b5c00 00000100:00100000:1.0:1746140888.075228:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573817856 00000100:00100000:3.0:1746140888.075229:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573817728 00000100:00100000:1.0:1746140888.075232:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573817856 00000100:00100000:3.0:1746140888.075234:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573817728 00002000:00100000:3.0:1746140888.075254:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012d3b6300 x1830960573817728/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.075254:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012d3b7b80 x1830960573817856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.075262:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b7b80 with x1830960573817856 ext(3145728->4194303) 00002000:00100000:3.0:1746140888.075263:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b6300 with x1830960573817728 ext(2097152->3145727) 00002000:00010000:1.0:1746140888.075266:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b7b80 00002000:00010000:3.0:1746140888.075267:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b6300 00000100:00100000:1.0:1746140888.075299:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8800 00000100:00100000:1.0:1746140888.075323:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573817216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140888.075330:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8801 00000100:00100000:2.0:1746140888.075338:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1982:x1830960573817472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.075380:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8802 00000100:00100000:1.0:1746140888.075385:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573817856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.075452:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8803 00000100:00100000:3.0:1746140888.075459:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573817728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140888.080083:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573816832:12345-192.168.204.16@tcp:4:cat.0 Request processed in 19340us (19608us total) trans 21474841472 rc 0/0 00000100:00100000:2.0:1746140888.080097:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1824 00002000:00100000:2.0:1746140888.080112:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (663552->946175) req@ffff8800a51ce680 x1830960573816832/t21474841472(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.080123:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ce680 with x1830960573816832 ext(663552->946175) 00010000:00010000:2.0:1746140888.080133:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 23 pid: 8458 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.080149:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 23 pid: 8458 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.080156:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51ce680 00000100:00100000:3.0:1746140888.084424:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.084550:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573818112 00000100:00100000:1.0:1746140888.084560:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573818112 00000100:00100000:1.0:1746140888.084619:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17222 00000100:00100000:1.0:1746140888.084627:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+10:32758:x1830960573818112:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140888.084644:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.085481:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c67 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.085511:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.085520:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 27 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.085526:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.085529:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.085532:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2174976->2965503] (req 2174976->2965503) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 11 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.085560:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 27 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.085570:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 27 pid: 8460 timeout: 967 lvb_type: 1 00000100:00100000:1.0:1746140888.085580:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576091136:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.085656:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 11 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.085664:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 11 pid: 8458 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.085672:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576091264:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.085690:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.086175:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573817728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10715us (11787us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.086186:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8803 00002000:00100000:3.0:1746140888.086196:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012d3b6300 x1830960573817728/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.086205:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b6300 with x1830960573817728 ext(2097152->3145727) 00010000:00010000:3.0:1746140888.086211:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 26 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:3.0:1746140888.086222:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 26 pid: 8460 timeout: 967 lvb_type: 1 00002000:00010000:3.0:1746140888.086228:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b6300 00000100:00100000:0.0:1746140888.087525:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.087639:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573818240 00000100:00100000:1.0:1746140888.087648:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573818240 00010000:00010000:1.0:1746140888.087679:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 23 pid: 8458 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.087713:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8899 00000100:00100000:1.0:1746140888.087721:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573818240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140888.087733:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140888.087756:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 23 pid: 8458 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.087766:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 23 pid: 8458 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.087787:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbac4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 663552->946175) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c21 expref: 23 pid: 8458 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.087805:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.087807:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.087814:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.087822:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.087851:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 14 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.087862:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576091392:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140888.087926:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54300 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.089811:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576091136:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.089825:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576091264:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.089851:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2174976->2965503] (req 2174976->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 11 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.089872:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a0000, rc 0) 00000100:00100000:1.0:1746140888.089913:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+11:32758:x1830960573818112:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5287us (5501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.089921:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17222 00000100:00100000:2.0:1746140888.090423:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573817216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15117us (16162us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140888.090432:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8800 00002000:00100000:2.0:1746140888.090440:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b1b3b80 x1830960573817216/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.090448:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b3b80 with x1830960573817216 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.090453:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b1b3b80 00000100:00100000:1.0:1746140888.091370:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576091392:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140888.091384:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140888.091418:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573818240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3698us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.091428:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8899 00000100:00100000:3.0:1746140888.095920:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.096023:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.096209:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573818624 00000100:00100000:2.0:1746140888.096219:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573818624 00002000:00100000:2.0:1746140888.096257:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f123b80 x1830960573818624/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.096274:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f123b80 with x1830960573818624 ext(0->1048575) 00002000:00010000:2.0:1746140888.096279:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f123b80 00000100:00100000:2.0:1746140888.096299:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8804 00000100:00100000:2.0:1746140888.096326:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573818624:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140888.096410:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573818368 00000100:00100000:1.0:1746140888.096414:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573818368 00010000:00010000:1.0:1746140888.096437:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 11 pid: 8458 timeout: 967 lvb_type: 0 00000100:00100000:0.0:1746140888.096451:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1982:x1830960573817856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21063us (22095us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140888.096458:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8802 00000100:00100000:1.0:1746140888.096464:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8900 00002000:00100000:0.0:1746140888.096464:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012d3b7b80 x1830960573817856/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140888.096470:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573818368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746140888.096472:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b7b80 with x1830960573817856 ext(3145728->4194303) 00010000:00010000:0.0:1746140888.096478:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 24 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:1.0:1746140888.096479:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140888.096488:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 24 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:1.0:1746140888.096495:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 11 pid: 8458 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.096496:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b7b80 00010000:00010000:1.0:1746140888.096505:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 11 pid: 8458 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.096526:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d600/0x8156357b7fdbac24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c0c expref: 11 pid: 8458 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.096551:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140888.096580:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573818368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 110us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.096586:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8900 00000100:00100000:0.0:1746140888.098093:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.098346:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1982:x1830960573817472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23007us (24016us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140888.098354:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8801 00002000:00100000:2.0:1746140888.098363:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012d3b5c00 x1830960573817472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.098371:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b5c00 with x1830960573817472 ext(3145728->4194303) 00002000:00010000:2.0:1746140888.098376:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b5c00 00000100:00100000:1.0:1746140888.098462:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573818752 00000100:00100000:1.0:1746140888.098469:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573818752 00000100:00100000:1.0:1746140888.098509:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17223 00000100:00100000:1.0:1746140888.098516:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:32762:x1830960573818752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.098528:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.098548:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c6e expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.098569:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.098575:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2174976->2965503] (req 2174976->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 9 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.098581:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140888.098585:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.098618:0:20960:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2174976->2965503] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 9 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.098628:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.098643:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a0a00, rc 0) 00000100:00100000:1.0:1746140888.098659:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:32762:x1830960573818752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 145us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.098664:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17223 00000100:00100000:1.0:1746140888.104577:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.104639:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573818880 00000100:00100000:2.0:1746140888.104648:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573818880 00010000:00010000:2.0:1746140888.104679:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 25 pid: 8460 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140888.104719:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8901 00000100:00100000:2.0:1746140888.104726:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573818880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.104739:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.104762:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 25 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.104773:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 25 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.104796:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a1c00/0x8156357b7fdbaca2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c3d expref: 25 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.104815:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.104817:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.104824:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 9 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.104832:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 9 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.104866:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 9 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.104876:0:8473:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 9 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.104886:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576091648:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.104956:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.106879:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576091648:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.106899:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.106909:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573818624:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10602us (10884us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.106917:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1982:x1830960573818880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2192us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.106920:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8804 00000100:00100000:3.0:1746140888.106924:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8901 00002000:00100000:2.0:1746140888.106930:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f123b80 x1830960573818624/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.106939:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f123b80 with x1830960573818624 ext(0->1048575) 00002000:00010000:2.0:1746140888.106945:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f123b80 00000100:00100000:0.0:1746140888.108518:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.108539:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.108561:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573819392 00000100:00100000:0.0:1746140888.108568:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573819392 00000100:00100000:3.0:1746140888.108606:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573819136 00000100:00100000:3.0:1746140888.108611:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573819136 00000100:00100000:0.0:1746140888.108613:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10795 00000100:00100000:0.0:1746140888.108620:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:32767:x1830960573819392:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140888.108639:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746140888.108641:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2174976->2179071) req@ffff88012d3b5f80 x1830960573819136/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.108649:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b5f80 with x1830960573819136 ext(2174976->2179071) 00010000:00010000:3.0:1746140888.108657:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.108657:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94800/0x8156357b7fdbacf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c75 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.108670:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.108677:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b5f80 00000100:00100000:3.0:1746140888.108689:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1825 00000100:00100000:3.0:1746140888.108695:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573819136:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:0.0:1746140888.108764:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.108776:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.108786:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.108798:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.108803:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.108808:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140888.108846:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573819136:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 151us (335us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140888.108852:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1825 00002000:00100000:3.0:1746140888.108857:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2174976->2179071) req@ffff88012d3b5f80 x1830960573819136/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.108865:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b5f80 with x1830960573819136 ext(2174976->2179071) 00010000:00010000:3.0:1746140888.108869:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.108878:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.108889:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b5f80 00010000:00010000:0.0:1746140888.108909:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.108917:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.108923:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140888.108931:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140888.109008:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109014:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109020:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109026:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e2e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140888.109030:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109035:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109055:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140888.109057:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746140888.109060:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109065:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x8156357b7fdbad0b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109090:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109099:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109103:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109107:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b94200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140888.109109:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109114:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109120:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140888.109122:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140888.109124:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109128:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94200/0x8156357b7fdbacfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109134:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109138:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109143:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109146:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b94a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140888.109148:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109155:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109160:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88013105d400) 00010000:00010000:0.0:1746140888.109162:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140888.109163:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109168:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94a00/0x8156357b7fdbad04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.109206:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94800/0x8156357b7fdbacf6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c75 expref: 276 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.109212:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b94800/0x8156357b7fdbacf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c75 expref: 276 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.109218:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b94800, rc 0) 00000100:00100000:0.0:1746140888.109248:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32767:x1830960573819392:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 629us (709us total) trans 8589945100 rc 301/301 00000100:00100000:0.0:1746140888.109254:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10795 00000100:00100000:0.0:1746140888.116568:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.116675:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573819520 00000100:00100000:1.0:1746140888.116685:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573819520 00000100:00100000:1.0:1746140888.116958:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17224 00000100:00100000:1.0:1746140888.116968:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32765:x1830960573819520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.116985:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.117002:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c7c expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.117026:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.117028:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.117035:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.117059:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.117069:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54a1a00, rc 0) 00000100:00100000:1.0:1746140888.117117:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32765:x1830960573819520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 152us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.117123:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17224 00000100:00100000:0.0:1746140888.120805:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.120917:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573819776 00000100:00100000:3.0:1746140888.120927:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573819776 00002000:00100000:3.0:1746140888.120970:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2961408->2965503) req@ffff88012d3b4a80 x1830960573819776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.120980:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4a80 with x1830960573819776 ext(2961408->2965503) 00010000:00010000:3.0:1746140888.120994:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.121007:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.121014:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b4a80 00000100:00100000:3.0:1746140888.121053:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1826 00000100:00100000:3.0:1746140888.121060:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573819776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.121238:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573819776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 177us (442us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140888.121244:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1826 00002000:00100000:3.0:1746140888.121250:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2961408->2965503) req@ffff88012d3b4a80 x1830960573819776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.121257:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b4a80 with x1830960573819776 ext(2961408->2965503) 00010000:00010000:3.0:1746140888.121261:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.121275:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.121282:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b4a80 00000100:00100000:0.0:1746140888.123162:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.123354:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573820032 00000100:00100000:3.0:1746140888.123363:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573820032 00002000:00100000:3.0:1746140888.123400:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880093135880 x1830960573820032/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.123408:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135880 with x1830960573820032 ext(2097152->3145727) 00002000:00010000:3.0:1746140888.123413:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135880 00000100:00100000:3.0:1746140888.123444:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8805 00000100:00100000:3.0:1746140888.123450:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573820032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.124076:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.124139:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573820288 00000100:00100000:2.0:1746140888.124143:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573820288 00002000:00100000:2.0:1746140888.124165:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2174975) req@ffff880093135f80 x1830960573820288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.124172:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135f80 with x1830960573820288 ext(2097152->2174975) 00010000:00010000:2.0:1746140888.124179:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.124204:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.124211:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093135f80 00000100:00100000:2.0:1746140888.124234:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1827 00000100:00100000:2.0:1746140888.124240:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573820288:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.126417:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.126453:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.126715:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573820288:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2473us (2637us total) trans 0 rc 77824/77824 00000100:00100000:2.0:1746140888.126724:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1827 00002000:00100000:2.0:1746140888.126733:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2174975) req@ffff880093135f80 x1830960573820288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 77824/77824 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.126741:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135f80 with x1830960573820288 ext(2097152->2174975) 00010000:00010000:2.0:1746140888.126749:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.126767:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.126772:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093135f80 00000100:00100000:2.0:1746140888.126793:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573820544 00000100:00100000:2.0:1746140888.126798:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573820544 00002000:00100000:2.0:1746140888.126819:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2174976->2965503) req@ffff880093136300 x1830960573820544/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.126826:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136300 with x1830960573820544 ext(2174976->2965503) 00010000:00010000:2.0:1746140888.126829:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.126836:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 10 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.126842:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093136300 00000100:00100000:3.0:1746140888.126866:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573820800 00000100:00100000:3.0:1746140888.126871:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573820800 00000100:00100000:2.0:1746140888.126871:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1828 00000100:00100000:2.0:1746140888.126877:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573820544:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140888.126894:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4743 00000100:00100000:3.0:1746140888.126900:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:32758:x1830960573820800:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140888.127065:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32758:x1830960573820800:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 164us (657us total) trans 8589945101 rc 0/0 00000100:00100000:3.0:1746140888.127071:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4743 00000100:00100000:3.0:1746140888.138144:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573820032:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14681us (14977us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.138158:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8805 00002000:00100000:3.0:1746140888.138170:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880093135880 x1830960573820032/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.138181:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135880 with x1830960573820032 ext(2097152->3145727) 00002000:00010000:3.0:1746140888.138187:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135880 00000100:00100000:0.0:1746140888.144554:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.145277:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573820928 00000100:00100000:3.0:1746140888.145288:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573820928 00000100:00100000:3.0:1746140888.145359:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17225 00000100:00100000:3.0:1746140888.145367:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+12:32765:x1830960573820928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.145381:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.145397:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c83 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.145423:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.145428:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 13 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.145440:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 13 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.145449:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c200, rc 0) 00000100:00100000:3.0:1746140888.145505:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+13:32765:x1830960573820928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 139us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.145511:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17225 00000100:00100000:2.0:1746140888.147189:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573820544:12345-192.168.204.16@tcp:4:cat.0 Request processed in 20309us (20731us total) trans 17179874181 rc 0/0 00000100:00100000:2.0:1746140888.147199:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1828 00002000:00100000:2.0:1746140888.147210:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2174976->2965503) req@ffff880093136300 x1830960573820544/t17179874181(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.147220:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136300 with x1830960573820544 ext(2174976->2965503) 00010000:00010000:2.0:1746140888.147228:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 13 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.147242:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 13 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.147248:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093136300 00000100:00100000:0.0:1746140888.149551:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.149658:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573821056 00000100:00100000:3.0:1746140888.149667:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573821056 00010000:00010000:3.0:1746140888.149703:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 13 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.150713:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8902 00000100:00100000:3.0:1746140888.150723:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573821056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.150738:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.150763:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 13 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.150776:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 13 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.150799:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0000/0x8156357b7fdbace8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2174976->2965503) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c67 expref: 13 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.150823:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.150825:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.150833:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.150841:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.150849:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.150850:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.150853:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 12 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.150860:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 12 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.150893:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 12 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.151106:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576091776:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.151915:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.151927:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576091904:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.151951:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b257840 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.156066:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576091776:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.158789:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576091904:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.158823:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.158930:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573821056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8207us (9385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.158941:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8902 00000100:00100000:0.0:1746140888.162712:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.162758:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.162807:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.163130:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573821312 00000100:00100000:1.0:1746140888.163140:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573821312 00002000:00100000:1.0:1746140888.163183:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880130d29880 x1830960573821312/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.163194:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29880 with x1830960573821312 ext(2097152->3145727) 00002000:00010000:1.0:1746140888.163199:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d29880 00000100:00100000:1.0:1746140888.163216:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573821696 00000100:00100000:1.0:1746140888.163218:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573821696 00002000:00100000:1.0:1746140888.163229:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a0309050 x1830960573821696/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.163237:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0309050 with x1830960573821696 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.163240:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0309050 00000100:00100000:1.0:1746140888.163249:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573821952 00000100:00100000:1.0:1746140888.163251:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573821952 00002000:00100000:1.0:1746140888.163260:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880130d2ad80 x1830960573821952/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.163266:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2ad80 with x1830960573821952 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.163269:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d2ad80 00000100:00100000:1.0:1746140888.163281:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8806 00000100:00100000:1.0:1746140888.163287:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573821312:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.164213:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8807 00000100:00100000:0.0:1746140888.164229:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0309050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573821696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.164586:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8808 00000100:00100000:1.0:1746140888.164593:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573821952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.165874:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.166009:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573821824 00000100:00100000:3.0:1746140888.166016:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573821824 00002000:00100000:3.0:1746140888.167323:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8801359b0380 x1830960573821824/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.167334:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0380 with x1830960573821824 ext(2097152->3145727) 00002000:00010000:3.0:1746140888.167340:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b0380 00000100:00100000:3.0:1746140888.167370:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8809 00000100:00100000:3.0:1746140888.167379:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573821824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.167698:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.167930:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573822336 00000100:00100000:2.0:1746140888.167936:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573822336 00002000:00100000:2.0:1746140888.167960:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880094452680 x1830960573822336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.167967:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094452680 with x1830960573822336 ext(3145728->4194303) 00002000:00010000:2.0:1746140888.167971:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094452680 00000100:00100000:2.0:1746140888.167990:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8810 00000100:00100000:2.0:1746140888.167995:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573822336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.179946:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573821312:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16646us (17232us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.179961:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8806 00002000:00100000:1.0:1746140888.179972:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880130d29880 x1830960573821312/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.179982:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29880 with x1830960573821312 ext(2097152->3145727) 00002000:00010000:1.0:1746140888.179988:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d29880 00000100:00100000:1.0:1746140888.180890:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573821952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16295us (18080us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.180898:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8808 00002000:00100000:1.0:1746140888.180903:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880130d2ad80 x1830960573821952/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.180910:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2ad80 with x1830960573821952 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.180914:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d2ad80 00000100:00100000:1.0:1746140888.187217:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0309050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573821696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22981us (24448us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.187230:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8807 00002000:00100000:1.0:1746140888.187242:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a0309050 x1830960573821696/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.187251:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0309050 with x1830960573821696 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.187258:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0309050 00000100:00100000:2.0:1746140888.187435:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573822336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19433us (19731us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140888.187445:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8810 00002000:00100000:2.0:1746140888.187455:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880094452680 x1830960573822336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.187465:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094452680 with x1830960573822336 ext(3145728->4194303) 00002000:00010000:2.0:1746140888.187471:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094452680 00000100:00100000:3.0:1746140888.190432:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573821824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23042us (24546us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.190445:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8809 00002000:00100000:3.0:1746140888.190456:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8801359b0380 x1830960573821824/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.190466:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0380 with x1830960573821824 ext(2097152->3145727) 00002000:00010000:3.0:1746140888.190472:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b0380 00000100:00100000:0.0:1746140888.194502:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.194916:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573822464 00000100:00100000:3.0:1746140888.194932:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573822464 00000100:00100000:3.0:1746140888.195003:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17226 00000100:00100000:3.0:1746140888.195011:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960573822464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.195030:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.195056:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c8a expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.195077:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.195079:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.195086:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 19 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.195101:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 19 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.195111:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c000, rc 0) 00000100:00100000:3.0:1746140888.195167:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573822464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 157us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.195176:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17226 00000100:00100000:0.0:1746140888.196791:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.196861:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573822592 00000100:00100000:3.0:1746140888.196869:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573822592 00000100:00100000:3.0:1746140888.196913:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17227 00000100:00100000:3.0:1746140888.196920:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:32767:x1830960573822592:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140888.196932:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.196944:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c91 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.196967:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.196974:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 20 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.196980:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.196981:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.196984:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [450560->1048575] (req 450560->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 20 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.197009:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 20 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.197019:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 20 pid: 24958 timeout: 967 lvb_type: 1 00000100:00100000:3.0:1746140888.197033:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576092032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.197156:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.197163:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 15 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.197170:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576092160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.197189:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b257840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.202419:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.202528:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573822848 00000100:00100000:3.0:1746140888.202543:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573822848 00002000:00100000:3.0:1746140888.202601:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094452300 x1830960573822848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.202611:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094452300 with x1830960573822848 ext(4194304->4886527) 00002000:00010000:3.0:1746140888.202617:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094452300 00000100:00100000:0.0:1746140888.202791:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.202846:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576092032:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.202857:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576092160:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140888.202886:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [450560->1048575] (req 450560->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 20 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.202902:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7dc00, rc 0) 00000100:00100000:3.0:1746140888.203368:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573823104 00000100:00100000:3.0:1746140888.203374:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573823104 00002000:00100000:3.0:1746140888.203397:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094450e00 x1830960573823104/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.203404:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094450e00 with x1830960573823104 ext(4194304->4886527) 00002000:00010000:3.0:1746140888.203408:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094450e00 00000100:00100000:2.0:1746140888.203457:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:32767:x1830960573822592:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6535us (6670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.203466:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17227 00000100:00100000:3.0:1746140888.203603:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8811 00000100:00100000:3.0:1746140888.203613:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573822848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.205016:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8812 00000100:00100000:0.0:1746140888.205026:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960573823104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.206512:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.206585:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.206691:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573823232 00000100:00100000:3.0:1746140888.206699:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573823232 00010000:00010000:3.0:1746140888.206731:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 22 pid: 24958 timeout: 967 lvb_type: 1 00000100:00100000:3.0:1746140888.206783:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573823360 00000100:00100000:3.0:1746140888.206787:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573823360 00010000:00010000:3.0:1746140888.206801:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 18 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.206820:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8903 00000100:00100000:3.0:1746140888.206826:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573823232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.206836:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140888.206846:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8904 00010000:00010000:3.0:1746140888.206855:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 22 pid: 24958 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140888.206855:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1983:x1830960573823360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.206863:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.206866:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 22 pid: 24958 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.206874:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 18 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.206913:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 18 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.206926:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1200/0x8156357b7fdbace1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c60 expref: 18 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.206943:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.206945:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.206951:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.206958:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.206992:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 22 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.207002:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576092288:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.207069:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00010000:00010000:3.0:1746140888.208193:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c000/0x8156357b7fdbad27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c8a expref: 22 pid: 24958 timeout: 967 lvb_type: 1 00010000:00010000:3.0:1746140888.208217:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.208362:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960573823232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1531us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.208370:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8903 00000100:00100000:3.0:1746140888.213279:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573822848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9657us (10859us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140888.213292:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8811 00002000:00100000:3.0:1746140888.213339:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094452300 x1830960573822848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.213352:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094452300 with x1830960573822848 ext(4194304->4886527) 00002000:00010000:3.0:1746140888.213358:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094452300 00000100:00100000:2.0:1746140888.214596:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960573823104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9564us (11796us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140888.214607:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8812 00002000:00100000:2.0:1746140888.214618:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094450e00 x1830960573823104/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.214628:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094450e00 with x1830960573823104 ext(4194304->4886527) 00002000:00010000:2.0:1746140888.214633:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094450e00 00000100:00100000:3.0:1746140888.214735:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576092288:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.214759:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.214793:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573823360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7939us (8209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.214802:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8904 00000100:00100000:0.0:1746140888.215497:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.215574:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573823616 00000100:00100000:2.0:1746140888.215581:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573823616 00002000:00100000:2.0:1746140888.215617:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (450560->454655) req@ffff880094451180 x1830960573823616/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.215624:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094451180 with x1830960573823616 ext(450560->454655) 00002000:00010000:2.0:1746140888.215627:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094451180 00000100:00100000:2.0:1746140888.215651:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8813 00000100:00100000:2.0:1746140888.215658:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960573823616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140888.216249:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960573823616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 590us (755us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140888.216256:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8813 00002000:00100000:2.0:1746140888.216262:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (450560->454655) req@ffff880094451180 x1830960573823616/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.216268:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094451180 with x1830960573823616 ext(450560->454655) 00002000:00010000:2.0:1746140888.216271:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094451180 00000100:00100000:0.0:1746140888.218682:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.219789:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573823744 00000100:00100000:2.0:1746140888.219798:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573823744 00000100:00100000:2.0:1746140888.219846:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17228 00000100:00100000:2.0:1746140888.219852:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573823744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.220519:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.220537:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbad35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c98 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.220587:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576092416:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140888.220664:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.224610:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.224750:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576092416:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140888.224780:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbad35 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c98 expref: 16 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.224794:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbad35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c98 expref: 16 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.224817:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e5b4a00, rc 0) 00000100:00100000:1.0:1746140888.224998:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573824000 00000100:00100000:1.0:1746140888.225004:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573824000 00000100:00100000:1.0:1746140888.225058:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4744 00000100:00100000:1.0:1746140888.225065:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:32762:x1830960573824000:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140888.225245:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573823744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5393us (6570us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140888.225252:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17228 00000100:00100000:1.0:1746140888.225439:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32762:x1830960573824000:12345-192.168.204.16@tcp:35:cat.0 Request processed in 375us (837us total) trans 8589945102 rc 0/0 00000100:00100000:1.0:1746140888.225445:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4744 00000100:00100000:2.0:1746140888.227806:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.228243:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.228413:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573824128 00000100:00100000:1.0:1746140888.228421:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573824128 00000100:00100000:1.0:1746140888.228454:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573824256 00000100:00100000:1.0:1746140888.228456:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573824256 00000100:00100000:1.0:1746140888.228482:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17229 00000100:00100000:1.0:1746140888.228489:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:32767:x1830960573824128:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140888.228506:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.228521:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1c9f expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.228548:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 11 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.228555:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 25 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.228561:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.228566:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.228568:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.228570:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.228599:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.228609:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 9 pid: 4186 timeout: 967 lvb_type: 1 00000100:00100000:1.0:1746140888.228619:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576092544:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.228694:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 25 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.228702:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 25 pid: 8458 timeout: 967 lvb_type: 1 00000100:00100000:3.0:1746140888.228707:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17230 00000100:00100000:1.0:1746140888.228709:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576092672:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.228718:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573824256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.228725:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.228733:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 11 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.228735:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7d600/0x8156357b7fdbad43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ca6 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.228741:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 11 pid: 4784 timeout: 967 lvb_type: 1 00000100:00100000:1.0:1746140888.228748:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576092800:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.228764:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576092928:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140888.228764:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f54f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.228789:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b257840 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.231671:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576092544:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.231684:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576092672:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.231692:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576092800:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.231720:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.231735:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e595600, rc 0) 00000100:00100000:1.0:1746140888.232113:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:32767:x1830960573824128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3622us (4322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.232121:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17229 00000100:00100000:0.0:1746140888.233244:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.233384:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576092928:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140888.233413:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7d600/0x8156357b7fdbad43 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ca6 expref: 16 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140888.233438:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.233465:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140888.233501:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7d600/0x8156357b7fdbad43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ca6 expref: 16 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140888.233654:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573824384 00000100:00100000:2.0:1746140888.233661:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573824384 00010000:00010000:2.0:1746140888.233688:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 10 pid: 4186 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140888.233708:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573824512 00000100:00100000:2.0:1746140888.233710:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573824512 00010000:00010000:2.0:1746140888.233719:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 25 pid: 8458 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140888.233730:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573824640 00000100:00100000:2.0:1746140888.233732:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573824640 00010000:00010000:2.0:1746140888.233739:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 12 pid: 4784 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140888.233750:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8905 00000100:00100000:2.0:1746140888.233756:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573824384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.233767:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.233776:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7d600, rc 0) 00010000:00010000:2.0:1746140888.233780:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 10 pid: 4186 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.233789:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 10 pid: 4186 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.233804:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fce7c00/0x8156357b7fdbaab1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b48 expref: 10 pid: 4186 timeout: 967 lvb_type: 1 00000100:00100000:3.0:1746140888.233807:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573824256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5093us (5564us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140888.233815:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17230 00010000:00010000:2.0:1746140888.233822:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.233838:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573824384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.233839:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8906 00000100:00100000:3.0:1746140888.233844:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573824512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140888.233844:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8905 00010000:00010000:3.0:1746140888.233851:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140888.233856:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8907 00010000:00010000:3.0:1746140888.233861:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 25 pid: 8458 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140888.233861:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960573824640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.233867:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.233869:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 25 pid: 8458 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.233876:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 12 pid: 4784 timeout: 967 lvb_type: 1 00010000:00010000:3.0:1746140888.233880:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013547ca00/0x8156357b7fdbab60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ba3 expref: 25 pid: 8458 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.233886:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 12 pid: 4784 timeout: 967 lvb_type: 1 00010000:00010000:3.0:1746140888.233895:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.233910:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573824512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.233915:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8906 00010000:00010000:2.0:1746140888.234338:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094959800/0x8156357b7fdbaa6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b02 expref: 12 pid: 4784 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.234349:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.234351:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.234357:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.234364:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.234389:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.234401:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576093056:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.234805:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.236512:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.236667:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576093056:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.236680:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573824896 00010000:00010000:2.0:1746140888.236684:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.236688:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573824896 00002000:00100000:3.0:1746140888.236729:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a7:0x0] (1052672->1056767) req@ffff88012d080a80 x1830960573824896/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140888.236730:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1982:x1830960573824640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2866us (3262us total) trans 0 rc 0/0 00002000:00100000:3.0:1746140888.236738:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080a80 with x1830960573824896 ext(1052672->1056767) 00000100:00100000:2.0:1746140888.236738:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8907 00002000:00010000:3.0:1746140888.236743:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d080a80 00000100:00100000:3.0:1746140888.236761:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8814 00000100:00100000:3.0:1746140888.236768:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573824896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.237273:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573824896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 504us (768us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140888.237281:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8814 00002000:00100000:3.0:1746140888.237287:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a7:0x0] (1052672->1056767) req@ffff88012d080a80 x1830960573824896/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.237294:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080a80 with x1830960573824896 ext(1052672->1056767) 00002000:00010000:3.0:1746140888.237297:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d080a80 00000100:00100000:0.0:1746140888.238012:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.238080:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573825152 00000100:00100000:1.0:1746140888.238084:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573825152 00000100:00100000:1.0:1746140888.238120:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4745 00000100:00100000:1.0:1746140888.238126:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:32765:x1830960573825152:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140888.238762:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:32765:x1830960573825152:12345-192.168.204.16@tcp:35:cat.0 Request processed in 635us (749us total) trans 8589945103 rc 0/0 00000100:00100000:1.0:1746140888.238768:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4745 00000100:00100000:2.0:1746140888.239170:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.239227:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573825408 00000100:00100000:1.0:1746140888.239231:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573825408 00000100:00100000:1.0:1746140888.239262:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4746 00000100:00100000:1.0:1746140888.239269:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:32767:x1830960573825408:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140888.239383:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:32767:x1830960573825408:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 114us (213us total) trans 8589945104 rc 0/0 00000100:00100000:1.0:1746140888.239389:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4746 00000100:00100000:0.0:1746140888.367007:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.367080:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.367152:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573825920 00000100:00100000:1.0:1746140888.367163:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573825920 00000100:00100000:2.0:1746140888.367205:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573825664 00000100:00100000:1.0:1746140888.367209:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10796 00000100:00100000:2.0:1746140888.367216:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573825664 00000100:00100000:1.0:1746140888.367221:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:307:x1830960573825920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140888.367244:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.367262:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594000/0x8156357b7fdbad4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cb4 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.367266:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10797 00000100:00100000:2.0:1746140888.367273:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:305:x1830960573825664:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140888.367294:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.367343:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbad51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cad expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.367437:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367450:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367461:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367472:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367480:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367485:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367569:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367576:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367581:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140888.367588:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140888.367593:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367605:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367613:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367622:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367627:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367632:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.367649:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367654:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367659:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367664:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e5b5000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140888.367667:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367673:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367683:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140888.367686:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140888.367690:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367695:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5000/0x8156357b7fdbad66 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140888.367707:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367714:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367718:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.367719:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367723:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367727:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140888.367728:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140888.367731:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e5b4200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140888.367733:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367737:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367742:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140888.367744:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140888.367746:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367750:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4200/0x8156357b7fdbad58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367756:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367760:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367765:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367768:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e5b5c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140888.367770:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367774:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367778:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f300) 00010000:00010000:2.0:1746140888.367779:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140888.367781:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140888.367784:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5c00/0x8156357b7fdbad5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140888.367787:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367792:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367797:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367801:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e594c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.367804:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.367807:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbad51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cad expref: 19 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.367808:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.367813:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbad51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cad expref: 19 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.367815:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140888.367818:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e5b5800, rc 0) 00010000:00010000:1.0:1746140888.367818:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140888.367821:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367825:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbad82 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367856:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367860:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140888.367862:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:305:x1830960573825664:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 591us (782us total) trans 8589945105 rc 301/301 00010000:00010000:1.0:1746140888.367864:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140888.367868:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10797 00010000:00010000:1.0:1746140888.367872:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e595800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.367874:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367878:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367883:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140888.367885:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.367887:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367892:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595800/0x8156357b7fdbad6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367898:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367902:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367905:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367909:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e595c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.367912:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367916:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367922:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f300) 00010000:00010000:1.0:1746140888.367924:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.367926:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367930:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595c00/0x8156357b7fdbad7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.367970:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594000/0x8156357b7fdbad4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cb4 expref: 279 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.367977:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594000/0x8156357b7fdbad4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cb4 expref: 279 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.367985:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e594000, rc 0) 00000100:00100000:1.0:1746140888.369623:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:307:x1830960573825920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2397us (2620us total) trans 8589945106 rc 301/301 00000100:00100000:1.0:1746140888.369633:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10796 00000100:00100000:0.0:1746140888.407237:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.407516:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573826048 00000100:00100000:3.0:1746140888.407528:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573826048 00000100:00100000:3.0:1746140888.407610:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17231 00000100:00100000:3.0:1746140888.407620:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:307:x1830960573826048:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140888.407643:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.407667:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cbb expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.407704:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.407713:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 10 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.407719:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.407722:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.407725:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3444736->3870719] (req 3444736->3870719) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 25 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.407770:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 10 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.407785:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 10 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.407799:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576093184:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.408504:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.408515:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.408526:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576093312:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.408559:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.414599:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576093184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.414613:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576093312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.414643:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3444736->3870719] (req 3444736->3870719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 25 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.414659:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7d600, rc 0) 00000100:00100000:3.0:1746140888.414710:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:307:x1830960573826048:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7092us (7485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.414722:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17231 00000100:00100000:0.0:1746140888.415902:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.415973:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573826176 00000100:00100000:2.0:1746140888.415981:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573826176 00010000:00010000:2.0:1746140888.416014:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 11 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.416052:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8908 00000100:00100000:2.0:1746140888.416058:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573826176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.416071:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.416095:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 11 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.416106:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 11 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.416128:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbad20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c83 expref: 11 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:0.0:1746140888.416426:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.416440:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573826304 00000100:00100000:0.0:1746140888.416444:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573826304 00010000:00010000:0.0:1746140888.416457:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:0.0:1746140888.416484:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8909 00000100:00100000:0.0:1746140888.416490:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1983:x1830960573826304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140888.416496:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140888.416505:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.416513:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.416525:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a0a00/0x8156357b7fdbacef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c6e expref: 25 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.416539:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140888.416540:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140888.416547:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 24 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.416555:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 24 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.416584:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 24 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140888.416595:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576093440:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140888.416650:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119780 going to sleep for 11 seconds 00010000:00010000:2.0:1746140888.416787:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.416809:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573826176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 750us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.416814:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8908 00000100:00100000:0.0:1746140888.421896:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.421982:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576093440:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.422003:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.422054:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1983:x1830960573826304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5563us (5627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.422065:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8909 00000100:00100000:3.0:1746140888.422148:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573826560 00000100:00100000:3.0:1746140888.422155:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573826560 00002000:00100000:3.0:1746140888.422189:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3444736->3448831) req@ffff88012d083100 x1830960573826560/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.422198:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d083100 with x1830960573826560 ext(3444736->3448831) 00002000:00010000:3.0:1746140888.422202:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d083100 00000100:00100000:3.0:1746140888.422216:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8815 00000100:00100000:3.0:1746140888.422222:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573826560:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140888.423267:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573826560:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1042us (1379us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140888.423274:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8815 00002000:00100000:3.0:1746140888.423280:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3444736->3448831) req@ffff88012d083100 x1830960573826560/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.423287:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d083100 with x1830960573826560 ext(3444736->3448831) 00002000:00010000:3.0:1746140888.423291:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d083100 00000100:00100000:0.0:1746140888.431129:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.431240:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573826816 00000100:00100000:3.0:1746140888.431250:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573826816 00002000:00100000:3.0:1746140888.431295:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3866624->3870719) req@ffff88012d082680 x1830960573826816/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.431336:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082680 with x1830960573826816 ext(3866624->3870719) 00002000:00010000:3.0:1746140888.431341:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d082680 00000100:00100000:3.0:1746140888.431523:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8816 00000100:00100000:3.0:1746140888.431531:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573826816:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140888.432096:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573826816:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 563us (976us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140888.432103:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8816 00002000:00100000:3.0:1746140888.432109:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3866624->3870719) req@ffff88012d082680 x1830960573826816/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.432117:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082680 with x1830960573826816 ext(3866624->3870719) 00002000:00010000:3.0:1746140888.432120:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d082680 00000100:00100000:0.0:1746140888.434712:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.435400:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573827072 00000100:00100000:3.0:1746140888.435409:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573827072 00000100:00100000:3.0:1746140888.435461:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4747 00000100:00100000:3.0:1746140888.435469:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:307:x1830960573827072:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140888.435868:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:307:x1830960573827072:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 399us (1163us total) trans 8589945107 rc 0/0 00000100:00100000:3.0:1746140888.435875:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4747 00000100:00100000:0.0:1746140888.448118:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.448355:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573827328 00000100:00100000:1.0:1746140888.448365:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573827328 00000100:00100000:1.0:1746140888.448423:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10798 00000100:00100000:1.0:1746140888.448430:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:311:x1830960573827328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.448453:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.448472:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594800/0x8156357b7fdbad97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cc2 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.448588:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448603:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448613:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448627:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448632:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448637:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448744:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448752:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448758:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140888.448765:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140888.448842:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448847:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448853:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448857:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e594e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.448861:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448866:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448877:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140888.448879:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140888.448884:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448888:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594e00/0x8156357b7fdbadac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448963:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448967:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448971:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448974:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e595000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.448976:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448980:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448985:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140888.448986:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.448992:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.448996:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595000/0x8156357b7fdbad9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.449014:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.449019:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.449023:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.449027:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e595200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.449029:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.449047:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.449052:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4dd00) 00010000:00010000:1.0:1746140888.449054:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.449056:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.449061:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595200/0x8156357b7fdbada5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.449102:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594800/0x8156357b7fdbad97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc2 expref: 281 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.449109:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594800/0x8156357b7fdbad97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc2 expref: 281 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.449116:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e594800, rc 0) 00000100:00100000:1.0:1746140888.449582:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:311:x1830960573827328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1151us (1475us total) trans 8589945108 rc 301/301 00000100:00100000:1.0:1746140888.449592:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10798 00000100:00100000:1.0:1746140888.453157:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.453219:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573827456 00000100:00100000:3.0:1746140888.453228:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573827456 00000100:00100000:3.0:1746140888.453267:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17232 00000100:00100000:3.0:1746140888.453273:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+15:305:x1830960573827456:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140888.453290:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.453333:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cc9 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.453369:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.453794:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.453801:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.453803:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.453807:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2936832->3145727] (req 2936832->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.453845:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.453860:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.453873:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576093568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.453988:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.453997:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 18 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.454005:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576093696:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.454043:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.454098:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.454167:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.454290:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573827840 00000100:00100000:2.0:1746140888.454294:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573827840 00002000:00100000:2.0:1746140888.454349:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1056768->2097151) req@ffff88012d082a00 x1830960573827840/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.454359:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082a00 with x1830960573827840 ext(1056768->2097151) 00002000:00010000:2.0:1746140888.454363:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d082a00 00000100:00100000:2.0:1746140888.454380:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573827968 00000100:00100000:2.0:1746140888.454382:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573827968 00002000:00100000:2.0:1746140888.454393:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->450559) req@ffff88012d083480 x1830960573827968/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.454399:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d083480 with x1830960573827968 ext(0->450559) 00002000:00010000:2.0:1746140888.454402:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d083480 00000100:00100000:2.0:1746140888.454411:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8817 00000100:00100000:2.0:1746140888.454415:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573827840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.457170:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8818 00000100:00100000:0.0:1746140888.457183:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960573827968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140888.459083:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576093568:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.459101:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576093696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140888.459130:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2936832->3145727] (req 2936832->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.459149:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c600, rc 0) 00000100:00100000:2.0:1746140888.459198:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+16:305:x1830960573827456:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5924us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.459207:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17232 00000100:00100000:0.0:1746140888.460680:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.462834:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573828224 00000100:00100000:1.0:1746140888.462847:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573828224 00000100:00100000:1.0:1746140888.462914:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10799 00000100:00100000:1.0:1746140888.462922:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:314:x1830960573828224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.462946:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.462964:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbadc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cd0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.463085:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463098:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463108:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463120:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463125:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463130:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140888.463360:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.463386:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573828480 00000100:00100000:2.0:1746140888.463389:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573828480 00010000:00010000:2.0:1746140888.463409:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 21 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.463428:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8910 00000100:00100000:2.0:1746140888.463433:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573828480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.463441:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.463459:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 21 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.463469:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 21 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.463486:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a4f800/0x8156357b7fdbaca9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c44 expref: 21 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.463504:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.463543:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960573828480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.463548:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8910 00000100:00100000:2.0:1746140888.463579:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.463590:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573828352 00000100:00100000:2.0:1746140888.463592:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573828352 00010000:00010000:2.0:1746140888.463602:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.463616:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8911 00000100:00100000:2.0:1746140888.463620:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1982:x1830960573828352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.463629:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.463635:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.463644:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.463654:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a1a00/0x8156357b7fdbad19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c7c expref: 16 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.463663:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.463664:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.463670:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 15 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.463676:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 15 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.463705:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 15 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.463716:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576093824:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.463769:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9600 going to sleep for 11 seconds 00010000:00010000:1.0:1746140888.463867:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463877:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463883:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140888.463894:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140888.463976:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463982:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463988:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.463993:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e594400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.463997:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464002:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464010:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140888.464012:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140888.464016:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464020:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594400/0x8156357b7fdbadd6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464064:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464069:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464076:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464080:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e595400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.464082:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464086:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464093:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140888.464095:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.464097:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464101:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595400/0x8156357b7fdbadc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464107:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464112:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464116:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464120:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e595a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.464122:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464126:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464136:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4d100) 00010000:00010000:1.0:1746140888.464137:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.464139:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464143:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e595a00/0x8156357b7fdbadcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.464179:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbadc1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cd0 expref: 20 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.464187:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e594c00/0x8156357b7fdbadc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cd0 expref: 20 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.464194:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e594c00, rc 0) 00000100:00100000:0.0:1746140888.464206:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1985:x1830960573827968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7025us (10036us total) trans 0 rc 450560/450560 00000100:00100000:0.0:1746140888.464215:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8818 00000100:00100000:1.0:1746140888.464219:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:314:x1830960573828224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1298us (3544us total) trans 8589945109 rc 301/301 00002000:00100000:0.0:1746140888.464224:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (0->450559) req@ffff88012d083480 x1830960573827968/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 450560/450560 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140888.464230:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10799 00002000:00100000:0.0:1746140888.464233:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d083480 with x1830960573827968 ext(0->450559) 00002000:00010000:0.0:1746140888.464238:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d083480 00000100:00100000:3.0:1746140888.465463:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573827840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11040us (11358us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746140888.465475:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8817 00002000:00100000:3.0:1746140888.465483:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1056768->2097151) req@ffff88012d082a00 x1830960573827840/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.465491:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082a00 with x1830960573827840 ext(1056768->2097151) 00002000:00010000:3.0:1746140888.465495:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d082a00 00000100:00100000:3.0:1746140888.466522:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576093824:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.466538:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.466561:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1982:x1830960573828352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2940us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.466568:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8911 00000100:00100000:0.0:1746140888.467900:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.468326:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573828736 00000100:00100000:3.0:1746140888.468334:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573828736 00002000:00100000:3.0:1746140888.468375:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2936832->2940927) req@ffff88012d082300 x1830960573828736/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.468385:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082300 with x1830960573828736 ext(2936832->2940927) 00002000:00010000:3.0:1746140888.468391:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d082300 00000100:00100000:3.0:1746140888.468407:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8819 00000100:00100000:3.0:1746140888.468414:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573828736:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140888.468594:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573828736:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 180us (697us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140888.468600:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8819 00002000:00100000:3.0:1746140888.468605:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2936832->2940927) req@ffff88012d082300 x1830960573828736/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.468618:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082300 with x1830960573828736 ext(2936832->2940927) 00002000:00010000:3.0:1746140888.468621:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d082300 00000100:00100000:0.0:1746140888.472972:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.473474:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.473560:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573828864 00000100:00100000:1.0:1746140888.473560:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573829120 00000100:00100000:2.0:1746140888.473568:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573828864 00000100:00100000:1.0:1746140888.473568:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573829120 00000100:00100000:0.0:1746140888.474002:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.474218:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573828992 00000100:00100000:1.0:1746140888.474221:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573828992 00000100:00100000:2.0:1746140888.474227:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17233 00000100:00100000:2.0:1746140888.474236:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+11:305:x1830960573829120:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:1.0:1746140888.474244:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17234 00000100:00100000:1.0:1746140888.474249:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573828864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.474256:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.474258:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.474274:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ce5 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.474274:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e594000/0x8156357b7fdbadeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cd7 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.474301:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.474325:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.474327:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.474331:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->2650111] (req 2097152->2650111) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 12 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.474348:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576093952:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140888.474351:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.474362:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 23 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.474371:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576094080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.474416:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17235 00000100:00100000:2.0:1746140888.474417:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.474422:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573828992:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.474428:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.474435:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e595200/0x8156357b7fdbadf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cde expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.474455:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576094208:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140888.474474:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.474483:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.474984:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.474997:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573829248 00000100:00100000:2.0:1746140888.475001:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573829248 00000100:00100000:2.0:1746140888.475057:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17236 00000100:00100000:2.0:1746140888.475063:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573829248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.475069:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.475075:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbadf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cec expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.475102:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576094336:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140888.475124:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.476713:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576094080:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140888.476737:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->2650111] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 15 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.476750:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e309a00, rc 0) 00000100:00100000:2.0:1746140888.476784:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+15:305:x1830960573829120:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2550us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.476792:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17233 00002000:00010000:1.0:1746140888.476882:0:4782:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime: 1746140887 -> 1746140889 00002000:00010000:1.0:1746140888.476886:0:4782:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime: 1746140887 -> 1746140889 00002000:00010000:1.0:1746140888.476888:0:4782:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime: 1746140887 -> 1746140889 00000100:00100000:1.0:1746140888.476910:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576094208:192.168.204.16@tcp:106: 00002000:00010000:3.0:1746140888.476929:0:8460:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime: 1746140888 -> 1746140889 00010000:00010000:1.0:1746140888.476931:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e595200/0x8156357b7fdbadf2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cde expref: 14 pid: 4782 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746140888.476932:0:8460:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140888 -> 1746140889 00002000:00010000:3.0:1746140888.476934:0:8460:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime: 1746140888 -> 1746140889 00010000:00010000:1.0:1746140888.476940:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e595200/0x8156357b7fdbadf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cde expref: 14 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140888.476942:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576094336:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140888.476953:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e595200, rc 0) 00010000:00010000:3.0:1746140888.476954:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbadf9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cec expref: 13 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.476961:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbadf9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cec expref: 13 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.476970:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e308c00, rc 0) 00000100:00100000:1.0:1746140888.476972:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573828992:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2551us (2970us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140888.476977:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17235 00000100:00100000:3.0:1746140888.476984:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573829248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1922us (2001us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140888.476989:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17236 00002000:00010000:1.0:1746140888.477006:0:20960:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime: 1746140888 -> 1746140889 00002000:00010000:1.0:1746140888.477009:0:20960:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime: 1746140888 -> 1746140889 00002000:00010000:1.0:1746140888.477010:0:20960:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime: 1746140888 -> 1746140889 00000100:00100000:1.0:1746140888.477574:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576093952:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140888.477592:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e594000/0x8156357b7fdbadeb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cd7 expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.477600:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e594000/0x8156357b7fdbadeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cd7 expref: 16 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.477606:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e594000, rc 0) 00000100:00100000:1.0:1746140888.477625:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573828864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3377us (4664us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140888.477630:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17234 00000100:00100000:2.0:1746140888.478078:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.478126:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.478176:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573829376 00000100:00100000:3.0:1746140888.478182:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573829376 00000100:00100000:1.0:1746140888.478197:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573829504 00000100:00100000:1.0:1746140888.478200:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573829504 00000100:00100000:1.0:1746140888.478220:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17237 00002000:00100000:3.0:1746140888.478224:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3444736->3870719) req@ffff88012b182300 x1830960573829376/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140888.478225:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:311:x1830960573829504:12345-192.168.204.16@tcp:101:cat.0 00002000:00100000:3.0:1746140888.478233:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182300 with x1830960573829376 ext(3444736->3870719) 00010000:00010000:1.0:1746140888.478235:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.478239:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 24 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.478245:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cf3 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.478250:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 24 pid: 24958 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.478256:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b182300 00010000:00010000:1.0:1746140888.478264:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 14 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.478270:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140888.478272:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746140888.478276:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1829 00010000:00010000:1.0:1746140888.478276:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.478281:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1982:x1830960573829376:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746140888.478298:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 14 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.478323:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 14 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.478333:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576094464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.478375:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.481249:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.481251:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576094464:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140888.481279:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.481287:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140888.481295:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e595000, rc 0) 00000100:00100000:3.0:1746140888.481298:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573829632 00000100:00100000:3.0:1746140888.481318:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573829632 00000100:00100000:2.0:1746140888.481355:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:311:x1830960573829504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3128us (3233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140888.481355:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573829760 00000100:00100000:0.0:1746140888.481358:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573829760 00000100:00100000:2.0:1746140888.481362:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17237 00000100:00100000:3.0:1746140888.481367:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17238 00000100:00100000:3.0:1746140888.481374:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:314:x1830960573829632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.481386:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746140888.481386:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2936832->3145727) req@ffff8801359b1c00 x1830960573829760/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.481392:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b1c00 with x1830960573829760 ext(2936832->3145727) 00010000:00010000:0.0:1746140888.481397:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 16 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.481398:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1cfa expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.481404:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 16 pid: 24958 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.481408:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801359b1c00 00000100:00100000:0.0:1746140888.481419:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1830 00010000:00010000:3.0:1746140888.481420:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140888.481422:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573829760:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746140888.481438:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.481439:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.481443:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 17 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.481469:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.481478:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 18 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.481494:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576094592:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.481550:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752540 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.484738:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576094592:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.484739:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140888.484763:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 18 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.484766:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573829888 00000100:00100000:1.0:1746140888.484772:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573829888 00010000:00010000:2.0:1746140888.484782:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7cc00, rc 0) 00002000:00100000:1.0:1746140888.484814:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (450560->1048575) req@ffff8801359b0700 x1830960573829888/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140888.484824:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:314:x1830960573829632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3450us (3584us total) trans 0 rc 0/0 00002000:00100000:1.0:1746140888.484825:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0700 with x1830960573829888 ext(450560->1048575) 00010000:00010000:1.0:1746140888.484831:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 19 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.484832:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17238 00010000:00010000:1.0:1746140888.484841:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 19 pid: 24958 timeout: 967 lvb_type: 0 00002000:00010000:1.0:1746140888.484847:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801359b0700 00000100:00100000:1.0:1746140888.484864:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1831 00000100:00100000:1.0:1746140888.484872:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960573829888:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140888.485842:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573829376:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7555us (7759us total) trans 17179874182 rc 0/0 00000100:00100000:3.0:1746140888.485852:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1829 00002000:00100000:3.0:1746140888.485859:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (3444736->3870719) req@ffff88012b182300 x1830960573829376/t17179874182(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.485867:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182300 with x1830960573829376 ext(3444736->3870719) 00010000:00010000:3.0:1746140888.485874:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 26 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.485885:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 26 pid: 24958 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.485891:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b182300 00000100:00100000:0.0:1746140888.487094:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573829760:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5665us (5800us total) trans 21474841473 rc 0/0 00000100:00100000:0.0:1746140888.487103:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1830 00002000:00100000:0.0:1746140888.487109:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2936832->3145727) req@ffff8801359b1c00 x1830960573829760/t21474841473(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.487116:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b1c00 with x1830960573829760 ext(2936832->3145727) 00010000:00010000:0.0:1746140888.487124:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 18 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.487135:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 18 pid: 24958 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.487144:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801359b1c00 00000100:00100000:0.0:1746140888.488815:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.489090:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573830144 00000100:00100000:3.0:1746140888.489100:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573830144 00010000:00010000:3.0:1746140888.489135:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 26 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.489177:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8912 00000100:00100000:3.0:1746140888.489187:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960573830144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.489203:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.489234:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 26 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.489247:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 26 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.489273:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f7d600/0x8156357b7fdbad90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3870719) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cbb expref: 26 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.489336:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.489338:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.489346:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 10 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.489355:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 10 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.489390:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 10 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.489403:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576094720:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.489489:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.489768:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.490261:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573830016 00000100:00100000:2.0:1746140888.490267:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573830016 00010000:00010000:2.0:1746140888.490286:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 18 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.490334:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8913 00000100:00100000:2.0:1746140888.490344:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573830016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.490355:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746140888.490368:0:22044:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140888 -> 1746140889 00002000:00010000:2.0:1746140888.490372:0:22044:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140888 -> 1746140889 00010000:00010000:2.0:1746140888.490377:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 18 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.490385:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 18 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.490399:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c600/0x8156357b7fdbadba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cc9 expref: 18 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.490422:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.490424:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.490429:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.490435:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.490455:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.490462:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576094848:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.490512:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.491943:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576094720:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.491960:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.492046:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960573830144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2860us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.492054:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8912 00000100:00100000:2.0:1746140888.492087:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576094848:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.492095:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.492124:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573830016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1785us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.492129:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8913 00000100:00100000:0.0:1746140888.494227:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.494322:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573830400 00000100:00100000:2.0:1746140888.494330:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573830400 00002000:00100000:2.0:1746140888.494364:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880094af5f80 x1830960573830400/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.494372:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5f80 with x1830960573830400 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.494378:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5f80 00000100:00100000:2.0:1746140888.494405:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8820 00000100:00100000:2.0:1746140888.494410:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573830400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.494621:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.494708:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573830656 00000100:00100000:3.0:1746140888.494712:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573830656 00002000:00100000:3.0:1746140888.494826:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2646016->2650111) req@ffff880094af4380 x1830960573830656/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.494834:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4380 with x1830960573830656 ext(2646016->2650111) 00002000:00010000:3.0:1746140888.494837:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094af4380 00000100:00100000:3.0:1746140888.494856:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8821 00000100:00100000:3.0:1746140888.494861:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573830656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.494966:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573830656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 104us (345us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140888.494977:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8821 00002000:00100000:3.0:1746140888.494982:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2646016->2650111) req@ffff880094af4380 x1830960573830656/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.494989:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4380 with x1830960573830656 ext(2646016->2650111) 00002000:00010000:3.0:1746140888.494992:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094af4380 00000100:00100000:0.0:1746140888.495460:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573829888:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10587us (10729us total) trans 21474841474 rc 0/0 00000100:00100000:0.0:1746140888.495468:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1831 00002000:00100000:0.0:1746140888.495474:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (450560->1048575) req@ffff8801359b0700 x1830960573829888/t21474841474(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.495481:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0700 with x1830960573829888 ext(450560->1048575) 00010000:00010000:0.0:1746140888.495487:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 22 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.495502:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 22 pid: 24958 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.495508:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801359b0700 00000100:00100000:0.0:1746140888.496589:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.496636:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573830912 00000100:00100000:3.0:1746140888.496642:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573830912 00000100:00100000:3.0:1746140888.496683:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4748 00000100:00100000:3.0:1746140888.496689:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:305:x1830960573830912:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140888.496883:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:305:x1830960573830912:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 193us (296us total) trans 8589945110 rc 0/0 00000100:00100000:3.0:1746140888.496890:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4748 00000100:00100000:0.0:1746140888.500765:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.500887:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573831040 00000100:00100000:2.0:1746140888.500897:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573831040 00010000:00010000:2.0:1746140888.500934:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 23 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.500961:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8914 00000100:00100000:2.0:1746140888.500967:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1983:x1830960573831040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.500981:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.501002:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 23 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.501015:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 23 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.501049:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbad2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 450560->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c91 expref: 23 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.501077:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.501079:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.501086:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 16 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.501098:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 16 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.501133:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 16 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.501450:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576094976:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.501680:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.503582:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573830400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9162us (9354us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140888.503592:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8820 00002000:00100000:2.0:1746140888.503603:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880094af5f80 x1830960573830400/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.503613:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5f80 with x1830960573830400 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.503619:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5f80 00000100:00100000:0.0:1746140888.505555:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.505623:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573831296 00000100:00100000:3.0:1746140888.505632:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573831296 00002000:00100000:3.0:1746140888.505673:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880094af7100 x1830960573831296/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.505683:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af7100 with x1830960573831296 ext(0->1048575) 00002000:00010000:3.0:1746140888.505692:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af7100 00000100:00100000:2.0:1746140888.505706:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576094976:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.505720:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8822 00000100:00100000:3.0:1746140888.505727:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573831296:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140888.505818:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.506402:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1983:x1830960573831040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5433us (5648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.506411:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8914 00000100:00100000:0.0:1746140888.509524:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.509618:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573831424 00000100:00100000:2.0:1746140888.509627:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573831424 00000100:00100000:2.0:1746140888.509729:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17239 00000100:00100000:2.0:1746140888.509737:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:311:x1830960573831424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.509758:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.509775:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d01 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.509804:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 10 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.509811:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.509813:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.509816:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 26 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.509843:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 10 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.509854:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 10 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.509866:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576095104:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.510268:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.511287:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573831296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5557us (5742us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.511298:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8822 00002000:00100000:3.0:1746140888.511327:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880094af7100 x1830960573831296/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.511336:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af7100 with x1830960573831296 ext(0->1048575) 00002000:00010000:3.0:1746140888.511341:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af7100 00000100:00100000:3.0:1746140888.511656:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576095104:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.511679:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 26 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.511693:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e308c00, rc 0) 00000100:00100000:3.0:1746140888.512243:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:311:x1830960573831424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2506us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.512250:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17239 00000100:00100000:0.0:1746140888.512783:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.513451:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573831552 00000100:00100000:3.0:1746140888.513460:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573831552 00002000:00100000:3.0:1746140888.513500:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2650111) req@ffff880094af4700 x1830960573831552/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.513509:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4700 with x1830960573831552 ext(2097152->2650111) 00010000:00010000:3.0:1746140888.513518:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 11 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.513534:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 11 pid: 24958 timeout: 967 lvb_type: 0 00002000:00010000:3.0:1746140888.513543:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094af4700 00000100:00100000:3.0:1746140888.513838:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1832 00000100:00100000:3.0:1746140888.513847:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573831552:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140888.516007:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.516812:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573831680 00000100:00100000:3.0:1746140888.516822:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573831680 00000100:00100000:3.0:1746140888.517230:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17240 00000100:00100000:3.0:1746140888.517239:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:314:x1830960573831680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.517256:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.517273:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d08 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.517734:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.517744:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.517746:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.517750:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 14 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.517781:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.517792:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 25 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.517811:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576095232:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.517885:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.520266:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573831552:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6411us (7473us total) trans 17179874183 rc 0/0 00000100:00100000:2.0:1746140888.520278:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1832 00002000:00100000:2.0:1746140888.520289:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2650111) req@ffff880094af4700 x1830960573831552/t17179874183(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.520299:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4700 with x1830960573831552 ext(2097152->2650111) 00010000:00010000:2.0:1746140888.520325:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 15 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.520401:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576095232:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.520423:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 15 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.520436:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7ce00, rc 0) 00000100:00100000:3.0:1746140888.520455:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:314:x1830960573831680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3219us (4457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.520461:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17240 00010000:00010000:2.0:1746140888.520531:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 14 pid: 24958 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.520538:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094af4700 00000100:00100000:0.0:1746140888.520753:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.520828:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573831808 00000100:00100000:2.0:1746140888.520835:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573831808 00002000:00100000:2.0:1746140888.520907:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1056767) req@ffff880094af5500 x1830960573831808/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 8680/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.520915:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5500 with x1830960573831808 ext(1048576->1056767) 00010000:00010000:2.0:1746140888.520920:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 26 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.520928:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 26 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.520933:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094af5500 00000100:00100000:2.0:1746140888.520947:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1833 00000100:00100000:2.0:1746140888.520952:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960573831808:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140888.521274:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573831808:12345-192.168.204.16@tcp:4:cat.0 Request processed in 320us (521us total) trans 17179874184 rc 0/0 00000100:00100000:2.0:1746140888.521280:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1833 00002000:00100000:2.0:1746140888.521284:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1056767) req@ffff880094af5500 x1830960573831808/t17179874184(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 8680/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.521291:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5500 with x1830960573831808 ext(1048576->1056767) 00010000:00010000:2.0:1746140888.521296:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 28 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.521329:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 28 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.521335:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094af5500 00000100:00100000:0.0:1746140888.522653:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.522756:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573831936 00000100:00100000:2.0:1746140888.522763:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573831936 00010000:00010000:2.0:1746140888.522787:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 14 pid: 24958 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.522807:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8915 00000100:00100000:2.0:1746140888.522813:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573831936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.522823:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.522841:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 14 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.522850:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 14 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.522870:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e309a00/0x8156357b7fdbade4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ce5 expref: 14 pid: 24958 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.522899:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.522901:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.522908:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 27 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.522919:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 27 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.522947:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 27 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.522962:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576095360:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.523043:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.524026:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.524086:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573832064 00000100:00100000:2.0:1746140888.524092:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573832064 00010000:00010000:2.0:1746140888.524113:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 28 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.524134:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8916 00000100:00100000:2.0:1746140888.524139:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573832064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.524147:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.524162:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 28 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.524165:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576095360:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.524171:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 28 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.524178:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140888.524185:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e595600/0x8156357b7fdbad3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1c9f expref: 28 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.524198:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.524200:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.524204:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 13 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.524212:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573831936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1399us (1564us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140888.524212:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 13 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.524219:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8915 00010000:00010000:2.0:1746140888.524230:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 12 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.524237:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576095488:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.524838:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.526239:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576095488:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.526254:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.526281:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573832064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2142us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.526290:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8916 00000100:00100000:0.0:1746140888.530694:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.530723:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.530744:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.530792:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573832320 00000100:00100000:2.0:1746140888.530803:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573832320 00000100:00100000:0.0:1746140888.530803:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140888.530848:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880094af6680 x1830960573832320/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.530858:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af6680 with x1830960573832320 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.530863:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094af6680 00000100:00100000:1.0:1746140888.530993:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573832576 00000100:00100000:1.0:1746140888.531000:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573832576 00002000:00100000:1.0:1746140888.531021:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092ba5880 x1830960573832576/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.531028:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5880 with x1830960573832576 ext(1048576->2097151) 00002000:00010000:1.0:1746140888.531039:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba5880 00000100:00100000:1.0:1746140888.531197:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573832832 00000100:00100000:3.0:1746140888.531199:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573833088 00000100:00100000:1.0:1746140888.531201:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573832832 00000100:00100000:3.0:1746140888.531202:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573833088 00000100:00100000:2.0:1746140888.531210:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8823 00002000:00100000:1.0:1746140888.531214:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880092ba7480 x1830960573832832/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.531217:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880092ba5180 x1830960573833088/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140888.531219:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573832320:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140888.531224:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5180 with x1830960573833088 ext(3145728->4194303) 00002000:00010000:3.0:1746140888.531227:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba5180 00000100:00100000:3.0:1746140888.531240:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8824 00000100:00100000:0.0:1746140888.531244:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8825 00000100:00100000:3.0:1746140888.531245:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573832576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.531249:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573833088:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746140888.532111:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7480 with x1830960573832832 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.532115:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba7480 00000100:00100000:1.0:1746140888.532128:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8826 00000100:00100000:1.0:1746140888.532134:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573832832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.543655:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960573832576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12396us (12916us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.543668:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8824 00002000:00100000:3.0:1746140888.543681:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092ba5880 x1830960573832576/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.543691:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5880 with x1830960573832576 ext(1048576->2097151) 00002000:00010000:3.0:1746140888.543697:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba5880 00000100:00100000:0.0:1746140888.547119:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.547259:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573833344 00000100:00100000:3.0:1746140888.547270:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573833344 00000100:00100000:3.0:1746140888.547364:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4749 00000100:00100000:3.0:1746140888.547372:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+6:32734:x1830960573833344:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00080000:0.0:1746140888.547679:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746140888.548237:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32734:x1830960573833344:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 864us (1126us total) trans 8589945111 rc 0/0 00000100:00100000:3.0:1746140888.548245:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4749 00000100:00100000:1.0:1746140888.549412:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573832832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17272us (18660us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.549422:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8826 00002000:00100000:1.0:1746140888.549431:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880092ba7480 x1830960573832832/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.549441:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7480 with x1830960573832832 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.549446:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba7480 00000100:00100000:0.0:1746140888.550385:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573832320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19164us (19700us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140888.550393:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8823 00002000:00100000:0.0:1746140888.550399:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880094af6680 x1830960573832320/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.550407:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af6680 with x1830960573832320 ext(2097152->3145727) 00002000:00010000:0.0:1746140888.550411:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094af6680 00000100:00100000:2.0:1746140888.551509:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.551738:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960573833088:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20487us (20932us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140888.551747:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8825 00002000:00100000:0.0:1746140888.551754:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880092ba5180 x1830960573833088/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.551761:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5180 with x1830960573833088 ext(3145728->4194303) 00002000:00010000:0.0:1746140888.551766:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba5180 00000100:00100000:3.0:1746140888.551975:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573833600 00000100:00100000:3.0:1746140888.551985:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573833600 00000100:00100000:3.0:1746140888.552040:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4750 00000100:00100000:3.0:1746140888.552048:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:32734:x1830960573833600:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746140888.552216:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:32734:x1830960573833600:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 169us (709us total) trans 8589945112 rc 0/0 00000100:00100000:3.0:1746140888.552222:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4750 00000100:00100000:0.0:1746140888.554585:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.554812:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573833728 00000100:00100000:3.0:1746140888.554820:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573833728 00000100:00100000:3.0:1746140888.554881:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17241 00000100:00100000:3.0:1746140888.554888:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573833728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.554905:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.554922:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d0f expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.554945:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.554946:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.554954:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 18 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.554970:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 18 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.554980:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7d400, rc 0) 00000100:00100000:3.0:1746140888.555043:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573833728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 155us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.555049:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17241 00000100:00100000:0.0:1746140888.556446:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.556521:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573833984 00000100:00100000:1.0:1746140888.556530:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573833984 00000100:00100000:1.0:1746140888.556574:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10800 00000100:00100000:1.0:1746140888.556581:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:317:x1830960573833984:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140888.556600:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.556615:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b600/0x8156357b7fdbae23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d1d expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.556718:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556729:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556738:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556750:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556755:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556760:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556856:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556863:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556868:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140888.556880:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140888.556960:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556966:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556971:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556976:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a521a000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.556980:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556987:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.556995:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140888.556997:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.557000:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.557005:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140888.558456:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.558484:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.558512:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140888.558634:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140888.558703:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573834112 00000100:00100000:2.0:1746140888.558710:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573834112 00010000:00010000:1.0:1746140888.559019:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.559025:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.559043:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a521a600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.559046:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.559051:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.559064:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4d100) 00010000:00010000:1.0:1746140888.559066:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.559069:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.559074:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbae31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.559141:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b600/0x8156357b7fdbae23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 283 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.559153:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 282 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.559160:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140888.559161:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140888.559164:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521a400, rc 0) 00000100:00100000:1.0:1746140888.559215:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:317:x1830960573833984:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2634us (2774us total) trans 8589945113 rc 0/0 00000100:00100000:1.0:1746140888.559223:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10800 00000100:00100000:1.0:1746140888.559259:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573834368 00000100:00100000:1.0:1746140888.559262:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573834368 00000100:00100000:1.0:1746140888.559669:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573834240 00000100:00100000:1.0:1746140888.559672:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573834240 00000100:00100000:0.0:1746140888.559711:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17242 00000100:00100000:0.0:1746140888.559754:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573834368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140888.559768:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140888.559781:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d2b expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.559800:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140888.559801:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140888.559808:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 28 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140888.559819:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 28 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140888.559827:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e5b4e00, rc 0) 00000100:00100000:0.0:1746140888.559847:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1983:x1830960573834368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.559898:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17243 00000100:00100000:3.0:1746140888.559908:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573834112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.559917:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140888.559919:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17244 00010000:00010000:3.0:1746140888.559925:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d16 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.559926:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1983:x1830960573834240:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.559934:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.559937:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.559939:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.559943:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d24 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.559944:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 14 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.559954:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 14 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.559954:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.559956:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.559960:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 21 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.559961:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c800, rc 0) 00010000:00010000:2.0:1746140888.559970:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 21 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.559977:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e308800, rc 0) 00000100:00100000:3.0:1746140888.559980:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573834112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 75us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.559986:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17243 00000100:00100000:2.0:1746140888.559993:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573834240:12345-192.168.204.16@tcp:101:cat.0 Request processed in 68us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.559998:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17244 00000100:00100000:0.0:1746140888.560751:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17242 00000100:00100000:2.0:1746140888.565648:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.565705:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573834624 00000100:00100000:0.0:1746140888.565713:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573834624 00002000:00100000:0.0:1746140888.565759:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b182a00 x1830960573834624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.565769:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182a00 with x1830960573834624 ext(4194304->4886527) 00002000:00010000:0.0:1746140888.565774:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b182a00 00000100:00100000:0.0:1746140888.565791:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8827 00000100:00100000:0.0:1746140888.565798:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573834624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.570452:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.570487:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.570506:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.570535:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.570681:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573834880 00000100:00100000:2.0:1746140888.570690:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573834880 00002000:00100000:2.0:1746140888.570733:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880092ba7100 x1830960573834880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140888.570746:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573835136 00002000:00100000:2.0:1746140888.570748:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7100 with x1830960573834880 ext(2097152->3145727) 00000100:00100000:1.0:1746140888.570751:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573835136 00002000:00010000:2.0:1746140888.570754:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba7100 00000100:00100000:2.0:1746140888.570768:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573835392 00000100:00100000:2.0:1746140888.570771:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573835392 00002000:00100000:1.0:1746140888.570771:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880092ba6680 x1830960573835136/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.570779:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba6680 with x1830960573835136 ext(3145728->4194303) 00002000:00100000:2.0:1746140888.570782:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880092ba4380 x1830960573835392/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746140888.570783:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba6680 00002000:00100000:2.0:1746140888.570788:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba4380 with x1830960573835392 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.570791:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba4380 00000100:00100000:1.0:1746140888.570797:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573835648 00000100:00100000:1.0:1746140888.570799:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573835648 00000100:00100000:2.0:1746140888.570802:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8828 00000100:00100000:2.0:1746140888.570807:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573834880:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746140888.570811:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880092ba5500 x1830960573835648/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.570817:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5500 with x1830960573835648 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.570820:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba5500 00000100:00100000:1.0:1746140888.570839:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8829 00000100:00100000:1.0:1746140888.570845:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573835136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.571433:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8830 00000100:00100000:3.0:1746140888.571928:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8831 00000100:00100000:3.0:1746140888.571937:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573835648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.572341:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573835392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.573275:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1982:x1830960573834624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7474us (7639us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140888.573284:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8827 00002000:00100000:1.0:1746140888.573293:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b182a00 x1830960573834624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.573318:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182a00 with x1830960573834624 ext(4194304->4886527) 00002000:00010000:1.0:1746140888.573325:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b182a00 00000100:00100000:0.0:1746140888.584174:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.584275:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573835904 00000100:00100000:3.0:1746140888.584284:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573835904 00000100:00100000:3.0:1746140888.584365:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4751 00000100:00100000:3.0:1746140888.584373:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:311:x1830960573835904:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140888.584901:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:311:x1830960573835904:12345-192.168.204.16@tcp:35:cat.0 Request processed in 528us (738us total) trans 8589945114 rc 0/0 00000100:00100000:3.0:1746140888.584908:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4751 00000100:00100000:1.0:1746140888.588368:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573835136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17513us (17870us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.588379:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8829 00002000:00100000:1.0:1746140888.588390:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880092ba6680 x1830960573835136/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.588399:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba6680 with x1830960573835136 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.588404:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba6680 00000100:00100000:2.0:1746140888.593878:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573834880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23062us (23427us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140888.593889:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8828 00002000:00100000:2.0:1746140888.593900:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880092ba7100 x1830960573834880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.593908:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba7100 with x1830960573834880 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.593913:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba7100 00000100:00100000:3.0:1746140888.594586:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573835648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22643us (24041us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.594596:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8831 00002000:00100000:3.0:1746140888.594606:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880092ba5500 x1830960573835648/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.594615:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5500 with x1830960573835648 ext(3145728->4194303) 00002000:00010000:3.0:1746140888.594620:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba5500 00000100:00100000:1.0:1746140888.595486:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573835392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24042us (24974us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.595495:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8830 00002000:00100000:1.0:1746140888.595503:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880092ba4380 x1830960573835392/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.595512:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba4380 with x1830960573835392 ext(2097152->3145727) 00002000:00010000:1.0:1746140888.595516:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ba4380 00000100:00100000:0.0:1746140888.602831:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.602924:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573836160 00000100:00100000:1.0:1746140888.602936:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573836160 00002000:00100000:1.0:1746140888.602990:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880092ba5f80 x1830960573836160/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.603000:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5f80 with x1830960573836160 ext(4194304->4886527) 00002000:00010000:1.0:1746140888.603006:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba5f80 00000100:00100000:1.0:1746140888.603055:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8832 00000100:00100000:1.0:1746140888.603063:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573836160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140888.607609:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.607818:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573836288 00000100:00100000:1.0:1746140888.607832:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573836288 00000100:00100000:1.0:1746140888.607939:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17245 00000100:00100000:1.0:1746140888.607948:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:317:x1830960573836288:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140888.607967:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.607985:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d32 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.608012:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 29 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.608021:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 13 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.608027:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.608043:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.608047:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 29 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.608076:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 13 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.608086:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 13 pid: 8460 timeout: 967 lvb_type: 1 00000100:00100000:1.0:1746140888.608097:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576095616:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.608211:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 29 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.608223:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 29 pid: 8460 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.608230:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576095744:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.608248:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.609390:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573836160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6325us (6567us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140888.609398:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8832 00002000:00100000:1.0:1746140888.609405:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880092ba5f80 x1830960573836160/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.609410:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ba5f80 with x1830960573836160 ext(4194304->4886527) 00002000:00010000:1.0:1746140888.609415:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ba5f80 00000100:00100000:0.0:1746140888.611587:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.611642:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576095616:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.611653:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576095744:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140888.611667:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140888.611680:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 29 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.611690:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573836416 00010000:00010000:1.0:1746140888.611695:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521b600, rc 0) 00000100:00100000:2.0:1746140888.611697:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573836416 00010000:00010000:2.0:1746140888.611723:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 14 pid: 8460 timeout: 967 lvb_type: 1 00000100:00100000:1.0:1746140888.611739:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f09b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:317:x1830960573836288:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3792us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.611745:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17245 00000100:00100000:2.0:1746140888.611753:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573836544 00000100:00100000:2.0:1746140888.611755:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573836544 00000100:00100000:3.0:1746140888.611759:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8917 00010000:00010000:2.0:1746140888.611765:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 29 pid: 8460 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.611770:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f09bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573836416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.611784:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140888.611787:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8918 00000100:00100000:2.0:1746140888.611792:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573836544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.611798:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.611804:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 14 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.611806:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 29 pid: 8460 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.611813:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 14 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.611822:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 29 pid: 8460 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.611840:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f7c800/0x8156357b7fdbae4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d16 expref: 14 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.611846:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e308c00/0x8156357b7fdbae0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d01 expref: 29 pid: 8460 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.611855:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.611856:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.611863:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.611870:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.611877:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140888.611894:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.611899:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573836544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.611904:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576095872:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.611905:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8918 00000100:00100000:3.0:1746140888.611959:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.612986:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.613087:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573836672 00000100:00100000:1.0:1746140888.613095:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573836672 00000100:00100000:1.0:1746140888.613147:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17246 00000100:00100000:1.0:1746140888.613154:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1983:x1830960573836672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.613169:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140888.613176:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576095872:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140888.613184:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a521bc00/0x8156357b7fdbae62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d39 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.613193:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.613225:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f09bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573836416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1457us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.613230:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576096000:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140888.613234:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8917 00000100:00100000:1.0:1746140888.613300:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.614852:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576096000:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140888.614877:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a521bc00/0x8156357b7fdbae62 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d39 expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.614889:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a521bc00/0x8156357b7fdbae62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d39 expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.614909:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521bc00, rc 0) 00000100:00100000:1.0:1746140888.614948:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573836672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1795us (1963us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140888.614955:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17246 00000100:00100000:0.0:1746140888.615348:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.615419:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573836928 00000100:00100000:1.0:1746140888.615424:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573836928 00002000:00100000:1.0:1746140888.615451:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2658304->2662399) req@ffff8800948f8a80 x1830960573836928/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.615459:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948f8a80 with x1830960573836928 ext(2658304->2662399) 00002000:00010000:1.0:1746140888.615464:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948f8a80 00000100:00100000:1.0:1746140888.615484:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8833 00000100:00100000:1.0:1746140888.615490:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573836928:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140888.615621:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573836928:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 132us (273us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140888.615627:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8833 00002000:00100000:1.0:1746140888.615632:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2658304->2662399) req@ffff8800948f8a80 x1830960573836928/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.616079:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948f8a80 with x1830960573836928 ext(2658304->2662399) 00002000:00010000:1.0:1746140888.616082:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948f8a80 00000100:00100000:0.0:1746140888.618489:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.618505:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.618668:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573837312 00000100:00100000:1.0:1746140888.618677:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573837312 00000100:00100000:1.0:1746140888.618840:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10801 00000100:00100000:1.0:1746140888.618848:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:321:x1830960573837312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140888.618868:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.618885:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521ba00/0x8156357b7fdbae69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d47 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.619040:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619052:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619062:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619074:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619083:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619088:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619183:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae7e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619189:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619194:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140888.619202:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140888.619279:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619285:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619291:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619295:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a521bc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.619299:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140888.619371:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573837056 00000100:00100000:0.0:1746140888.619375:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573837056 00000100:00100000:0.0:1746140888.619405:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17247 00000100:00100000:0.0:1746140888.619410:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573837056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140888.619418:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140888.619427:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdbae8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d40 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140888.619465:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576096128:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140888.619539:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119900 going to sleep for 11 seconds 00010000:00010000:1.0:1746140888.619580:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619591:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140888.619594:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.619597:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619603:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbae70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619622:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619626:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619630:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619635:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a521b200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.619637:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619642:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619646:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4d100) 00010000:00010000:1.0:1746140888.619648:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.619650:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619653:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbae77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.619683:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521ba00/0x8156357b7fdbae69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d47 expref: 23 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.619697:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d47 expref: 22 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.619703:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140888.619705:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140888.619707:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521a000, rc 0) 00000100:00100000:1.0:1746140888.619736:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:321:x1830960573837312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 889us (1239us total) trans 8589945115 rc 0/0 00000100:00100000:1.0:1746140888.619742:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10801 00000100:00100000:0.0:1746140888.620408:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.620671:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573837440 00000100:00100000:2.0:1746140888.620681:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573837440 00000100:00100000:2.0:1746140888.620718:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17248 00000100:00100000:2.0:1746140888.620725:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:317:x1830960573837440:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140888.620740:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.620753:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d4e expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.620781:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 22 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.620789:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 17 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.620795:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.620797:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.620800:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->3252223] (req 3145728->3252223) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 22 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.620826:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 17 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.620837:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 17 pid: 8460 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140888.620847:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576096256:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140888.620933:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 22 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.620942:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 22 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.620950:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576096384:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.620970:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.621131:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576096128:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140888.621152:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdbae8c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d40 expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140888.621164:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfd5400/0x8156357b7fdbae8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d40 expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140888.621186:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dfd5400, rc 0) 00000100:00100000:0.0:1746140888.621219:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1983:x1830960573837056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1809us (2739us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140888.621225:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17247 00000100:00100000:0.0:1746140888.626658:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.626828:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.626829:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573837568 00000100:00100000:3.0:1746140888.626841:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573837568 00000100:00100000:3.0:1746140888.626904:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 782 00000100:00100000:3.0:1746140888.626911:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573837568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140888.626924:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576096256:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.626925:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140888.626935:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576096384:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.626948:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbae7e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d47 expref: 22 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.626962:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->3252223] (req 3145728->3252223) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 22 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.626978:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5eec00, rc 0) 00010000:00010000:3.0:1746140888.626981:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140888.626985:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.627023:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:317:x1830960573837440:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6298us (6616us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.627025:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573837568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 114us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.627043:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 782 00000100:00100000:2.0:1746140888.627046:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17248 00000100:00100000:3.0:1746140888.627070:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573837824 00000100:00100000:3.0:1746140888.627073:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573837824 00000100:00100000:3.0:1746140888.627091:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4752 00000100:00100000:3.0:1746140888.627096:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+21:314:x1830960573837824:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140888.627253:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:314:x1830960573837824:12345-192.168.204.16@tcp:35:cat.0 Request processed in 157us (425us total) trans 8589945116 rc 0/0 00000100:00100000:3.0:1746140888.627258:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4752 00000100:00100000:0.0:1746140888.628769:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.628834:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573838080 00000100:00100000:2.0:1746140888.628842:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573838080 00010000:00010000:2.0:1746140888.628871:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 18 pid: 8460 timeout: 967 lvb_type: 1 00000100:00100000:2.0:1746140888.628902:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8919 00000100:00100000:2.0:1746140888.628908:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573838080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.628918:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.628939:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 18 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.628949:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 18 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.628969:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbae1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d0f expref: 18 pid: 8460 timeout: 967 lvb_type: 1 00010000:00010000:2.0:1746140888.628992:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.629018:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573838080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.629192:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8919 00000100:00100000:0.0:1746140888.629472:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.629514:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573837952 00000100:00100000:2.0:1746140888.629520:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573837952 00010000:00010000:2.0:1746140888.629543:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 22 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.629579:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8920 00000100:00100000:2.0:1746140888.629585:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573837952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.629595:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.629612:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 22 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.629627:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 22 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.629643:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e595000/0x8156357b7fdbae00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cf3 expref: 22 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.629654:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.629655:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.629661:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.629672:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.629702:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.629715:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576096512:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.629789:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.634080:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576096512:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.634100:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140888.634151:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.634260:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573837952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4672us (4786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.634270:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8920 00000100:00100000:1.0:1746140888.634435:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573838336 00000100:00100000:1.0:1746140888.634441:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573838336 00002000:00100000:1.0:1746140888.634474:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3248128->3252223) req@ffff8800948fa300 x1830960573838336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.634484:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fa300 with x1830960573838336 ext(3248128->3252223) 00002000:00010000:1.0:1746140888.634488:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948fa300 00000100:00100000:1.0:1746140888.634716:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8834 00000100:00100000:1.0:1746140888.634722:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573838336:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140888.635245:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1983:x1830960573838336:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 522us (1099us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140888.635252:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8834 00002000:00100000:1.0:1746140888.635258:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3248128->3252223) req@ffff8800948fa300 x1830960573838336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.635264:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fa300 with x1830960573838336 ext(3248128->3252223) 00002000:00010000:1.0:1746140888.635267:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948fa300 00000100:00100000:0.0:1746140888.638606:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.638677:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573838592 00000100:00100000:3.0:1746140888.638687:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573838592 00000100:00100000:3.0:1746140888.638740:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4753 00000100:00100000:3.0:1746140888.638748:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:317:x1830960573838592:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140888.639120:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:317:x1830960573838592:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 373us (521us total) trans 8589945117 rc 0/0 00000100:00100000:3.0:1746140888.639127:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4753 00000100:00100000:0.0:1746140888.669668:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.669779:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573838720 00000100:00100000:1.0:1746140888.669794:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573838720 00000100:00100000:1.0:1746140888.669876:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10802 00000100:00100000:1.0:1746140888.669884:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:324:x1830960573838720:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140888.669908:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.669926:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521ba00/0x8156357b7fdbae9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d55 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.669982:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.669993:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670003:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670014:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670019:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670025:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670133:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670141:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670146:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:1.0:1746140888.670173:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140888.670176:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140888.670189:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670197:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670203:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670208:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670213:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670219:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a521b200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.670223:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670229:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670238:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140888.670241:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.670244:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670248:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521b200/0x8156357b7fdbaea1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670276:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670282:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670286:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670290:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a521bc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140888.670292:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670296:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670302:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4de00) 00010000:00010000:1.0:1746140888.670340:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140888.670343:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670811:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaea8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.670840:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521ba00/0x8156357b7fdbae9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.670849:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.670856:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140888.670858:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140888.670860:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521a600, rc 0) 00000100:00100000:1.0:1746140888.670924:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:324:x1830960573838720:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1041us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.670931:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10802 00000100:00100000:0.0:1746140888.673398:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.673505:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573838848 00000100:00100000:2.0:1746140888.673515:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573838848 00000100:00100000:2.0:1746140888.673559:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17249 00000100:00100000:2.0:1746140888.673566:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573838848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140888.673585:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.673602:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d5c expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.673625:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.673627:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.673636:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 10 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.673657:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 10 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.673668:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5efe00, rc 0) 00000100:00100000:2.0:1746140888.673725:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573838848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 159us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.673731:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17249 00000100:00100000:1.0:1746140888.675010:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.675048:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.676360:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573838976 00000100:00100000:3.0:1746140888.676366:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573839232 00000100:00100000:2.0:1746140888.676370:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573838976 00000100:00100000:3.0:1746140888.676374:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573839232 00000100:00100000:2.0:1746140888.676422:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17250 00000100:00100000:2.0:1746140888.676429:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573838976:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140888.676445:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.676460:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d63 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.676468:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17251 00000100:00100000:3.0:1746140888.676477:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573839232:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140888.676479:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.676481:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.676488:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.676492:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.676503:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.676505:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f200/0x8156357b7fdbaec4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d71 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.676512:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ef800, rc 0) 00000100:00100000:3.0:1746140888.676552:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576096640:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140888.677083:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573838976:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 653us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.677231:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.677417:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.677624:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573839104 00000100:00100000:3.0:1746140888.677629:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573839104 00000100:00100000:2.0:1746140888.677778:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17250 00000100:00100000:2.0:1746140888.677800:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17252 00000100:00100000:2.0:1746140888.677808:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573839104:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140888.677818:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.677828:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b5efc00/0x8156357b7fdbaecb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d6a expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.677863:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576096768:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140888.677908:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.678900:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576096640:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140888.678927:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f200/0x8156357b7fdbaec4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d71 expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.678939:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8f200/0x8156357b7fdbaec4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d71 expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.678964:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f200, rc 0) 00000100:00100000:3.0:1746140888.678994:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573839232:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2519us (3945us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140888.679000:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17251 00002000:00010000:3.0:1746140888.679815:0:32377:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140888 -> 1746140889 00000100:00100000:3.0:1746140888.679830:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576096768:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140888.679847:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b5efc00/0x8156357b7fdbaecb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d6a expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.679856:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b5efc00/0x8156357b7fdbaecb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d6a expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.679864:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5efc00, rc 0) 00000100:00100000:3.0:1746140888.679889:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573839104:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2082us (2473us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140888.679896:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17252 00000100:00100000:0.0:1746140888.682170:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.682250:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573839488 00000100:00100000:1.0:1746140888.682258:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573839488 00000100:00100000:1.0:1746140888.682333:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10803 00000100:00100000:1.0:1746140888.682340:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:324:x1830960573839488:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140888.682356:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.682371:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaed2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d78 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682442:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.682454:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 283 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682462:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 21 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682466:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 283 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682472:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682477:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.682504:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682514:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 10 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.682524:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576096896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.682655:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 283 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682662:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 283 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.682670:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576097024:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.682694:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 21 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682701:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 21 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.682708:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576097152:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140888.682729:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 283 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.682735:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 283 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.682746:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576097280:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.682757:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00010000:00010000:2.0:1746140888.685866:0:1273:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140888.686903:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.686924:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.687025:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573839616 00000100:00100000:0.0:1746140888.687039:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.687043:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573839616 00000100:00100000:0.0:1746140888.687055:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573839744 00000100:00100000:0.0:1746140888.687057:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573839744 00010000:00010000:2.0:1746140888.687077:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.687077:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 284 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.687085:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576096896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.687097:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576097024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140888.687098:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573839872 00000100:00100000:0.0:1746140888.687100:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573839872 00000100:00100000:1.0:1746140888.687106:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576097152:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140888.687107:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 285 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.687115:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576097280:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.687142:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8921 00010000:00010000:1.0:1746140888.687148:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140888.687150:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1984:x1830960573839744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.687162:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.687166:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 285 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.687175:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 285 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.687192:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a400/0x8156357b7fdbae38 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d1d expref: 285 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.687225:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140888.687229:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.687235:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.687240:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.687270:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:1984:x1830960573839744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.687275:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8921 00000100:00100000:2.0:1746140888.687290:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8922 00000100:00100000:2.0:1746140888.687294:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573839616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140888.687294:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8923 00000100:00100000:0.0:1746140888.687298:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:1985:x1830960573839872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.687300:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140888.687302:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.687319:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.687321:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 283 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.687327:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.687333:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 283 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.687342:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a600/0x8156357b7fdbaeaf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d55 expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.687402:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140888.687403:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fce6000/0x8156357b7fdbab3d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b87 expref: 283 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.687405:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.687409:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.687414:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140888.687415:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140888.687417:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140888.687421:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140888.687425:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.687427:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573839616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.687432:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8922 00000100:00100000:0.0:1746140888.687435:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:1985:x1830960573839872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 138us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140888.687439:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8923 00000100:00100000:0.0:1746140888.687473:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.687567:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573840000 00000100:00100000:1.0:1746140888.687571:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573840000 00010000:00010000:1.0:1746140888.687584:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 22 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.687635:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8924 00000100:00100000:1.0:1746140888.687641:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573840000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140888.687649:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140888.687653:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 22 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.687660:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 22 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.687671:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1cc000/0x8156357b7fdbabd0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bdb expref: 22 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.687692:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140888.687695:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.687702:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.687707:0:9847:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140888.687733:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140888.687753:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573840000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.687759:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8924 00010000:00010000:0.0:1746140888.687818:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140888.687844:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:0.0:1746140888.687859:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140888.687979:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521bc00/0x8156357b7fdbaed2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.687991:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.687997:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140888.687999:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140888.688001:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521a000, rc 0) 00000100:00100000:0.0:1746140888.688045:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:324:x1830960573839488:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5706us (5881us total) trans 8589945118 rc 0/0 00000100:00100000:0.0:1746140888.688052:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10803 00000100:00100000:0.0:1746140888.693294:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.693429:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573840128 00000100:00100000:2.0:1746140888.693439:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573840128 00000100:00100000:2.0:1746140888.693607:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10804 00000100:00100000:2.0:1746140888.693616:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:324:x1830960573840128:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140888.693642:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.693660:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbaee7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d7f expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.693733:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.693746:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.693752:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.693782:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.693792:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.693804:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576097408:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.694295:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.700748:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.700841:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576097408:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.700843:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573840256 00000100:00100000:3.0:1746140888.700855:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573840256 00010000:00010000:2.0:1746140888.700865:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140888.700898:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 12 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.702225:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8925 00000100:00100000:3.0:1746140888.702239:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573840256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.702258:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.702266:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 12 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.702278:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 12 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.702297:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a521a000/0x8156357b7fdbaed9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d78 expref: 12 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.702557:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140888.702561:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140888.702586:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140888.702592:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140888.702628:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.702684:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573840256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 449us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.702690:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8925 00010000:00010000:2.0:1746140888.702758:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.702768:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140888.702813:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140888.702822:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746140888.702840:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.702877:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbaee7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.702907:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.702916:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140888.702919:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140888.702922:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5eea00, rc 0) 00000100:00100000:2.0:1746140888.702971:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:324:x1830960573840128:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9356us (9687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.702979:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10804 00000100:00100000:0.0:1746140888.705641:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.705692:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.705782:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573840384 00000100:00100000:2.0:1746140888.705782:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573840512 00000100:00100000:3.0:1746140888.705791:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573840384 00000100:00100000:2.0:1746140888.705791:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573840512 00000100:00100000:3.0:1746140888.706827:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17253 00000100:00100000:3.0:1746140888.706907:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573840384:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746140888.706924:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17254 00010000:00010000:3.0:1746140888.706925:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140888.706932:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573840512:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140888.706942:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdbaef5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d86 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.706942:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.706953:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b5ee800/0x8156357b7fdbaefc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d8d expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.706988:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576097536:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140888.706988:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576097664:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140888.707322:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.707453:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.708406:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576097536:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140888.708439:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdbaef5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d86 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.708459:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdbaef5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d86 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.708470:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f400, rc 0) 00000100:00100000:3.0:1746140888.708513:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573840384:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1677us (2879us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140888.708522:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17253 00000100:00100000:2.0:1746140888.708675:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576097664:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140888.708701:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b5ee800/0x8156357b7fdbaefc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d8d expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.708711:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b5ee800/0x8156357b7fdbaefc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d8d expref: 11 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140888.708720:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ee800, rc 0) 00000100:00100000:2.0:1746140888.708748:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573840512:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1817us (3056us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140888.708754:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17254 00000100:00100000:0.0:1746140888.710434:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.710489:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573840768 00000100:00100000:2.0:1746140888.710499:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573840768 00000100:00100000:2.0:1746140888.710545:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10805 00000100:00100000:2.0:1746140888.710552:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:324:x1830960573840768:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140888.710567:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.710582:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5efc00/0x8156357b7fdbaf03 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d94 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.710672:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.710683:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.710692:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.710701:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.710706:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.710711:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.710982:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b5ee200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140888.710988:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.710995:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.711010:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140888.711012:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140888.711016:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.711022:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf0a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.711065:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5efc00/0x8156357b7fdbaf03 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d94 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.711072:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5efc00/0x8156357b7fdbaf03 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d94 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.711080:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5efc00, rc 0) 00000100:00100000:2.0:1746140888.711143:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:324:x1830960573840768:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 590us (715us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140888.711149:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10805 00000100:00100000:0.0:1746140888.712163:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.712338:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573840896 00000100:00100000:2.0:1746140888.712345:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573840896 00000100:00100000:2.0:1746140888.712420:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17255 00000100:00100000:2.0:1746140888.712427:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:321:x1830960573840896:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140888.712440:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.712453:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1d9b expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.712477:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 20 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.712484:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.712485:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.712489:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2400256->3145727] (req 2400256->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 18 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.712517:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 20 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.712528:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 20 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.712540:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576097792:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.712831:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.712931:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.713185:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573841152 00000100:00100000:3.0:1746140888.713191:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573841152 00000100:00100000:3.0:1746140888.713243:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4754 00000100:00100000:3.0:1746140888.713249:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:324:x1830960573841152:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746140888.713489:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:28b972ba-4133-49d1-b679-ce80456803d9+11:324:x1830960573841152:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 239us (557us total) trans 8589945119 rc 0/0 00000100:00100000:3.0:1746140888.713495:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4754 00000100:00100000:3.0:1746140888.713731:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576097792:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.713755:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2400256->3145727] (req 2400256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 18 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.713770:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ef600, rc 0) 00000100:00100000:3.0:1746140888.713790:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+18:321:x1830960573840896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1364us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.713796:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17255 00000100:00100000:0.0:1746140888.714619:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.714690:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573841280 00000100:00100000:1.0:1746140888.714699:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573841280 00002000:00100000:1.0:1746140888.714737:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->3252223) req@ffff88009b755c00 x1830960573841280/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.714746:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755c00 with x1830960573841280 ext(3145728->3252223) 00010000:00010000:1.0:1746140888.714754:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 21 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.714765:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 21 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:1.0:1746140888.714772:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b755c00 00000100:00100000:1.0:1746140888.714808:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1834 00000100:00100000:1.0:1746140888.714815:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960573841280:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140888.717392:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960573841280:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2570us (2767us total) trans 21474841475 rc 0/0 00000100:00100000:1.0:1746140888.717400:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1834 00002000:00100000:1.0:1746140888.717408:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->3252223) req@ffff88009b755c00 x1830960573841280/t21474841475(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.717414:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755c00 with x1830960573841280 ext(3145728->3252223) 00010000:00010000:1.0:1746140888.717421:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.717431:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:1.0:1746140888.717436:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b755c00 00000100:00100000:0.0:1746140888.719525:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.719682:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573841408 00000100:00100000:3.0:1746140888.719690:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573841408 00010000:00010000:3.0:1746140888.719724:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.720290:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8926 00000100:00100000:3.0:1746140888.720299:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960573841408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.720354:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.720375:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.720391:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.720413:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b5eec00/0x8156357b7fdbae93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d4e expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.720426:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.720428:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.720435:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 17 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.720442:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 17 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.720473:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 17 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.720483:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576097920:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.720561:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.722998:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576097920:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.723020:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.723067:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573841408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2768us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.723077:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8926 00000100:00100000:0.0:1746140888.723241:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.723380:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573841664 00000100:00100000:1.0:1746140888.723386:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573841664 00002000:00100000:1.0:1746140888.723418:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2400256->2404351) req@ffff88009b754700 x1830960573841664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.723426:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754700 with x1830960573841664 ext(2400256->2404351) 00002000:00010000:1.0:1746140888.723430:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b754700 00000100:00100000:1.0:1746140888.723443:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8835 00000100:00100000:1.0:1746140888.723447:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573841664:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140888.723888:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573841664:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 438us (646us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140888.723894:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8835 00002000:00100000:1.0:1746140888.723900:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2400256->2404351) req@ffff88009b754700 x1830960573841664/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.723907:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754700 with x1830960573841664 ext(2400256->2404351) 00002000:00010000:1.0:1746140888.723909:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b754700 00000100:00100000:0.0:1746140888.729384:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.729885:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573841792 00000100:00100000:3.0:1746140888.729894:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573841792 00000100:00100000:3.0:1746140888.729983:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17256 00000100:00100000:3.0:1746140888.729991:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:321:x1830960573841792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140888.730009:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.730034:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1da2 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.730062:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.730068:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.730070:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.730073:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 14 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.730103:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.730112:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 27 pid: 32377 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.730124:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576098048:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.730818:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4651240 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.732868:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.732953:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576098048:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.732984:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 14 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.733000:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ec00, rc 0) 00000100:00100000:3.0:1746140888.733051:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:321:x1830960573841792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3060us (3679us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.733063:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17256 00000100:00100000:1.0:1746140888.733128:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573841920 00000100:00100000:1.0:1746140888.733134:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573841920 00002000:00100000:1.0:1746140888.733167:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2658304->3145727) req@ffff88009b754380 x1830960573841920/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.733176:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754380 with x1830960573841920 ext(2658304->3145727) 00010000:00010000:1.0:1746140888.733183:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 28 pid: 32377 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.733195:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 28 pid: 32377 timeout: 967 lvb_type: 0 00002000:00010000:1.0:1746140888.733201:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b754380 00000100:00100000:1.0:1746140888.733214:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1835 00000100:00100000:1.0:1746140888.733221:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573841920:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140888.738792:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573841920:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5560us (5920us total) trans 17179874185 rc 0/0 00000100:00100000:1.0:1746140888.738804:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1835 00002000:00100000:1.0:1746140888.738816:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2658304->3145727) req@ffff88009b754380 x1830960573841920/t17179874185(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.738826:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754380 with x1830960573841920 ext(2658304->3145727) 00010000:00010000:1.0:1746140888.738835:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 30 pid: 32377 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.738853:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 30 pid: 32377 timeout: 967 lvb_type: 0 00002000:00010000:1.0:1746140888.738860:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b754380 00000100:00100000:0.0:1746140888.740675:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.740892:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573842048 00000100:00100000:3.0:1746140888.740900:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573842048 00010000:00010000:3.0:1746140888.740940:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 30 pid: 32377 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.740983:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8927 00000100:00100000:3.0:1746140888.740991:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573842048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.741005:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.741038:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 30 pid: 32377 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.741050:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 30 pid: 32377 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.741185:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbae5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d32 expref: 30 pid: 32377 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.741217:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.741219:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.741225:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 13 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.741234:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 13 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.741266:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 13 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.741278:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576098176:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.741380:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4651240 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.743192:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576098176:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.743216:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.743250:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573842048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2259us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.743259:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8927 00000100:00100000:0.0:1746140888.744423:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.744482:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573842304 00000100:00100000:1.0:1746140888.744490:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573842304 00002000:00100000:1.0:1746140888.744533:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2101248->2105343) req@ffff88009b754000 x1830960573842304/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.744544:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754000 with x1830960573842304 ext(2101248->2105343) 00002000:00010000:1.0:1746140888.744550:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754000 00000100:00100000:1.0:1746140888.744579:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8836 00000100:00100000:1.0:1746140888.744585:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573842304:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140888.744756:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573842304:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 171us (336us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140888.744763:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8836 00002000:00100000:1.0:1746140888.744768:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2101248->2105343) req@ffff88009b754000 x1830960573842304/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.744775:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754000 with x1830960573842304 ext(2101248->2105343) 00002000:00010000:1.0:1746140888.744778:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754000 00000100:00100000:0.0:1746140888.746264:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.746352:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573842560 00000100:00100000:3.0:1746140888.746359:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573842560 00000100:00100000:3.0:1746140888.746651:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4755 00000100:00100000:3.0:1746140888.746659:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+21:321:x1830960573842560:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140888.747020:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:321:x1830960573842560:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 361us (759us total) trans 8589945120 rc 0/0 00000100:00100000:3.0:1746140888.747034:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4755 00000100:00100000:0.0:1746140888.805874:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.806474:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573842816 00000100:00100000:2.0:1746140888.806484:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573842816 00000100:00100000:2.0:1746140888.806562:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10806 00000100:00100000:2.0:1746140888.806570:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:329:x1830960573842816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.806597:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.806615:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee800/0x8156357b7fdbaf1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1da9 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.806727:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806739:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806749:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806760:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806766:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806771:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806869:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806877:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806882:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140888.806891:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140888.806972:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806979:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806984:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806989:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b5ef000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140888.806993:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.806999:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807008:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140888.807010:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140888.807013:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807018:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef000/0x8156357b7fdbaf26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807064:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807069:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807073:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807077:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b5ef400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140888.807079:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807084:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807090:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f200) 00010000:00010000:2.0:1746140888.807092:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140888.807095:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807099:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ef400/0x8156357b7fdbaf2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140888.807132:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee800/0x8156357b7fdbaf1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 285 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.807143:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 284 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.807149:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140888.807152:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140888.807154:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ee000, rc 0) 00000100:00100000:2.0:1746140888.807225:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:329:x1830960573842816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 655us (1362us total) trans 8589945121 rc 0/0 00000100:00100000:2.0:1746140888.807232:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10806 00000100:00100000:0.0:1746140888.808950:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.809019:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.809097:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573842944 00000100:00100000:1.0:1746140888.809102:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573843072 00000100:00100000:3.0:1746140888.809105:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573842944 00000100:00100000:1.0:1746140888.809106:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573843072 00000100:00100000:1.0:1746140888.809171:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17257 00000100:00100000:1.0:1746140888.809178:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1982:x1830960573843072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.809196:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.809211:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801359dfe00/0x8156357b7fdbaf42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1db7 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.809256:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576098304:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140888.809901:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17258 00000100:00100000:3.0:1746140888.810036:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573842944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.810045:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.810055:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbaf49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1db0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.810082:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576098432:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140888.810516:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.810599:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.811362:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576098304:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140888.811379:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576098432:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140888.811385:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801359dfe00/0x8156357b7fdbaf42 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1db7 expref: 30 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.811397:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801359dfe00/0x8156357b7fdbaf42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1db7 expref: 30 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.811427:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801359dfe00, rc 0) 00010000:00010000:3.0:1746140888.811444:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbaf49 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1db0 expref: 23 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.811457:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbaf49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1db0 expref: 23 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140888.811464:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1982:x1830960573843072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2286us (2443us total) trans 0 rc 301/301 00010000:00010000:3.0:1746140888.811469:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ee00, rc 0) 00000100:00100000:1.0:1746140888.811471:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17257 00000100:00100000:3.0:1746140888.811489:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1982:x1830960573842944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1468us (2544us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140888.811494:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17258 00000100:00100000:0.0:1746140888.817981:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.818051:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.818066:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573843456 00000100:00100000:1.0:1746140888.818076:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573843456 00002000:00100000:1.0:1746140888.818123:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b756680 x1830960573843456/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.818134:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756680 with x1830960573843456 ext(1048576->2097151) 00002000:00010000:1.0:1746140888.818139:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756680 00000100:00100000:1.0:1746140888.818169:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573843584 00000100:00100000:1.0:1746140888.818171:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573843584 00002000:00100000:1.0:1746140888.818184:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880099495500 x1830960573843584/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.818191:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495500 with x1830960573843584 ext(0->1048575) 00002000:00010000:1.0:1746140888.818194:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099495500 00000100:00100000:1.0:1746140888.818216:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8837 00000100:00100000:1.0:1746140888.818223:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573843456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.818374:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8838 00000100:00100000:3.0:1746140888.818383:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573843584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.829597:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573843456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11362us (11618us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.829610:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8837 00002000:00100000:1.0:1746140888.829623:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009b756680 x1830960573843456/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.829632:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756680 with x1830960573843456 ext(1048576->2097151) 00002000:00010000:1.0:1746140888.829637:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756680 00000100:00100000:3.0:1746140888.830926:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960573843584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12541us (12870us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.830935:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8838 00002000:00100000:3.0:1746140888.830942:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880099495500 x1830960573843584/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.830951:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495500 with x1830960573843584 ext(0->1048575) 00002000:00010000:3.0:1746140888.830955:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099495500 00000100:00100000:0.0:1746140888.844614:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.844660:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.844692:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573843712 00000100:00100000:0.0:1746140888.844701:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573843712 00000100:00100000:0.0:1746140888.844737:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573843840 00000100:00100000:0.0:1746140888.844739:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573843840 00000100:00100000:0.0:1746140888.844754:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17259 00000100:00100000:0.0:1746140888.844761:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573843712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140888.844776:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140888.844792:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1dbe expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140888.844844:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576098560:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140888.846170:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17260 00000100:00100000:2.0:1746140888.846182:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1982:x1830960573843840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.846193:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.846208:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1dc5 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.846247:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576098688:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140888.846456:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119900 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.846620:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.858572:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.858641:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.858729:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576098688:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140888.858763:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf57 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dc5 expref: 30 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140888.858777:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b5ee200/0x8156357b7fdbaf57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dc5 expref: 30 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140888.858792:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ee200, rc 0) 00000100:00100000:0.0:1746140888.858836:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1982:x1830960573843840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 12657us (14174us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140888.858845:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17260 00000100:00100000:0.0:1746140888.858978:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573844096 00000100:00100000:0.0:1746140888.858984:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573844096 00000100:00100000:1.0:1746140888.858992:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576098560:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140888.859009:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf50 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dbe expref: 23 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140888.859012:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573844352 00000100:00100000:0.0:1746140888.859014:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573844352 00010000:00010000:1.0:1746140888.859019:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dbe expref: 23 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140888.859039:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10807 00010000:00010000:1.0:1746140888.859040:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d214400, rc 0) 00000100:00100000:0.0:1746140888.859045:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:334:x1830960573844096:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140888.859062:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1983:x1830960573843712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 14302us (14460us total) trans 0 rc 301/301 00010000:00010000:0.0:1746140888.859062:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140888.859067:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17259 00010000:00010000:0.0:1746140888.859077:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214000/0x8156357b7fdbaf5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1dcc expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.859132:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10808 00000100:00100000:1.0:1746140888.859140:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:333:x1830960573844352:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140888.859150:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.859156:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009441b800/0x8156357b7fdbaf65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1dd3 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.859178:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859190:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859200:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140888.859207:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140888.859211:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140888.859217:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.859220:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140888.859224:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 285 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.859225:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140888.859228:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140888.859255:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 285 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.859265:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 285 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.859276:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576098816:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140888.859340:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859347:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859357:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140888.859367:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140888.859441:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859447:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859453:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859458:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d214e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140888.859460:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859465:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859473:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140888.859476:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140888.859479:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859483:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214e00/0x8156357b7fdbaf6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859491:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859495:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859500:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859503:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d215a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140888.859505:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859510:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859515:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630a200) 00010000:00010000:0.0:1746140888.859517:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140888.859519:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.859523:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215a00/0x8156357b7fdbaf7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140888.859544:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.859553:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 10 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.859566:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576098944:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.859585:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbd80 going to sleep for 11 seconds 00010000:00010000:0.0:1746140888.860083:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214000/0x8156357b7fdbaf5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 25 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.860099:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 24 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.860105:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140888.860107:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140888.860109:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d215800, rc 0) 00000100:00100000:0.0:1746140888.860319:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+24:334:x1830960573844096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1258us (1744us total) trans 8589945122 rc 0/0 00000100:00100000:0.0:1746140888.860325:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10807 00000100:00100000:2.0:1746140888.864223:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.864366:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576098816:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.864378:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576098944:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140888.864685:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573844480 00000100:00100000:0.0:1746140888.864692:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573844480 00000100:00100000:0.0:1746140888.864743:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17261 00000100:00100000:0.0:1746140888.864751:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:329:x1830960573844480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140888.864771:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140888.864787:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1dda expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.864817:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 17 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.864824:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140888.864825:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140888.864828:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 23 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.864853:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 17 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.864866:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 17 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:0.0:1746140888.864878:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576099072:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140888.865727:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746140888.866585:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140888.866626:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.866667:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.866690:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.866718:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573844608 00000100:00100000:3.0:1746140888.866725:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573844608 00000100:00100000:2.0:1746140888.866741:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573844736 00000100:00100000:2.0:1746140888.866746:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573844736 00010000:00010000:3.0:1746140888.866755:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.866763:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 286 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.866778:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8928 00000100:00100000:2.0:1746140888.866783:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8929 00000100:00100000:3.0:1746140888.866785:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573844608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140888.866788:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:1982:x1830960573844736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.866796:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.866796:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.866800:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 286 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.866801:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.866808:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 286 pid: 14785 timeout: 967 lvb_type: 0 00000100:00100000:0.0:1746140888.866994:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573844992 00000100:00100000:0.0:1746140888.866998:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573844992 00000100:00100000:0.0:1746140888.867022:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10809 00000100:00100000:0.0:1746140888.867051:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+24:336:x1830960573844992:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140888.867071:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140888.867083:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215c00/0x8156357b7fdbaf96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1de1 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.867288:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.867331:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5ee000/0x8156357b7fdbaf34 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da9 expref: 286 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.867674:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.867684:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.867692:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.867704:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.867709:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.867714:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.867830:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099607c00/0x8156357b7fdbafab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140888.867870:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b5eea00/0x8156357b7fdbaeee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d7f expref: 11 pid: 14785 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.867881:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140888.867887:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140888.867896:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140888.867902:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140888.867909:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140888.867912:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140888.867989:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.868005:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573845248 00000100:00100000:1.0:1746140888.868009:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573845248 00010000:00010000:2.0:1746140888.868011:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140888.868038:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140888.868044:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:1.0:1746140888.868046:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17262 00000100:00100000:1.0:1746140888.868051:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+18:334:x1830960573845248:12345-192.168.204.16@tcp:101:cat.0 00000004:00200000:2.0:1746140888.868060:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140888.868061:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.868072:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1de8 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.868090:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140888.868095:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.868105:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.868114:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521b200, rc 0) 00000100:00100000:1.0:1746140888.868152:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+19:334:x1830960573845248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 101us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.868158:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17262 00010000:00010000:2.0:1746140888.868192:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009441b800/0x8156357b7fdbaf65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 287 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.868203:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 286 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.868210:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140888.868213:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140888.868214:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009441ba00, rc 0) 00000100:00100000:1.0:1746140888.868229:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.868242:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:333:x1830960573844352:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9104us (9600us total) trans 8589945123 rc 0/0 00000100:00100000:2.0:1746140888.868248:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10808 00000100:00100000:2.0:1746140888.868278:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1982:x1830960573844736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1490us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.868284:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8929 00000100:00100000:2.0:1746140888.868339:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573845120 00000100:00100000:2.0:1746140888.868342:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573845120 00002000:00100000:2.0:1746140888.868364:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2400256->3145727) req@ffff8801359b2a00 x1830960573845120/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.868373:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b2a00 with x1830960573845120 ext(2400256->3145727) 00010000:00010000:2.0:1746140888.868378:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 19 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.868388:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 19 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.868394:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801359b2a00 00000100:00100000:3.0:1746140888.868407:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573844608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1622us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.868411:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1836 00000100:00100000:3.0:1746140888.868414:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8928 00000100:00100000:2.0:1746140888.868416:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573845120:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140888.868475:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576099072:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140888.868492:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 23 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.868500:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d214a00, rc 0) 00000100:00100000:3.0:1746140888.868515:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:329:x1830960573844480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3766us (4306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.868520:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17261 00010000:00010000:0.0:1746140888.868658:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099607c00/0x8156357b7fdbafab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868666:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099607c00/0x8156357b7fdbafab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140888.868673:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140888.868718:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868723:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868729:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868734:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d214400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140888.868737:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868743:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868750:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140888.868752:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140888.868755:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868760:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214400/0x8156357b7fdbaf9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868771:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868776:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868781:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868785:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009441a000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140888.868787:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868791:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868796:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630a500) 00010000:00010000:0.0:1746140888.868798:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140888.868800:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868804:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009441a000/0x8156357b7fdbafa4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140888.868829:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215c00/0x8156357b7fdbaf96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de1 expref: 27 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.868838:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099607c00/0x8156357b7fdbafab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de1 expref: 26 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140888.868842:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140888.868844:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140888.868846:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099607c00, rc 0) 00000100:00100000:0.0:1746140888.868862:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:336:x1830960573844992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1811us (2193us total) trans 8589945124 rc 0/0 00000100:00100000:0.0:1746140888.868867:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10809 00000100:00100000:1.0:1746140888.872141:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.872384:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573845376 00000100:00100000:3.0:1746140888.872393:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573845376 00000100:00100000:3.0:1746140888.872457:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 783 00000100:00100000:3.0:1746140888.872465:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573845376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.872478:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.872501:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099607c00/0x8156357b7fdbafab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de1 expref: 26 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.872518:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140888.872522:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.872719:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573845376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 254us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.872731:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 783 00000100:00100000:0.0:1746140888.881834:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573845120:12345-192.168.204.16@tcp:4:cat.0 Request processed in 13402us (13588us total) trans 21474841476 rc 0/0 00000100:00100000:0.0:1746140888.881849:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1836 00002000:00100000:0.0:1746140888.881861:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (2400256->3145727) req@ffff8801359b2a00 x1830960573845120/t21474841476(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140888.881862:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:0.0:1746140888.881872:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b2a00 with x1830960573845120 ext(2400256->3145727) 00010000:00010000:0.0:1746140888.881882:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 21 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.881897:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 21 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.881905:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801359b2a00 00000100:00100000:1.0:1746140888.881993:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.882012:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573845504 00000100:00100000:2.0:1746140888.882020:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573845504 00000100:00100000:2.0:1746140888.882065:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573845632 00000100:00100000:2.0:1746140888.882067:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573845632 00000100:00100000:2.0:1746140888.882083:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17263 00000100:00100000:2.0:1746140888.882089:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:336:x1830960573845504:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140888.882101:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.882115:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1def expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.882136:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.882138:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.882142:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->4128767] (req 3842048->4128767) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 22 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.882153:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->4128767] (req 3842048->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 22 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.882160:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17264 00010000:00010000:2.0:1746140888.882162:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5ee400, rc 0) 00000100:00100000:1.0:1746140888.882168:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:333:x1830960573845632:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140888.882176:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140888.882183:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+22:336:x1830960573845504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 95us (323us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140888.882187:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1df6 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.882188:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17263 00010000:00010000:1.0:1746140888.882210:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 13 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.882218:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140888.882219:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140888.882222:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.882247:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 13 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.882257:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 13 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:1.0:1746140888.882268:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576099200:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.882344:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.883961:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576099200:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140888.883985:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.883997:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a521b600, rc 0) 00000100:00100000:2.0:1746140888.884044:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:333:x1830960573845632:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1877us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140888.884046:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.884054:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17264 00000100:00100000:0.0:1746140888.884094:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.884117:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573845888 00000100:00100000:0.0:1746140888.884121:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573845888 00002000:00100000:0.0:1746140888.884158:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2105343) req@ffff880099494e00 x1830960573845888/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 8680/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.884168:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494e00 with x1830960573845888 ext(2097152->2105343) 00010000:00010000:0.0:1746140888.884174:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 14 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.884185:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 14 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.884191:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099494e00 00000100:00100000:0.0:1746140888.884209:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1837 00000100:00100000:0.0:1746140888.884215:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960573845888:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140888.884397:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573845760 00000100:00100000:2.0:1746140888.884401:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573845760 00010000:00010000:2.0:1746140888.884416:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 22 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.884512:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8930 00000100:00100000:2.0:1746140888.884517:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573845760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.884525:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.884540:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 22 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.884548:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 22 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:0.0:1746140888.884573:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573845888:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 358us (526us total) trans 17179874186 rc 0/0 00000100:00100000:0.0:1746140888.884579:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1837 00002000:00100000:0.0:1746140888.884584:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2105343) req@ffff880099494e00 x1830960573845888/t17179874186(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 8680/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.884592:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494e00 with x1830960573845888 ext(2097152->2105343) 00010000:00010000:0.0:1746140888.884596:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 16 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.884606:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 16 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.884611:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099494e00 00010000:00010000:2.0:1746140888.884650:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ef600/0x8156357b7fdbaf11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2400256->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d9b expref: 22 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.884667:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.884669:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.884676:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 22 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.884684:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 22 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.884690:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.884692:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.884694:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.884701:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.884705:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.884705:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.884708:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.884713:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.884733:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 21 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.884741:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576099328:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.885233:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 21 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.885241:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576099456:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.885327:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 22 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.885337:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576099584:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.885374:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00000100:00100000:1.0:1746140888.886047:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.886121:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573846016 00000100:00100000:3.0:1746140888.886129:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573846016 00010000:00010000:3.0:1746140888.886157:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 16 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.886187:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8931 00000100:00100000:3.0:1746140888.886194:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1983:x1830960573846016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.886205:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.886223:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 16 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.886233:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 16 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.886251:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ec00/0x8156357b7fdbaf18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1da2 expref: 16 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.886279:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.886281:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.886287:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.886294:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.886360:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.886370:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576099712:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.886439:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.886696:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576099328:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140888.890105:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.890166:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573846272 00000100:00100000:2.0:1746140888.890175:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573846272 00000100:00100000:0.0:1746140888.890176:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.890204:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140888.890213:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3842048->3846143) req@ffff880099496300 x1830960573846272/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.890221:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496300 with x1830960573846272 ext(3842048->3846143) 00002000:00010000:2.0:1746140888.890226:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099496300 00000100:00100000:0.0:1746140888.890246:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.890259:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573846528 00000100:00100000:2.0:1746140888.890260:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573846528 00002000:00100000:2.0:1746140888.890270:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099494a80 x1830960573846528/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.890274:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494a80 with x1830960573846528 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.890276:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099494a80 00000100:00100000:2.0:1746140888.890283:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573846784 00000100:00100000:2.0:1746140888.890284:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573846784 00002000:00100000:2.0:1746140888.890291:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3960832->3964927) req@ffff880099496680 x1830960573846784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.890295:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496680 with x1830960573846784 ext(3960832->3964927) 00002000:00010000:2.0:1746140888.890297:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099496680 00000100:00100000:2.0:1746140888.890327:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573847040 00000100:00100000:2.0:1746140888.890330:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573847040 00002000:00100000:2.0:1746140888.890340:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099496d80 x1830960573847040/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.890346:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496d80 with x1830960573847040 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.890348:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099496d80 00000100:00100000:3.0:1746140888.890353:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576099456:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.890360:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8839 00000100:00100000:3.0:1746140888.890364:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576099584:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140888.890368:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573846272:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:3.0:1746140888.890387:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.890429:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573845760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5911us (6333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.890442:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8930 00000100:00100000:1.0:1746140888.890485:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8840 00000100:00100000:1.0:1746140888.890493:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573846528:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140888.890515:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573846272:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 149us (422us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140888.890520:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8839 00002000:00100000:2.0:1746140888.890525:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3842048->3846143) req@ffff880099496300 x1830960573846272/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.890531:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496300 with x1830960573846272 ext(3842048->3846143) 00002000:00010000:2.0:1746140888.890533:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099496300 00000100:00100000:0.0:1746140888.890534:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8841 00000100:00100000:0.0:1746140888.890541:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573846784:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140888.890542:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8842 00000100:00100000:2.0:1746140888.890546:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1982:x1830960573847040:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140888.890623:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576099712:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.890638:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.890661:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1983:x1830960573846016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4467us (4624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.890667:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8931 00000100:00100000:0.0:1746140888.890754:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573846784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 213us (549us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140888.890760:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8841 00002000:00100000:0.0:1746140888.890765:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3960832->3964927) req@ffff880099496680 x1830960573846784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.890773:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496680 with x1830960573846784 ext(3960832->3964927) 00002000:00010000:0.0:1746140888.890776:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099496680 00000100:00100000:0.0:1746140888.894816:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.895467:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.895510:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573847296 00000100:00100000:1.0:1746140888.895510:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573847424 00000100:00100000:2.0:1746140888.895519:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573847296 00000100:00100000:1.0:1746140888.895519:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573847424 00002000:00100000:1.0:1746140888.895560:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4124672->4128767) req@ffff880099497100 x1830960573847424/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746140888.895566:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17265 00002000:00100000:1.0:1746140888.895570:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497100 with x1830960573847424 ext(4124672->4128767) 00000100:00100000:2.0:1746140888.895573:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:333:x1830960573847296:12345-192.168.204.16@tcp:101:multiop.0 00002000:00010000:1.0:1746140888.895575:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497100 00010000:00010000:2.0:1746140888.895586:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140888.895586:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8843 00000100:00100000:1.0:1746140888.895590:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573847424:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:2.0:1746140888.895604:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1dfd expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.895627:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.895635:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.895637:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.895639:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4268031] (req 4194304->4268031) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.895670:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.895681:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.895691:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576099840:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.895726:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573847424:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 135us (260us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140888.895732:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8843 00002000:00100000:1.0:1746140888.895737:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4124672->4128767) req@ffff880099497100 x1830960573847424/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.895744:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497100 with x1830960573847424 ext(4124672->4128767) 00010000:00010000:1.0:1746140888.895749:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.895759:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:1.0:1746140888.895764:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099497100 00000100:00100000:2.0:1746140888.896263:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.899583:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576099840:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140888.899614:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4268031] (req 4194304->4268031) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.899632:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d214800, rc 0) 00000100:00100000:2.0:1746140888.899690:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:333:x1830960573847296:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4116us (4884us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.899698:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17265 00000100:00100000:1.0:1746140888.901105:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573846528:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10608us (10923us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.901115:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8840 00002000:00100000:1.0:1746140888.901125:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099494a80 x1830960573846528/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.901135:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099494a80 with x1830960573846528 ext(2097152->3145727) 00002000:00010000:1.0:1746140888.901141:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099494a80 00000100:00100000:1.0:1746140888.901625:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1982:x1830960573847040:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11069us (11370us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.901637:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8842 00002000:00100000:1.0:1746140888.901646:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880099496d80 x1830960573847040/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.901656:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496d80 with x1830960573847040 ext(2097152->3145727) 00002000:00010000:1.0:1746140888.901661:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099496d80 00000100:00100000:0.0:1746140888.901732:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.901781:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573847936 00000100:00100000:2.0:1746140888.901788:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573847936 00000100:00100000:2.0:1746140888.902017:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4756 00000100:00100000:2.0:1746140888.902032:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:336:x1830960573847936:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140888.902219:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+26:336:x1830960573847936:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 196us (488us total) trans 8589945125 rc 0/0 00000100:00100000:2.0:1746140888.902225:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4756 00000100:00100000:0.0:1746140888.902430:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.902492:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573847680 00000100:00100000:1.0:1746140888.902499:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573847680 00002000:00100000:1.0:1746140888.902530:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3842048->4128767) req@ffff880099495c00 x1830960573847680/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.902538:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495c00 with x1830960573847680 ext(3842048->4128767) 00010000:00010000:1.0:1746140888.902546:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 21 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.902559:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 21 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:1.0:1746140888.902565:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099495c00 00000100:00100000:1.0:1746140888.902580:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1838 00000100:00100000:1.0:1746140888.902586:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573847680:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140888.904369:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.904676:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573848064 00000100:00100000:2.0:1746140888.904685:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573848064 00000100:00100000:2.0:1746140888.904724:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17266 00000100:00100000:2.0:1746140888.904730:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+15:334:x1830960573848064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.904744:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.904760:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e04 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.904786:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.904793:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.904795:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140888.904798:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.904824:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140888.904836:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 29 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:2.0:1746140888.904847:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576099968:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140888.904925:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746140888.909119:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.909219:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.909238:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573848320 00000100:00100000:0.0:1746140888.909245:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573848320 00002000:00100000:0.0:1746140888.909280:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b06b100 x1830960573848320/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.909290:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06b100 with x1830960573848320 ext(2097152->3145727) 00010000:00010000:0.0:1746140888.909299:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 30 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.909333:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 30 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.909344:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b06b100 00000100:00100000:0.0:1746140888.909360:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573848448 00000100:00100000:0.0:1746140888.909362:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573848448 00000100:00100000:1.0:1746140888.909367:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1839 00002000:00100000:0.0:1746140888.909374:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3960832->4194303) req@ffff88012b068700 x1830960573848448/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746140888.909376:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576099968:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.909377:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573848320:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:0.0:1746140888.909381:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068700 with x1830960573848448 ext(3960832->4194303) 00010000:00010000:0.0:1746140888.909385:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 31 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.909391:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 31 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.909396:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b068700 00000100:00100000:0.0:1746140888.909405:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1840 00010000:00010000:3.0:1746140888.909406:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 16 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140888.909408:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573848448:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:3.0:1746140888.909422:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d214200, rc 0) 00000100:00100000:3.0:1746140888.909473:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+16:334:x1830960573848064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4742us (5108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.909480:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17266 00000100:00100000:3.0:1746140888.909607:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.909633:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573848576 00000100:00100000:3.0:1746140888.909638:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573848576 00000100:00100000:3.0:1746140888.909674:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17267 00000100:00100000:3.0:1746140888.909681:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:329:x1830960573848576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.909693:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.909705:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e0b expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.909722:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.909726:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 34 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.909733:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 34 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.909740:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7dc00, rc 0) 00000100:00100000:3.0:1746140888.909754:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:329:x1830960573848576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 74us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.909759:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17267 00000100:00100000:2.0:1746140888.911909:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573847680:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9312us (9467us total) trans 21474841477 rc 0/0 00000100:00100000:2.0:1746140888.911922:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1838 00002000:00100000:2.0:1746140888.911934:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3842048->4128767) req@ffff880099495c00 x1830960573847680/t21474841477(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.911944:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495c00 with x1830960573847680 ext(3842048->4128767) 00010000:00010000:2.0:1746140888.911953:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:2.0:1746140888.911965:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00002000:00010000:2.0:1746140888.911972:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099495c00 00000100:00100000:0.0:1746140888.914052:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573848448:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4632us (4822us total) trans 17179874187 rc 0/0 00000100:00100000:0.0:1746140888.914062:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1840 00002000:00100000:0.0:1746140888.914071:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3960832->4194303) req@ffff88012b068700 x1830960573848448/t17179874187(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140888.914080:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068700 with x1830960573848448 ext(3960832->4194303) 00010000:00010000:0.0:1746140888.914089:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 35 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:0.0:1746140888.914106:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 35 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:0.0:1746140888.914112:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b068700 00000100:00100000:0.0:1746140888.915158:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.915203:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573848704 00000100:00100000:3.0:1746140888.915211:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573848704 00010000:00010000:3.0:1746140888.915243:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.915272:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8932 00000100:00100000:3.0:1746140888.915279:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573848704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.915295:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.915341:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.915351:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.915371:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b5ee400/0x8156357b7fdbafc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3842048->18446744073709551615] (req 3842048->4128767) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1def expref: 23 pid: 4782 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.915399:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.915401:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.915408:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.915416:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.915447:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.915457:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576100096:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.915588:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.918421:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576100096:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.918443:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140888.918478:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573848320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9102us (9369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.918489:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1839 00002000:00100000:1.0:1746140888.918500:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b06b100 x1830960573848320/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.918509:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06b100 with x1830960573848320 ext(2097152->3145727) 00010000:00010000:1.0:1746140888.918519:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 33 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:1.0:1746140888.918532:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 33 pid: 20960 timeout: 967 lvb_type: 0 00002000:00010000:1.0:1746140888.918539:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b06b100 00000100:00100000:3.0:1746140888.918542:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573848704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3262us (3384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.918551:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8932 00000100:00100000:0.0:1746140888.918861:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.918896:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573848960 00000100:00100000:1.0:1746140888.918902:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573848960 00002000:00100000:1.0:1746140888.918928:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4263936->4268031) req@ffff88012b069c00 x1830960573848960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.918935:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069c00 with x1830960573848960 ext(4263936->4268031) 00002000:00010000:1.0:1746140888.918938:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b069c00 00000100:00100000:1.0:1746140888.918956:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8844 00000100:00100000:1.0:1746140888.918963:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1983:x1830960573848960:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140888.919097:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1983:x1830960573848960:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 136us (238us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140888.919102:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8844 00002000:00100000:1.0:1746140888.919105:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4263936->4268031) req@ffff88012b069c00 x1830960573848960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.919109:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069c00 with x1830960573848960 ext(4263936->4268031) 00002000:00010000:1.0:1746140888.919111:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b069c00 00000100:00100000:2.0:1746140888.922712:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.922776:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573849088 00000100:00100000:3.0:1746140888.922784:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573849088 00010000:00010000:3.0:1746140888.922818:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 33 pid: 20960 timeout: 967 lvb_type: 0 00000100:00100000:3.0:1746140888.922855:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8933 00000100:00100000:3.0:1746140888.922863:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573849088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140888.922876:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140888.923236:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 33 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.923248:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 33 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.923268:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a521b600/0x8156357b7fdbafce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3960832->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1df6 expref: 33 pid: 20960 timeout: 967 lvb_type: 0 00010000:00010000:3.0:1746140888.923290:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.923292:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.923299:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.923328:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.923335:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.923337:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.923339:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 32 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.923345:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 32 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.923371:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 32 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.923382:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576100224:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.924996:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 15 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.925012:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576100352:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.925042:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.927637:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576100352:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.927652:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576100224:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140888.928422:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140888.928486:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573849088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5622us (5777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.928497:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8933 00000100:00100000:0.0:1746140888.928948:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.929391:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.929597:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573849344 00000100:00100000:2.0:1746140888.929605:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573849344 00002000:00100000:2.0:1746140888.929640:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b06a680 x1830960573849344/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.929650:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06a680 with x1830960573849344 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.929655:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b06a680 00000100:00100000:2.0:1746140888.929677:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573849600 00000100:00100000:2.0:1746140888.929680:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573849600 00002000:00100000:2.0:1746140888.929692:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b069f80 x1830960573849600/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.929699:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069f80 with x1830960573849600 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.929702:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b069f80 00000100:00100000:2.0:1746140888.929714:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8845 00000100:00100000:2.0:1746140888.929720:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573849344:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140888.929772:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8846 00000100:00100000:3.0:1746140888.929816:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573849600:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140888.935341:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573849600:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5551us (5941us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140888.935355:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8846 00002000:00100000:3.0:1746140888.935366:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b069f80 x1830960573849600/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.935376:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069f80 with x1830960573849600 ext(2097152->3145727) 00002000:00010000:3.0:1746140888.935382:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b069f80 00000100:00100000:2.0:1746140888.936129:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573849344:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6406us (7180us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140888.936137:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8845 00002000:00100000:2.0:1746140888.936143:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b06a680 x1830960573849344/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.936151:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b06a680 with x1830960573849344 ext(2097152->3145727) 00002000:00010000:2.0:1746140888.936156:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b06a680 00000100:00100000:0.0:1746140888.940278:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.940435:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573849728 00000100:00100000:3.0:1746140888.940445:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573849728 00000100:00100000:0.0:1746140888.940445:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.941596:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573849856 00000100:00100000:3.0:1746140888.941601:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573849856 00000100:00100000:1.0:1746140888.941607:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17268 00000100:00100000:1.0:1746140888.941619:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+22:334:x1830960573849728:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140888.941626:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17269 00000100:00100000:3.0:1746140888.941631:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:329:x1830960573849856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140888.941637:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.941638:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.941654:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e19 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.941655:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e12 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.941678:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.941767:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.941776:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.941791:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.941793:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140888.941798:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.941808:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.941808:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.941818:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e5b5400, rc 0) 00010000:00010000:3.0:1746140888.941819:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c400, rc 0) 00000100:00100000:3.0:1746140888.942066:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:329:x1830960573849856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 434us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.942066:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:334:x1830960573849728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 450us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140888.942072:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17268 00000100:00100000:3.0:1746140888.942075:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17269 00000100:00100000:0.0:1746140888.946475:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.946510:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.946557:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.946623:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573850752 00000100:00100000:2.0:1746140888.946623:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573850240 00000100:00100000:1.0:1746140888.946623:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573850624 00000100:00100000:3.0:1746140888.946632:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573850752 00000100:00100000:2.0:1746140888.946632:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573850240 00000100:00100000:1.0:1746140888.946632:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573850624 00002000:00100000:2.0:1746140888.946671:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b068000 x1830960573850240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.946671:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b069500 x1830960573850624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.946672:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b068a80 x1830960573850752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.946681:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068a80 with x1830960573850752 ext(3145728->4194303) 00002000:00100000:2.0:1746140888.946681:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068000 with x1830960573850240 ext(3145728->4194303) 00002000:00100000:1.0:1746140888.946681:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069500 with x1830960573850624 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.946685:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b069500 00002000:00010000:3.0:1746140888.946686:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b068a80 00002000:00010000:2.0:1746140888.946686:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b068000 00000100:00100000:3.0:1746140888.946714:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8847 00000100:00100000:2.0:1746140888.946719:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8848 00000100:00100000:3.0:1746140888.946721:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573850752:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140888.946725:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573850240:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140888.946796:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8849 00000100:00100000:0.0:1746140888.946803:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1983:x1830960573850624:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140888.948155:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.948260:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573850880 00000100:00100000:1.0:1746140888.948265:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573850880 00002000:00100000:1.0:1746140888.948287:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b068380 x1830960573850880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.948296:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068380 with x1830960573850880 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.948300:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b068380 00000100:00100000:1.0:1746140888.948428:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8850 00000100:00100000:1.0:1746140888.948435:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573850880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140888.954446:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573850240:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7708us (7967us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140888.954461:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8848 00002000:00100000:2.0:1746140888.954474:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b068000 x1830960573850240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.954485:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068000 with x1830960573850240 ext(3145728->4194303) 00002000:00010000:2.0:1746140888.954491:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b068000 00000100:00100000:2.0:1746140888.957503:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1983:x1830960573850624:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10687us (10978us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140888.957517:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8849 00002000:00100000:2.0:1746140888.957532:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012b069500 x1830960573850624/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.957544:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b069500 with x1830960573850624 ext(3145728->4194303) 00002000:00010000:2.0:1746140888.957552:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b069500 00000100:00100000:3.0:1746140888.964886:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573850752:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 18158us (18320us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.965224:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573850880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 16789us (17070us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140888.965235:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8850 00002000:00100000:1.0:1746140888.965246:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b068380 x1830960573850880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.965254:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068380 with x1830960573850880 ext(3145728->4194303) 00002000:00010000:1.0:1746140888.965260:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b068380 00000100:00100000:3.0:1746140888.965331:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8847 00002000:00100000:3.0:1746140888.965336:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b068a80 x1830960573850752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.965343:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b068a80 with x1830960573850752 ext(3145728->4194303) 00002000:00010000:3.0:1746140888.965346:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b068a80 00000100:00100000:0.0:1746140888.968254:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.968302:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.968403:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573851008 00000100:00100000:1.0:1746140888.968412:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573851008 00000100:00100000:1.0:1746140888.968522:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573851136 00000100:00100000:1.0:1746140888.968525:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573851136 00000100:00100000:1.0:1746140888.968618:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17270 00000100:00100000:3.0:1746140888.968623:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17271 00000100:00100000:1.0:1746140888.968624:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573851008:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140888.968630:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573851136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.968642:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140888.968642:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.968658:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbaff8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e27 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140888.968658:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f773400/0x8156357b7fdbafff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e20 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140888.968703:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576100480:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140888.968759:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576100608:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140888.968866:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.968918:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140888.970973:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576100480:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140888.971013:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbaff8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e27 expref: 24 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140888.971040:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576100608:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140888.971041:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7d400/0x8156357b7fdbaff8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e27 expref: 24 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.971062:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f773400/0x8156357b7fdbafff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e20 expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.971069:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7d400, rc 0) 00010000:00010000:1.0:1746140888.971071:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f773400/0x8156357b7fdbafff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e20 expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140888.971083:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f773400, rc 0) 00000100:00100000:1.0:1746140888.971129:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573851008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2503us (2879us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140888.971137:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17270 00000100:00100000:3.0:1746140888.971257:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573851136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2627us (2953us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140888.971263:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17271 00000100:00100000:0.0:1746140888.975240:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.975346:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.975475:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573851264 00000100:00100000:3.0:1746140888.975485:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573851264 00000100:00100000:3.0:1746140888.975541:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17272 00000100:00100000:3.0:1746140888.975548:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+23:334:x1830960573851264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140888.975566:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140888.975585:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e2e expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.975617:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.975630:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.975632:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140888.975635:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->4886527] (req 4194304->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.975674:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.975688:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 24 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140888.975701:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576100736:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140888.975793:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.975875:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573851520 00000100:00100000:2.0:1746140888.975880:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573851520 00002000:00100000:2.0:1746140888.975918:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4268032->4886527) req@ffff8800a51cdc00 x1830960573851520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140888.975928:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cdc00 with x1830960573851520 ext(4268032->4886527) 00010000:00010000:2.0:1746140888.975938:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140888.975951:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00002000:00010000:2.0:1746140888.975958:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cdc00 00000100:00100000:2.0:1746140888.976113:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1841 00000100:00100000:2.0:1746140888.976119:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573851520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.977552:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576100736:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140888.977553:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140888.977573:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573851648 00010000:00010000:3.0:1746140888.977577:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->4886527] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140888.977577:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573851648 00010000:00010000:3.0:1746140888.977593:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c200, rc 0) 00002000:00100000:1.0:1746140888.977606:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4268031) req@ffff8801359b0e00 x1830960573851648/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.977611:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0e00 with x1830960573851648 ext(4194304->4268031) 00010000:00010000:1.0:1746140888.977616:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140888.977712:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00002000:00010000:1.0:1746140888.977717:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801359b0e00 00000100:00100000:1.0:1746140888.977730:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1842 00000100:00100000:1.0:1746140888.977736:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573851648:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140888.977962:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+24:334:x1830960573851264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2413us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.977969:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17272 00000100:00100000:1.0:1746140888.981711:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573851648:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3963us (4151us total) trans 21474841478 rc 0/0 00000100:00100000:1.0:1746140888.981720:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1842 00002000:00100000:1.0:1746140888.981729:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4268031) req@ffff8801359b0e00 x1830960573851648/t21474841478(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/448 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.981736:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0e00 with x1830960573851648 ext(4194304->4268031) 00010000:00010000:1.0:1746140888.981745:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140888.981757:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140888.981760:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573851520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5640us (6413us total) trans 0 rc 618496/618496 00002000:00010000:1.0:1746140888.981762:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801359b0e00 00000100:00100000:3.0:1746140888.981767:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1841 00002000:00100000:3.0:1746140888.981773:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4268032->4886527) req@ffff8800a51cdc00 x1830960573851520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:H/200/0 rc 618496/618496 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.981781:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cdc00 with x1830960573851520 ext(4268032->4886527) 00010000:00010000:3.0:1746140888.981787:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140888.981798:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140888.981804:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cdc00 00000100:00100000:0.0:1746140888.984553:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.984670:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.984735:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573851904 00000100:00100000:2.0:1746140888.984744:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573851904 00010000:00010000:2.0:1746140888.984778:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140888.984799:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8934 00000100:00100000:2.0:1746140888.984805:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573851904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140888.984816:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140888.984846:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140888.984858:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140888.984863:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573851776 00000100:00100000:3.0:1746140888.984868:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573851776 00010000:00010000:2.0:1746140888.984882:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d214800/0x8156357b7fdbafd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dfd expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140888.984909:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17273 00010000:00010000:2.0:1746140888.984915:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140888.984916:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573851776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140888.984917:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140888.984925:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.984930:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140888.984937:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.984941:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e35 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140888.984956:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.984958:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140888.984964:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.984976:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140888.984984:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7d200, rc 0) 00010000:00010000:2.0:1746140888.984996:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140888.985008:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576100864:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140888.985048:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1983:x1830960573851776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 133us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140888.985054:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17273 00000100:00100000:2.0:1746140888.985082:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140888.986465:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576100864:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140888.986481:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140888.986520:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573851904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1713us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140888.986531:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8934 00000100:00100000:0.0:1746140888.990743:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140888.990806:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140888.990961:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573852160 00000100:00100000:3.0:1746140888.990969:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573852160 00000100:00100000:1.0:1746140888.990995:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573852416 00000100:00100000:1.0:1746140888.990999:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573852416 00002000:00100000:3.0:1746140888.991007:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff8800a51cca80 x1830960573852160/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.991014:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cca80 with x1830960573852160 ext(4882432->4886527) 00002000:00010000:3.0:1746140888.991018:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cca80 00002000:00100000:1.0:1746140888.991020:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8800a51cd180 x1830960573852416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/0 e 0 to 0 dl 1746140899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.991036:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cd180 with x1830960573852416 ext(4194304->4886527) 00002000:00010000:1.0:1746140888.991040:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cd180 00000100:00100000:3.0:1746140888.991052:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8851 00000100:00100000:3.0:1746140888.991057:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573852160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140888.991057:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8852 00000100:00100000:1.0:1746140888.991063:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573852416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140888.991210:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573852160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 153us (481us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140888.991214:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8851 00002000:00100000:3.0:1746140888.991218:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4882432->4886527) req@ffff8800a51cca80 x1830960573852160/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140888.991222:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cca80 with x1830960573852160 ext(4882432->4886527) 00002000:00010000:3.0:1746140888.991224:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cca80 00000100:00100000:0.0:1746140888.996896:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140888.996998:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573852672 00000100:00100000:2.0:1746140888.997008:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573852672 00000100:00100000:2.0:1746140888.997068:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4757 00000100:00100000:2.0:1746140888.997075:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:329:x1830960573852672:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140888.997122:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573852416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6050us (6306us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140888.997135:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8852 00002000:00100000:1.0:1746140888.997146:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8800a51cd180 x1830960573852416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:304/0 lens 488/440 e 0 to 0 dl 1746140899 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140888.997157:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cd180 with x1830960573852416 ext(4194304->4886527) 00002000:00010000:1.0:1746140888.997164:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51cd180 00000100:00100000:2.0:1746140888.997731:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:329:x1830960573852672:12345-192.168.204.16@tcp:35:cat.0 Request processed in 655us (847us total) trans 8589945126 rc 0/0 00000100:00100000:2.0:1746140888.997738:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4757 00000100:00100000:0.0:1746140889.002684:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.003251:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573852928 00000100:00100000:2.0:1746140889.003261:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573852928 00000100:00100000:0.0:1746140889.003428:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4758 00000100:00100000:0.0:1746140889.003438:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+26:334:x1830960573852928:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746140889.004190:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:334:x1830960573852928:12345-192.168.204.16@tcp:35:cat.0 Request processed in 752us (1513us total) trans 8589945127 rc 0/0 00000100:00100000:0.0:1746140889.004198:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4758 00000100:00100000:0.0:1746140889.025709:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.025805:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.025932:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573853056 00000100:00100000:1.0:1746140889.025948:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573853056 00000100:00100000:3.0:1746140889.025952:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573853312 00000100:00100000:3.0:1746140889.025959:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573853312 00000100:00100000:1.0:1746140889.026079:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10810 00000100:00100000:1.0:1746140889.026088:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:343:x1830960573853056:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140889.026113:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.026130:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5200/0x8156357b7fdbb014 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e3c expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.026189:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.026201:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.026212:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.026225:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.026230:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.026236:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140889.026334:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10811 00000100:00100000:3.0:1746140889.026342:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+27:342:x1830960573853312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140889.026361:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.026362:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.026373:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 285 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.026375:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7da00/0x8156357b7fdbb030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e43 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.026380:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.026410:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 285 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.026420:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 285 pid: 27790 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.026432:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576100992:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.026460:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026471:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026483:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026491:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026497:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026501:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:1.0:1746140889.026509:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140889.026586:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c600/0x8156357b7fdbb045 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026594:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c600/0x8156357b7fdbb045 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026599:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c600/0x8156357b7fdbb045 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140889.026608:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140889.026696:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026702:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026707:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026713:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f7d400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140889.026717:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026724:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026733:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140889.026736:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140889.026739:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.026743:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.027216:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.027225:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.027231:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.027235:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f7c800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140889.027238:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.027244:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.027254:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4da00) 00010000:00010000:3.0:1746140889.027256:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140889.027259:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.027264:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb03e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140889.027302:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7da00/0x8156357b7fdbb030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e43 expref: 30 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.027347:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c600/0x8156357b7fdbb045 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e43 expref: 29 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.027354:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.027356:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140889.027358:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140889.027364:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140889.027369:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c600, rc 0) 00000100:00100000:3.0:1746140889.027492:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+29:342:x1830960573853312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1149us (1685us total) trans 8589945128 rc 0/0 00000100:00100000:3.0:1746140889.027499:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10811 00000100:00100000:0.0:1746140889.028682:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.028728:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.028813:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573853568 00000100:00100000:2.0:1746140889.028820:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573853568 00000100:00100000:2.0:1746140889.028853:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4759 00000100:00100000:2.0:1746140889.028859:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:27404:x1830960573853568:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746140889.028870:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576100992:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.028891:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140889.028979:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573853696 00000100:00100000:3.0:1746140889.028983:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573853696 00000100:00100000:3.0:1746140889.029029:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 784 00000100:00100000:3.0:1746140889.029034:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573853696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.029043:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.029056:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c600/0x8156357b7fdbb045 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e43 expref: 29 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.029067:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.029072:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140889.029078:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140889.029082:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140889.029087:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.029115:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573853696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.029120:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 784 00000100:00100000:2.0:1746140889.029278:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:27404:x1830960573853568:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 419us (600us total) trans 8589945129 rc 0/0 00000100:00100000:2.0:1746140889.029285:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4759 00000100:00100000:0.0:1746140889.030981:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.031351:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573853824 00000100:00100000:1.0:1746140889.031363:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573853824 00010000:00010000:1.0:1746140889.031389:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 287 pid: 27790 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.031426:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8935 00000100:00100000:1.0:1746140889.031431:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1982:x1830960573853824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.031442:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.031446:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 287 pid: 27790 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.031460:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 287 pid: 27790 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.031476:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009441ba00/0x8156357b7fdbaf73 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dd3 expref: 287 pid: 27790 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.031497:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.031501:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031510:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031515:0:9847:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031531:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.031560:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:1982:x1830960573853824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 129us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.031566:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8935 00010000:00010000:1.0:1746140889.031582:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031591:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140889.031622:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140889.031625:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140889.031637:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031644:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031652:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031657:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031662:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031667:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e5b4600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140889.031670:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031675:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031682:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140889.031684:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140889.031686:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031690:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4600/0x8156357b7fdbb01b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031698:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031703:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031707:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031711:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e5b4a00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140889.031712:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031716:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031721:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4da00) 00010000:00010000:1.0:1746140889.031723:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140889.031725:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031729:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b4a00/0x8156357b7fdbb022 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.031752:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5200/0x8156357b7fdbb014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 12 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.031761:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 11 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.031767:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.031769:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140889.031771:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e5b5a00, rc 0) 00000100:00100000:1.0:1746140889.031790:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:343:x1830960573853056:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5705us (6094us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.031796:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10810 00000100:00100000:0.0:1746140889.035780:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.035839:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.035924:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573853952 00000100:00100000:3.0:1746140889.035928:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573854080 00000100:00100000:3.0:1746140889.035936:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573854080 00000100:00100000:1.0:1746140889.035936:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573853952 00000100:00080000:0.0:1746140889.036045:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746140889.036049:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746140889.036108:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17274 00000100:00100000:3.0:1746140889.036118:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573854080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140889.036136:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.036152:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e51 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.036177:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.036179:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.036187:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.036202:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.036212:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7da00, rc 0) 00000100:00100000:1.0:1746140889.036252:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17275 00000100:00100000:3.0:1746140889.036258:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573854080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 144us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.036261:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573853952:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746140889.036265:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17274 00010000:00010000:1.0:1746140889.036275:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.036289:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e4a expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.036345:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.036347:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.036355:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 11 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.036368:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 11 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.036378:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e5b5800, rc 0) 00000100:00100000:1.0:1746140889.036416:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573853952:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 159us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.036422:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17275 00000100:00100000:0.0:1746140889.037843:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.037921:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.037996:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573854336 00000100:00100000:1.0:1746140889.038002:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573854336 00000100:00100000:1.0:1746140889.038041:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573854592 00000100:00100000:1.0:1746140889.038044:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573854592 00000100:00100000:1.0:1746140889.038067:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10812 00000100:00100000:1.0:1746140889.038073:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:345:x1830960573854336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140889.038089:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.038104:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773800/0x8156357b7fdbb061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e58 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.038115:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10813 00000100:00100000:2.0:1746140889.038127:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+11:343:x1830960573854592:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140889.038202:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038213:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038222:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038246:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038252:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038258:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.038349:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.038362:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdbb076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e5f expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.038381:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038389:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038395:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140889.038407:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.038463:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.038477:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 12 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.038482:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.038487:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.038501:0:14785:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038514:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.038521:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 12 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.038521:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038527:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.038532:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 12 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.038532:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f773600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140889.038535:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038541:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140889.038542:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576101120:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.038551:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140889.038554:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140889.038557:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038562:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038574:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038578:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038583:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038590:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eefe000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140889.038592:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038597:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038602:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099f4de00) 00010000:00010000:1.0:1746140889.038604:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140889.038606:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.038610:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe000/0x8156357b7fdbb06f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140889.038611:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00010000:00010000:1.0:1746140889.038645:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773800/0x8156357b7fdbb061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e58 expref: 289 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.038656:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e58 expref: 288 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.038791:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e58 expref: 288 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.038797:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eefe200, rc 0) 00000100:00100000:1.0:1746140889.039363:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:345:x1830960573854336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1286us (1520us total) trans 8589945130 rc 0/0 00000100:00100000:1.0:1746140889.039370:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10812 00000100:00100000:0.0:1746140889.040152:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.040210:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573854720 00000100:00100000:3.0:1746140889.040217:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573854720 00010000:00010000:3.0:1746140889.040243:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 13 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.040280:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576101120:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.040300:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140889.040363:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8936 00000100:00100000:3.0:1746140889.040372:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1983:x1830960573854720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.040382:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.040388:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 13 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.040397:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 13 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.040413:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e5b5a00/0x8156357b7fdbb029 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e3c expref: 13 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.040424:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.040429:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.040436:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.040441:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.040464:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573854720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.040470:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8936 00000100:00100000:0.0:1746140889.041449:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.041686:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573854848 00000100:00100000:1.0:1746140889.041691:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573854848 00010000:00010000:1.0:1746140889.041709:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e58 expref: 288 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.041737:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8937 00000100:00100000:1.0:1746140889.041743:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+288:1985:x1830960573854848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.041751:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.041755:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e58 expref: 288 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.041764:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e58 expref: 288 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.041778:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eefe200/0x8156357b7fdbb07d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e58 expref: 288 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.041789:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.041793:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140889.041800:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140889.041806:0:9847:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140889.041833:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.041865:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1985:x1830960573854848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.041871:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8937 00010000:00010000:2.0:1746140889.042110:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.042119:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140889.042143:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.042259:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf800/0x8156357b7fdbb076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.042288:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.042295:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.042297:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140889.042300:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8bee00, rc 0) 00000100:00100000:2.0:1746140889.042390:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:343:x1830960573854592:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4266us (4467us total) trans 8589945131 rc 0/0 00000100:00100000:2.0:1746140889.042397:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10813 00000100:00100000:0.0:1746140889.044796:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.044889:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573854976 00000100:00100000:2.0:1746140889.044897:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573854976 00000100:00100000:2.0:1746140889.044947:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10814 00000100:00100000:2.0:1746140889.044954:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:343:x1830960573854976:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140889.044977:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.044996:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8be600/0x8156357b7fdbb099 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e66 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045093:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.045106:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045112:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.045144:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045155:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 13 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.045166:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576101248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.045237:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719480 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.045249:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.045268:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573855104 00000100:00100000:2.0:1746140889.045271:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573855104 00000100:00080000:0.0:1746140889.045298:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746140889.045326:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17276 00000100:00100000:2.0:1746140889.045331:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+16:342:x1830960573855104:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140889.045339:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.045348:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e6d expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045366:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045373:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.045379:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045385:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.045387:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.045389:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3751936->4120575] (req 3751936->4120575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045403:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045410:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 31 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.045418:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576101376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.045461:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.045468:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 10 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.045476:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576101504:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.045495:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 17 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.045502:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 17 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.045510:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576101632:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.045524:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.046154:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576101248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.046168:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140889.046301:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.046476:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573855232 00000100:00100000:3.0:1746140889.046480:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573855232 00010000:00010000:3.0:1746140889.046501:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 14 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:0.0:1746140889.046522:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.046528:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573855360 00000100:00100000:3.0:1746140889.046530:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573855360 00010000:00010000:3.0:1746140889.046540:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 11 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.046588:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576101376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.046596:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576101504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.046643:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8938 00000100:00100000:1.0:1746140889.046651:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573855232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.046659:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.046665:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 14 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.046675:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 14 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.046690:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bee00/0x8156357b7fdbb08b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e5f expref: 14 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.046702:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.046706:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140889.046713:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140889.046718:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140889.046730:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.046766:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573855232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.046771:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8938 00000100:00100000:1.0:1746140889.046816:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8939 00000100:00100000:1.0:1746140889.046821:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573855360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.046827:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.046848:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 11 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.046856:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 11 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.046868:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f7da00/0x8156357b7fdbb053 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e51 expref: 11 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.046877:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.046894:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573855360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.046899:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8939 00000100:00100000:2.0:1746140889.046959:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576101632:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.046974:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3751936->4120575] (req 3751936->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.046982:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d400, rc 0) 00000100:00100000:2.0:1746140889.047047:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+17:342:x1830960573855104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1715us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.047054:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17276 00010000:00010000:2.0:1746140889.047071:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.047077:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140889.047109:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140889.047114:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746140889.047128:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.047150:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8be600/0x8156357b7fdbb099 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.047158:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.047165:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.047168:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140889.047169:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8bf400, rc 0) 00000100:00100000:2.0:1746140889.047185:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:343:x1830960573854976:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2233us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.047190:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10814 00000100:00100000:0.0:1746140889.048378:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.048396:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573855488 00000100:00100000:3.0:1746140889.048404:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573855488 00000100:00080000:0.0:1746140889.048424:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746140889.048429:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 32 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.048447:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8940 00000100:00100000:3.0:1746140889.048452:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573855488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.048459:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.048471:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 32 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.048479:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 32 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.048491:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f7dc00/0x8156357b7fdbafe3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e0b expref: 32 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.048506:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.048532:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573855488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.048538:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8940 00000100:00100000:0.0:1746140889.049343:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.049387:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573855616 00000100:00100000:2.0:1746140889.049393:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573855616 00000100:00100000:2.0:1746140889.049429:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17277 00000100:00100000:2.0:1746140889.049435:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573855616:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140889.049447:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.049457:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4c600/0x8156357b7fdbb0ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e74 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.049472:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.049479:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4c600/0x8156357b7fdbb0ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e74 expref: 11 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.049491:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4c600/0x8156357b7fdbb0ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e74 expref: 11 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.049500:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4c600, rc 0) 00000100:00100000:2.0:1746140889.049533:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573855616:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 99us (191us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140889.049539:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17277 00000100:00100000:0.0:1746140889.049742:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.049792:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573855744 00000100:00100000:3.0:1746140889.049796:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573855744 00010000:00010000:3.0:1746140889.049810:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 17 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.049833:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8941 00000100:00100000:3.0:1746140889.049842:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573855744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.049849:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.049861:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 17 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.049921:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 17 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.049935:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d214200/0x8156357b7fdbafdc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e04 expref: 17 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.049943:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.049944:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.049950:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.049962:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.049996:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.050007:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576101760:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140889.050240:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.051106:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576101760:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140889.051122:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.051154:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573855744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1314us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.051161:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8941 00000100:00100000:2.0:1746140889.051846:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.051853:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.051937:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573856256 00000100:00100000:1.0:1746140889.051942:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573856256 00002000:00100000:1.0:1746140889.051974:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3751936->3756031) req@ffff88012b180e00 x1830960573856256/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.051983:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180e00 with x1830960573856256 ext(3751936->3756031) 00002000:00010000:1.0:1746140889.051988:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b180e00 00000100:00100000:1.0:1746140889.052015:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8853 00000100:00100000:1.0:1746140889.052029:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573856256:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140889.053169:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573856000 00000100:00100000:3.0:1746140889.053176:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573856000 00000100:00100000:3.0:1746140889.053217:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10815 00000100:00100000:3.0:1746140889.053223:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:343:x1830960573856000:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140889.053234:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.053249:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e7b expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.053355:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053369:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053379:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053390:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053396:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053402:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053407:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f7d600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140889.053411:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053417:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053431:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.053434:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140889.053438:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053443:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0bc lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.053466:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0b5 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e7b expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.053473:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0b5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e7b expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.053484:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c800, rc 0) 00000100:00100000:3.0:1746140889.053549:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:343:x1830960573856000:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 305us (1676us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140889.053555:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10815 00000100:00100000:1.0:1746140889.053600:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573856256:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1578us (1754us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140889.053607:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8853 00002000:00100000:1.0:1746140889.053613:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3751936->3756031) req@ffff88012b180e00 x1830960573856256/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.053626:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180e00 with x1830960573856256 ext(3751936->3756031) 00002000:00010000:1.0:1746140889.053629:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b180e00 00000100:00100000:0.0:1746140889.055510:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.055559:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573856512 00000100:00100000:2.0:1746140889.055565:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573856512 00000100:00100000:2.0:1746140889.055602:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4760 00000100:00100000:2.0:1746140889.055607:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:343:x1830960573856512:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746140889.055773:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:343:x1830960573856512:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 165us (270us total) trans 8589945132 rc 0/0 00000100:00100000:2.0:1746140889.055778:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4760 00000100:00100000:0.0:1746140889.056754:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.056809:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573856768 00000100:00100000:1.0:1746140889.056815:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573856768 00002000:00100000:1.0:1746140889.056844:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (4116480->4120575) req@ffff880093137b80 x1830960573856768/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.056853:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137b80 with x1830960573856768 ext(4116480->4120575) 00002000:00010000:1.0:1746140889.056858:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093137b80 00000100:00100000:1.0:1746140889.056948:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8854 00000100:00100000:1.0:1746140889.056954:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573856768:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140889.057216:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573856768:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 261us (468us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140889.057221:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8854 00002000:00100000:1.0:1746140889.057226:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (4116480->4120575) req@ffff880093137b80 x1830960573856768/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.057233:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137b80 with x1830960573856768 ext(4116480->4120575) 00002000:00010000:1.0:1746140889.057235:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093137b80 00000100:00100000:0.0:1746140889.063575:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.063998:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573857024 00000100:00100000:2.0:1746140889.064007:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573857024 00000100:00100000:2.0:1746140889.064073:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4761 00000100:00100000:2.0:1746140889.064081:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:342:x1830960573857024:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140889.064488:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:342:x1830960573857024:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 407us (918us total) trans 8589945133 rc 0/0 00000100:00100000:2.0:1746140889.064497:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4761 00000100:00100000:0.0:1746140889.086412:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.086581:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573857152 00000100:00100000:3.0:1746140889.086591:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573857152 00000100:00080000:0.0:1746140889.086649:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746140889.086656:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17278 00000100:00100000:3.0:1746140889.086664:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:345:x1830960573857152:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140889.086680:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.086695:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e82 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.086723:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 23 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.086731:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 10 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.086737:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.086743:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.086744:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.086747:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [589824->1048575] (req 589824->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.086776:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.086787:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 28 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.086797:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576101888:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.086891:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 10 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.086900:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 10 pid: 4782 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.086908:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576102016:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.086930:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 23 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.086937:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 23 pid: 8460 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.086944:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576102144:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.086957:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.090292:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.090362:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.090461:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576101888:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.090472:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576102016:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.090479:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576102144:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.090507:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573857280 00010000:00010000:3.0:1746140889.090508:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [589824->1048575] (req 589824->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.090513:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573857280 00010000:00010000:3.0:1746140889.090524:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c800, rc 0) 00010000:00010000:2.0:1746140889.090541:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 11 pid: 4782 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.090559:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:345:x1830960573857152:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3898us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.090562:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573857408 00000100:00100000:2.0:1746140889.090564:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573857408 00000100:00100000:3.0:1746140889.090566:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17278 00010000:00010000:2.0:1746140889.090573:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 24 pid: 8460 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.090586:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8942 00000100:00100000:2.0:1746140889.090592:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573857280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.090603:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140889.090620:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8943 00010000:00010000:2.0:1746140889.090621:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 11 pid: 4782 timeout: 968 lvb_type: 1 00000100:00100000:0.0:1746140889.090627:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573857408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.090629:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 11 pid: 4782 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.090634:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.090649:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b5efe00/0x8156357b7fdbaeb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d5c expref: 11 pid: 4782 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.090652:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 24 pid: 8460 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.090659:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 24 pid: 8460 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.090671:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140889.090672:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbae07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1cfa expref: 24 pid: 8460 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.090689:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573857280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (404us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140889.090689:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.090694:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8942 00000100:00100000:0.0:1746140889.090705:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573857408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.090710:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8943 00000100:00100000:0.0:1746140889.090966:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.091004:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573857536 00000100:00100000:2.0:1746140889.091008:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573857536 00010000:00010000:2.0:1746140889.091032:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 28 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.091065:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8944 00000100:00100000:2.0:1746140889.091070:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573857536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.091077:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.091084:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 28 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.091093:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 28 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.091104:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e308800/0x8156357b7fdbae54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d24 expref: 28 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.091112:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.091114:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.091119:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.091126:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.091151:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.091161:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576102272:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.091510:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4719300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.094143:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576102272:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.094160:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.094193:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573857536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3120us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.094203:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8944 00000100:00100000:0.0:1746140889.095052:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.095130:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573857792 00000100:00100000:1.0:1746140889.095136:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573857792 00002000:00100000:1.0:1746140889.095173:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (589824->593919) req@ffff880093135500 x1830960573857792/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.095181:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135500 with x1830960573857792 ext(589824->593919) 00002000:00010000:1.0:1746140889.095186:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135500 00000100:00100000:1.0:1746140889.095216:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8855 00000100:00100000:1.0:1746140889.095223:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573857792:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140889.095395:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573857792:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 173us (345us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140889.095401:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8855 00002000:00100000:1.0:1746140889.095407:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (589824->593919) req@ffff880093135500 x1830960573857792/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.095415:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135500 with x1830960573857792 ext(589824->593919) 00002000:00010000:1.0:1746140889.095417:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135500 00000100:00100000:0.0:1746140889.101785:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.101912:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573857920 00000100:00100000:3.0:1746140889.101922:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573857920 00000100:00100000:3.0:1746140889.101977:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17279 00000100:00100000:3.0:1746140889.101985:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:345:x1830960573857920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140889.102001:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.102018:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e89 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.102056:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 15 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.102064:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 9 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.102071:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 32 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.102077:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.102079:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.102082:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 32 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.102107:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 32 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.102116:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 32 pid: 24958 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.102127:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576102400:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.102214:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 9 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.102221:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 9 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.102231:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576102528:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.102260:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 15 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.102267:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 15 pid: 8460 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.102274:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576102656:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.102288:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.106832:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.107455:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576102400:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.107468:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576102528:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.107475:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576102656:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.107511:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 32 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.107530:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d214800, rc 0) 00000100:00100000:3.0:1746140889.107603:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:345:x1830960573857920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5618us (5825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.107612:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17279 00000100:00100000:2.0:1746140889.107879:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573858176 00000100:00100000:2.0:1746140889.107887:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573858176 00010000:00010000:2.0:1746140889.107916:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 16 pid: 8460 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.107922:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.108151:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573858048 00000100:00100000:0.0:1746140889.108155:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573858048 00000100:00100000:2.0:1746140889.108156:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8945 00000100:00100000:2.0:1746140889.108164:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573858176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140889.108170:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 10 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.108176:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140889.108188:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8946 00000100:00100000:0.0:1746140889.108192:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573858048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.108198:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 16 pid: 8460 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.108199:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.108209:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 16 pid: 8460 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.108218:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 10 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.108231:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbae15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d08 expref: 16 pid: 8460 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.108232:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 10 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.108244:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b5ef800/0x8156357b7fdbaebd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d63 expref: 10 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.108259:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140889.108583:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.108905:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573858176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 741us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.108905:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573858048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 710us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.108912:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8946 00000100:00100000:2.0:1746140889.108919:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8945 00000100:00100000:0.0:1746140889.109972:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.110188:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573858304 00000100:00100000:2.0:1746140889.110195:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573858304 00010000:00010000:2.0:1746140889.110221:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 32 pid: 24958 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.110244:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8947 00000100:00100000:2.0:1746140889.110250:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573858304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.110261:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.110278:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 32 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.110288:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 32 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.110329:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e5b4e00/0x8156357b7fdbae46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1d2b expref: 32 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.110341:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.110343:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.110349:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.110357:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.110385:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.110397:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576102784:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.110473:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4826f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.111937:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576102784:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.111951:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.111980:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573858304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1729us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.111988:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8947 00000100:00100000:0.0:1746140889.113056:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.113402:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573858560 00000100:00100000:2.0:1746140889.113410:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573858560 00002000:00100000:2.0:1746140889.113449:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1150976->1155071) req@ffff880093135180 x1830960573858560/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.113460:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135180 with x1830960573858560 ext(1150976->1155071) 00002000:00010000:2.0:1746140889.113465:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093135180 00000100:00100000:2.0:1746140889.113593:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8856 00000100:00100000:2.0:1746140889.113601:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573858560:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140889.113847:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573858560:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 246us (794us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140889.113853:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8856 00002000:00100000:2.0:1746140889.113859:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1150976->1155071) req@ffff880093135180 x1830960573858560/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.113866:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135180 with x1830960573858560 ext(1150976->1155071) 00002000:00010000:2.0:1746140889.113869:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093135180 00000100:00100000:0.0:1746140889.115111:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.115152:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.115208:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573858816 00000100:00100000:3.0:1746140889.115215:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573858816 00000100:00100000:3.0:1746140889.115251:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10816 00000100:00100000:3.0:1746140889.115256:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:351:x1830960573858816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.115273:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.115291:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbb0d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e90 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.115413:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115425:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115435:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115446:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115451:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115456:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115561:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115569:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115575:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140889.115583:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140889.115683:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115689:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115694:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115700:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f7d400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140889.115703:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115709:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115718:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140889.115721:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140889.115725:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115733:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d400/0x8156357b7fdbb0d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115783:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115788:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115793:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115798:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f7d600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140889.115801:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115805:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115812:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388900) 00010000:00010000:3.0:1746140889.115813:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140889.115815:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.115819:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d600/0x8156357b7fdbb0df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140889.115838:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573859072 00000100:00100000:2.0:1746140889.115843:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573859072 00010000:00010000:3.0:1746140889.115852:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7cc00/0x8156357b7fdbb0d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 291 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.115863:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 290 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.115867:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.115869:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140889.115870:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7dc00, rc 0) 00000100:00100000:2.0:1746140889.115870:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4762 00000100:00100000:2.0:1746140889.115875:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:345:x1830960573859072:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140889.115902:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:351:x1830960573858816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 647us (794us total) trans 8589945134 rc 0/0 00000100:00100000:3.0:1746140889.115906:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10816 00000100:00100000:2.0:1746140889.115975:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:345:x1830960573859072:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 99us (822us total) trans 8589945135 rc 0/0 00000100:00100000:2.0:1746140889.115981:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4762 00000100:00100000:0.0:1746140889.117729:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.117802:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573859200 00000100:00100000:3.0:1746140889.117808:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573859200 00000100:00100000:3.0:1746140889.117897:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17280 00000100:00100000:3.0:1746140889.117908:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573859200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.117920:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.117934:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbb0f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e97 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.117979:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576102912:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140889.118490:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.124659:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576102912:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140889.124698:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbb0f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e97 expref: 32 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.124711:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f7ce00/0x8156357b7fdbb0f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e97 expref: 32 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.124725:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7ce00, rc 0) 00000100:00100000:3.0:1746140889.124779:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573859200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6871us (7055us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140889.124787:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17280 00000100:00100000:0.0:1746140889.131751:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.131802:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.131864:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573859584 00000100:00100000:1.0:1746140889.131874:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573859584 00000100:00100000:2.0:1746140889.131883:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573859712 00000100:00100000:2.0:1746140889.131888:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573859712 00002000:00100000:2.0:1746140889.131918:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->589823) req@ffff880093136680 x1830960573859712/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.131918:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1155072->2097151) req@ffff880093136300 x1830960573859584/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.131927:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136680 with x1830960573859712 ext(0->589823) 00002000:00100000:1.0:1746140889.131927:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136300 with x1830960573859584 ext(1155072->2097151) 00002000:00010000:2.0:1746140889.131932:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093136680 00002000:00010000:1.0:1746140889.131932:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093136300 00000100:00100000:1.0:1746140889.131971:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8857 00000100:00100000:2.0:1746140889.131978:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8858 00000100:00100000:1.0:1746140889.131978:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573859584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.131984:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573859712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.144047:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573859584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12058us (12300us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746140889.144048:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573859712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12051us (12232us total) trans 0 rc 589824/589824 00000100:00100000:3.0:1746140889.144058:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8858 00000100:00100000:1.0:1746140889.144065:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8857 00002000:00100000:1.0:1746140889.144076:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1155072->2097151) req@ffff880093136300 x1830960573859584/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.144085:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136300 with x1830960573859584 ext(1155072->2097151) 00002000:00010000:1.0:1746140889.144092:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093136300 00002000:00100000:3.0:1746140889.144206:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->589823) req@ffff880093136680 x1830960573859712/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 589824/589824 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.144212:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136680 with x1830960573859712 ext(0->589823) 00002000:00010000:3.0:1746140889.144215:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093136680 00000100:00100000:0.0:1746140889.156035:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.156103:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573859840 00000100:00100000:3.0:1746140889.156113:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573859840 00000100:00100000:3.0:1746140889.156167:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17281 00000100:00100000:3.0:1746140889.156175:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:351:x1830960573859840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.156192:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.156209:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1e9e expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.156286:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 14 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.156295:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.156297:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.156301:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 32 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.156582:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 14 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.156594:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 14 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.156606:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576103040:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.157115:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.158582:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576103040:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.158612:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 32 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.158628:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d215e00, rc 0) 00000100:00100000:3.0:1746140889.158673:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:351:x1830960573859840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2498us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.158680:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17281 00000100:00100000:0.0:1746140889.160922:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.161048:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573859968 00000100:00100000:3.0:1746140889.161058:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573859968 00002000:00100000:3.0:1746140889.161100:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3751936->4120575) req@ffff880093137100 x1830960573859968/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.161110:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137100 with x1830960573859968 ext(3751936->4120575) 00010000:00010000:3.0:1746140889.161119:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 15 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.161138:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 15 pid: 24958 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.161146:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093137100 00000100:00100000:3.0:1746140889.161216:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1843 00000100:00100000:3.0:1746140889.161224:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960573859968:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140889.163605:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576103168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746140889.163656:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140889.163942:0:8462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576103168 00000100:00100000:3.0:1746140889.163951:0:8462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576103168 00000100:00080000:1.0:1746140889.164006:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746140889.164031:0:8462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1746140889.164039:0:8462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960576103168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746140889.164060:0:8462:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 744423424 pending 18743296 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746140889.164126:0:8462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3311:x1830960576103168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.164132:0:8462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1746140889.164164:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576103168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746140889.165827:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573859968:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4600us (4909us total) trans 17179874188 rc 0/0 00000100:00100000:3.0:1746140889.165836:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1843 00002000:00100000:3.0:1746140889.165845:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3751936->4120575) req@ffff880093137100 x1830960573859968/t17179874188(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.165854:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137100 with x1830960573859968 ext(3751936->4120575) 00010000:00010000:3.0:1746140889.165862:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 17 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.165880:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 17 pid: 24958 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.165887:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093137100 00000100:00100000:0.0:1746140889.167526:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.167678:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573860096 00000100:00100000:2.0:1746140889.167687:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573860096 00010000:00010000:2.0:1746140889.167719:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 17 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.167755:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8948 00000100:00100000:2.0:1746140889.167762:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573860096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.167774:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.167794:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 17 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.167805:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 17 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.167825:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbb0a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4120575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e6d expref: 17 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.167856:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.167859:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.167865:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.167879:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.167907:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.167917:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576103296:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.168366:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135a0c900 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.169812:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576103296:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.169828:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.169857:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960573860096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2095us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.169866:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8948 00000100:00100000:0.0:1746140889.174378:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.174429:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.174514:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573860352 00000100:00100000:1.0:1746140889.174523:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573860352 00000100:00100000:3.0:1746140889.174555:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573860480 00000100:00100000:3.0:1746140889.174560:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573860480 00002000:00100000:1.0:1746140889.174576:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880130d2b480 x1830960573860352/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.174581:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880130d28380 x1830960573860480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.174586:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2b480 with x1830960573860352 ext(2097152->3145727) 00002000:00100000:3.0:1746140889.174589:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d28380 with x1830960573860480 ext(3145728->4194303) 00002000:00010000:3.0:1746140889.174592:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d28380 00002000:00010000:1.0:1746140889.174592:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d2b480 00000100:00100000:1.0:1746140889.174763:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8859 00000100:00100000:1.0:1746140889.174771:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573860352:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.174773:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8860 00000100:00100000:3.0:1746140889.174780:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573860480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140889.181576:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.182446:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573860864 00000100:00100000:3.0:1746140889.182457:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573860864 00000100:00100000:3.0:1746140889.182504:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10817 00000100:00100000:3.0:1746140889.182511:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:354:x1830960573860864:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140889.182535:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.182552:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214600/0x8156357b7fdbb102 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ea5 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.182663:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182676:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182688:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182700:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182705:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182709:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182808:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182816:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182822:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140889.182829:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140889.182902:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182908:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182914:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182918:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8e400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140889.182922:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182929:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182937:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140889.182940:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140889.182943:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182947:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8e400/0x8156357b7fdbb109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182979:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182984:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182988:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182993:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f8ea00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140889.182995:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.182999:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.183004:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388f00) 00010000:00010000:3.0:1746140889.183007:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140889.183009:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.183013:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8ea00/0x8156357b7fdbb110 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.183059:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d214600/0x8156357b7fdbb102 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 32 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.183069:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 31 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.183074:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.183076:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140889.183078:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8fe00, rc 0) 00000100:00100000:3.0:1746140889.183128:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+31:354:x1830960573860864:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 618us (1564us total) trans 8589945136 rc 0/0 00000100:00100000:3.0:1746140889.183135:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10817 00000100:00100000:3.0:1746140889.184587:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573860480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9804us (10153us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.184597:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8860 00002000:00100000:3.0:1746140889.184605:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880130d28380 x1830960573860480/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.184615:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d28380 with x1830960573860480 ext(3145728->4194303) 00002000:00010000:3.0:1746140889.184619:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d28380 00000100:00100000:1.0:1746140889.184639:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573860352:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9867us (10269us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140889.184647:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8859 00002000:00100000:1.0:1746140889.184653:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880130d2b480 x1830960573860352/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.184661:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d2b480 with x1830960573860352 ext(2097152->3145727) 00002000:00010000:1.0:1746140889.184664:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d2b480 00000100:00100000:0.0:1746140889.191658:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.191749:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573861120 00000100:00100000:1.0:1746140889.191757:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573861120 00002000:00100000:1.0:1746140889.191798:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4882431) req@ffff880130d29180 x1830960573861120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.191812:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29180 with x1830960573861120 ext(4194304->4882431) 00002000:00010000:1.0:1746140889.191817:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d29180 00000100:00100000:1.0:1746140889.191852:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8861 00000100:00100000:1.0:1746140889.191859:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573861120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.205114:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573861120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13241us (13454us total) trans 0 rc 688128/688128 00000100:00100000:2.0:1746140889.205127:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8861 00002000:00100000:2.0:1746140889.205140:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4882431) req@ffff880130d29180 x1830960573861120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 688128/688128 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.205150:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d29180 with x1830960573861120 ext(4194304->4882431) 00002000:00010000:2.0:1746140889.205156:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d29180 00000100:00100000:0.0:1746140889.209754:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.209824:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573861376 00000100:00100000:2.0:1746140889.209834:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573861376 00000100:00100000:2.0:1746140889.210118:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4763 00000100:00100000:2.0:1746140889.210127:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+290:351:x1830960573861376:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140889.210377:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+291:351:x1830960573861376:12345-192.168.204.16@tcp:35:cat.0 Request processed in 251us (633us total) trans 8589945137 rc 0/0 00000100:00100000:2.0:1746140889.210384:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4763 00000100:00100000:1.0:1746140889.211458:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55f02bfa-093a-4e1f-9a53-4ed2824b373e:3312:1830960576103424:0@lo:400:kworker.0 00000100:00100000:2.0:1746140889.211499:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1830960576103680:0@lo:400:kworker.0 00000100:00100000:1.0:1746140889.211500:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140889.211529:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140889.211546:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1830960576103936:0@lo:400:kworker.0 00000100:00100000:2.0:1746140889.211548:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746140889.211553:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576103808:0@lo:400:kworker.0 00000100:00100000:1.0:1746140889.211565:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140889.211572:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140889.211579:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746140889.211584:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1830960576103552:0@lo:400:kworker.0 00000100:00100000:2.0:1746140889.211599:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576103808 00000100:00100000:1.0:1746140889.211601:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140889.211604:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576103808 00000100:00100000:0.0:1746140889.211616:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576103680 00000100:00100000:1.0:1746140889.211626:0:14739:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576103424 00000100:00100000:1.0:1746140889.211630:0:14739:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576103424 00000100:00100000:3.0:1746140889.211632:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576103936 00000100:00100000:0.0:1746140889.211632:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576103680 00000100:00100000:3.0:1746140889.211636:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576103936 00000100:00100000:2.0:1746140889.211637:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1746140889.211642:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3310:x1830960576103808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140889.211658:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576103552 00000100:00100000:1.0:1746140889.211659:0:14739:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1746140889.211660:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576103552 00000100:00100000:1.0:1746140889.211665:0:14739:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3312:x1830960576103424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746140889.211667:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1746140889.211671:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3310:x1830960576103808:12345-0@lo:400:kworker.0 Request processed in 30us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.211672:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1830960576103680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746140889.211677:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1746140889.211690:0:14739:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3312:x1830960576103424:12345-0@lo:400:kworker.0 Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00080000:2.0:1746140889.211691:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746140889.211694:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746140889.211695:0:14739:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1746140889.211706:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1830960576103680:12345-0@lo:400:kworker.0 Request processed in 34us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.211714:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1746140889.211718:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576103808:0@lo:400:kworker.0 00000100:00100000:1.0:1746140889.211719:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55f02bfa-093a-4e1f-9a53-4ed2824b373e:3312:1830960576103424:0@lo:400:kworker.0 00000100:00100000:3.0:1746140889.211726:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1746140889.211727:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1830960576103680:0@lo:400:kworker.0 00000100:00100000:3.0:1746140889.211729:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1830960576103936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746140889.211750:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1830960576103936:12345-0@lo:400:kworker.0 Request processed in 21us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.211755:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1746140889.211755:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1830960576103936:0@lo:400:kworker.0 00000100:00100000:0.0:1746140889.211924:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1746140889.211935:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1830960576103552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140889.212039:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1830960576103552:12345-0@lo:400:kworker.0 Request processed in 108us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.212130:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1746140889.212222:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1830960576103552:0@lo:400:kworker.0 00000100:00100000:0.0:1746140889.227220:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.227280:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573861632 00000100:00100000:2.0:1746140889.227289:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573861632 00000100:00100000:2.0:1746140889.227362:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10818 00000100:00100000:2.0:1746140889.227368:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+31:360:x1830960573861632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.227387:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.227401:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbb125 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1eac expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.227488:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.227500:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.227507:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140889.227514:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.227613:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbb125 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 34 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.227634:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 33 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.227639:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.227641:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746140889.227643:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d000, rc 0) 00000100:00100000:2.0:1746140889.227683:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+33:360:x1830960573861632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 316us (475us total) trans 8589945138 rc 0/0 00000100:00100000:2.0:1746140889.227687:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10818 00000100:00100000:0.0:1746140889.228043:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576104064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746140889.228080:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140889.228124:0:8462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576104064 00000100:00100000:3.0:1746140889.228128:0:8462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576104064 00000100:00100000:3.0:1746140889.228267:0:8462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1746140889.228273:0:8462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3313:x1830960576104064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746140889.228288:0:8462:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 730923008 pending 22151168 free 3847225344 avail 3845128192 00000100:00100000:3.0:1746140889.228337:0:8462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3313:x1830960576104064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.228342:0:8462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1746140889.228490:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576104064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746140889.229628:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.229654:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.229692:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.229767:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573861760 00000100:00100000:3.0:1746140889.229773:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573861760 00000100:00100000:2.0:1746140889.229788:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573861888 00000100:00100000:2.0:1746140889.229793:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573861888 00000100:00100000:3.0:1746140889.229798:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573862016 00000100:00100000:3.0:1746140889.229800:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573862016 00000100:00100000:2.0:1746140889.229816:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17282 00000100:00100000:3.0:1746140889.229822:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17283 00000100:00100000:2.0:1746140889.229822:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1982:x1830960573861760:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140889.229827:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573861888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.229832:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.229836:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.229844:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbb13a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1eb3 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.229846:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb141 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1eba expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.229880:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576104320:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140889.229880:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576104192:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140889.229936:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17284 00000100:00100000:0.0:1746140889.229943:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573862016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140889.229949:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140889.229956:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ec1 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.229966:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140889.229968:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140889.229975:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 19 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.229987:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 19 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.229995:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c25c00, rc 0) 00000100:00100000:2.0:1746140889.230046:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.230048:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573862016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.230054:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17284 00000100:00100000:3.0:1746140889.230102:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.231131:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576104192:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140889.231149:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbb13a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eb3 expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.231157:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbb13a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eb3 expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.231165:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d400, rc 0) 00000100:00100000:2.0:1746140889.231192:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1982:x1830960573861760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1370us (1566us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140889.231197:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17282 00000100:00100000:3.0:1746140889.231271:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576104320:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140889.231288:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb141 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eba expref: 18 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.231296:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb141 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eba expref: 18 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.231334:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ee00, rc 0) 00000100:00100000:3.0:1746140889.231354:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1982:x1830960573861888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1527us (1700us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140889.231360:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17283 00000100:00100000:0.0:1746140889.234514:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.234569:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.234689:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573862400 00000100:00100000:2.0:1746140889.234698:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573862400 00000100:00100000:2.0:1746140889.234950:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10819 00000100:00100000:2.0:1746140889.234958:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+291:359:x1830960573862400:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746140889.234973:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573862144 00000100:00100000:3.0:1746140889.234977:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573862144 00010000:00010000:2.0:1746140889.234979:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.234996:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbb14f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ecf expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.235005:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17285 00000100:00100000:3.0:1746140889.235011:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+23:360:x1830960573862144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.235031:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.235042:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ec8 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.235066:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.235073:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.235075:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.235078:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.235102:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140889.235105:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 26 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.235113:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.235117:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.235121:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 292 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.235128:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576104448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.235128:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 32 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.235133:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.235150:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 32 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.235157:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 32 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.235166:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576104576:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.235340:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23cacc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746140889.235389:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 292 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.235398:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 292 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.235410:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576104704:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.235437:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.235445:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 12 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.235453:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576104832:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.235470:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6780 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.237222:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576104448:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140889.237235:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140889.237249:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.237264:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e000, rc 0) 00000100:00100000:2.0:1746140889.237282:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576104576:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.237329:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+24:360:x1830960573862144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2294us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.237336:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17285 00000100:00100000:0.0:1746140889.237419:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.237473:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573862528 00000100:00100000:3.0:1746140889.237478:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573862528 00000100:00100000:2.0:1746140889.237478:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573862656 00000100:00100000:2.0:1746140889.237481:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573862656 00010000:00010000:2.0:1746140889.237500:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 33 pid: 14785 timeout: 968 lvb_type: 0 00002000:00100000:3.0:1746140889.237508:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (589824->1048575) req@ffff880135699880 x1830960573862528/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.237517:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699880 with x1830960573862528 ext(589824->1048575) 00010000:00010000:3.0:1746140889.237523:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.237530:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8949 00010000:00010000:3.0:1746140889.237533:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.237536:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1983:x1830960573862656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00002000:00010000:3.0:1746140889.237543:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135699880 00010000:00010000:2.0:1746140889.237546:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.237552:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 33 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.237561:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 33 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.237563:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1844 00000100:00100000:3.0:1746140889.237569:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573862528:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:2.0:1746140889.237580:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f8fe00/0x8156357b7fdbb117 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ea5 expref: 33 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.237590:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.237594:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.237601:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.237609:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.237630:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1983:x1830960573862656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.237635:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8949 00000100:00100000:0.0:1746140889.238284:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.238337:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.238398:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576104704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.238406:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576104832:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.238418:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573862784 00010000:00010000:2.0:1746140889.238423:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:1.0:1746140889.238423:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573862784 00000100:00100000:2.0:1746140889.238436:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573862912 00000100:00100000:2.0:1746140889.238439:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573862912 00010000:00010000:1.0:1746140889.238440:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 293 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.238457:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8950 00000100:00100000:1.0:1746140889.238462:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+293:1984:x1830960573862784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.238468:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.238472:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 293 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.238479:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 293 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.238491:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7dc00/0x8156357b7fdbb0e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e90 expref: 293 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.238502:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.238505:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.238511:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.238515:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.238533:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:1984:x1830960573862784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.238538:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8950 00010000:00010000:2.0:1746140889.238545:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 13 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.238568:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8951 00000100:00100000:2.0:1746140889.238573:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+13:1983:x1830960573862912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.238580:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.238584:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 13 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.238591:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 13 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.238601:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8bf400/0x8156357b7fdbb0a0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e66 expref: 13 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.238608:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.238612:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.238618:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.238623:0:9847:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.238636:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.238653:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573862912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.238658:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8951 00010000:00010000:2.0:1746140889.238671:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.238676:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140889.238698:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.238834:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbb14f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 293 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.238844:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 292 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.238850:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.238853:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140889.238854:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d600, rc 0) 00000100:00100000:2.0:1746140889.238877:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:359:x1830960573862400:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3921us (4308us total) trans 8589945139 rc 0/0 00000100:00100000:2.0:1746140889.238886:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10819 00000100:00100000:0.0:1746140889.242597:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.242738:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573863040 00000100:00100000:3.0:1746140889.242771:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573863040 00000100:00100000:3.0:1746140889.242827:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17286 00000100:00100000:3.0:1746140889.242835:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+24:354:x1830960573863040:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140889.242853:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.242871:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ed6 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.242900:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 25 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.242909:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 28 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.242916:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.242922:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.242925:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.242928:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1708032->2097151] (req 1708032->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.242962:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 9 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.243143:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 9 pid: 4186 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.243155:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576104960:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.243389:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 28 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.243399:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 28 pid: 8459 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.243407:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576105088:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.243432:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 25 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.243439:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 25 pid: 8458 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.243447:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576105216:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.243471:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.243757:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.243772:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573863168 00000100:00100000:2.0:1746140889.243776:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573863168 00000100:00100000:2.0:1746140889.243799:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17287 00000100:00100000:2.0:1746140889.243804:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:359:x1830960573863168:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140889.243812:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.243822:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1edd expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.244751:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.244764:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 33 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.244771:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 8 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.244776:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.244778:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.244781:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1720320->1822719] (req 1720320->1822719) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.244801:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 8 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.244813:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 8 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.244823:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576105344:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.244888:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 33 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.244896:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 33 pid: 4784 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.244903:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576105472:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.244925:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 16 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.244932:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 16 pid: 4784 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.244939:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576105600:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.244951:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac8c6780 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.245389:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960573862528:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7817us (7967us total) trans 21474841479 rc 0/0 00000100:00100000:3.0:1746140889.245401:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1844 00002000:00100000:3.0:1746140889.245409:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a0:0x0] (589824->1048575) req@ffff880135699880 x1830960573862528/t21474841479(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.245417:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699880 with x1830960573862528 ext(589824->1048575) 00010000:00010000:3.0:1746140889.245424:0:21689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 29 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.245433:0:21689:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 29 pid: 20960 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.245438:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135699880 00000100:00100000:3.0:1746140889.246624:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576105088:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.246636:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576105216:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.246643:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576104960:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.246669:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1708032->2097151] (req 1708032->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.246683:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8e800, rc 0) 00000100:00100000:3.0:1746140889.246707:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+25:354:x1830960573863040:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3874us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.246714:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17286 00000100:00100000:0.0:1746140889.246765:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.247130:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573863424 00000100:00100000:2.0:1746140889.247135:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573863424 00010000:00010000:2.0:1746140889.247157:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 10 pid: 4186 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.247191:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8952 00000100:00100000:2.0:1746140889.247197:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573863424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.247207:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.247225:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 10 pid: 4186 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.247234:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 10 pid: 4186 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.247251:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fce7600/0x8156357b7fdbaac6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b56 expref: 10 pid: 4186 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.247262:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.247277:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573863424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.247283:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8952 00000100:00100000:0.0:1746140889.247392:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.247851:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.248476:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.248593:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573863296 00000100:00100000:3.0:1746140889.248599:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573863296 00010000:00010000:3.0:1746140889.248620:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 29 pid: 8459 timeout: 968 lvb_type: 1 00000100:00100000:0.0:1746140889.248914:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.248932:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573863552 00000100:00100000:2.0:1746140889.248935:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573863552 00010000:00010000:2.0:1746140889.248947:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 25 pid: 8458 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.248963:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573863680 00000100:00100000:2.0:1746140889.248965:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573863680 00010000:00010000:2.0:1746140889.248975:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 9 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.248991:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8953 00000100:00100000:2.0:1746140889.248996:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573863296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.249007:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.249033:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 29 pid: 8459 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.249041:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 29 pid: 8459 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.249057:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009963e600/0x8156357b7fdbab52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1bb1 expref: 29 pid: 8459 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.249069:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.249100:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573863296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.249106:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8953 00000100:00100000:2.0:1746140889.249118:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8954 00000100:00100000:2.0:1746140889.249122:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573863552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.249128:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.249134:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 25 pid: 8458 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.249142:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 25 pid: 8458 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.249157:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a16400/0x8156357b7fdbaa95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b2c expref: 25 pid: 8458 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.249165:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.249166:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.249172:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.249179:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.249208:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.249219:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576105728:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.249260:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.249288:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576105344:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.249297:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576105472:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.249320:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576105600:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.249340:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [1720320->1822719] (req 1720320->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.249348:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8bf000, rc 0) 00000100:00100000:2.0:1746140889.249364:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:359:x1830960573863168:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5560us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.249370:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17287 00000100:00100000:1.0:1746140889.249871:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573863808 00000100:00100000:1.0:1746140889.249875:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573863808 00000100:00100000:3.0:1746140889.249880:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8955 00000100:00100000:3.0:1746140889.249889:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573863680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.249891:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.249898:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140889.249900:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8956 00010000:00010000:3.0:1746140889.249913:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 9 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.249922:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 9 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.249935:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5229e00/0x8156357b7fdbaabf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b4f expref: 9 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.249948:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.249965:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573863680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.249971:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8955 00000100:00100000:1.0:1746140889.250210:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573863808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.250217:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.250228:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.250239:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.250252:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c800/0x8156357b7fdbb0c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 589824->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e82 expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.250270:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.250271:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.250275:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.250282:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.250325:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.250334:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576105856:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140889.250363:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.250404:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.250436:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573864064 00000100:00100000:3.0:1746140889.250440:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573864064 00000100:00100000:0.0:1746140889.250453:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140889.250454:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 17 pid: 4784 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.250478:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573863936 00000100:00100000:3.0:1746140889.250480:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573863936 00010000:00010000:3.0:1746140889.250490:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 33 pid: 4784 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.250515:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8957 00000100:00100000:3.0:1746140889.250521:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573864064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.250527:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.250536:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 17 pid: 4784 timeout: 968 lvb_type: 1 00000100:00100000:0.0:1746140889.250537:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8958 00010000:00010000:3.0:1746140889.250544:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 17 pid: 4784 timeout: 968 lvb_type: 1 00000100:00100000:0.0:1746140889.250545:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1983:x1830960573863936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140889.250553:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.250556:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094958200/0x8156357b7fdbaa64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b09 expref: 17 pid: 4784 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.250563:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 33 pid: 4784 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.250565:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140889.250573:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 33 pid: 4784 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.250585:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3d000/0x8156357b7fdbab75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1baa expref: 33 pid: 4784 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.250598:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140889.250600:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573864064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (196us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140889.250600:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140889.250604:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 32 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.250606:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8957 00010000:00010000:0.0:1746140889.250610:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 32 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.250626:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 32 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140889.250638:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135699500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576105984:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140889.250660:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119900 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.252270:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576105728:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140889.252270:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1830960576105984:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140889.252273:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576105856:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.252285:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140889.252285:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140889.252285:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.252330:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573863808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2424us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.252331:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573863552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3207us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.252332:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1983:x1830960573863936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1790us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.252339:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8954 00000100:00100000:0.0:1746140889.252342:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8958 00000100:00100000:1.0:1746140889.252348:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8956 00000100:00100000:0.0:1746140889.252422:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.252471:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573864320 00000100:00100000:3.0:1746140889.252476:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573864320 00002000:00100000:3.0:1746140889.252505:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a2:0x0] (1708032->1712127) req@ffff880135699500 x1830960573864320/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.252516:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699500 with x1830960573864320 ext(1708032->1712127) 00002000:00010000:3.0:1746140889.252520:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135699500 00000100:00100000:3.0:1746140889.252550:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8862 00000100:00100000:3.0:1746140889.252556:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573864320:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140889.252706:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573864320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 150us (282us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140889.252712:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8862 00002000:00100000:3.0:1746140889.252717:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a2:0x0] (1708032->1712127) req@ffff880135699500 x1830960573864320/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.252724:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699500 with x1830960573864320 ext(1708032->1712127) 00002000:00010000:3.0:1746140889.252728:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135699500 00000100:00100000:0.0:1746140889.253155:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.253193:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573864576 00000100:00100000:3.0:1746140889.253197:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573864576 00002000:00100000:3.0:1746140889.253213:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1720320->1724415) req@ffff88013569a300 x1830960573864576/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.253220:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569a300 with x1830960573864576 ext(1720320->1724415) 00002000:00010000:3.0:1746140889.253223:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569a300 00000100:00100000:3.0:1746140889.253251:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8863 00000100:00100000:3.0:1746140889.253256:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573864576:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140889.253376:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573864576:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 120us (221us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140889.253382:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8863 00002000:00100000:3.0:1746140889.253387:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1720320->1724415) req@ffff88013569a300 x1830960573864576/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.253394:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569a300 with x1830960573864576 ext(1720320->1724415) 00002000:00010000:3.0:1746140889.253397:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569a300 00000100:00100000:1.0:1746140889.253667:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.253709:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573864832 00000100:00100000:0.0:1746140889.253713:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573864832 00002000:00100000:0.0:1746140889.253731:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801359b0a80 x1830960573864832/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140889.253739:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0a80 with x1830960573864832 ext(0->1048575) 00002000:00010000:0.0:1746140889.253742:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b0a80 00000100:00100000:0.0:1746140889.253766:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8864 00000100:00100000:0.0:1746140889.253771:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573864832:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140889.256178:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.256235:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573865088 00000100:00100000:3.0:1746140889.256242:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573865088 00002000:00100000:3.0:1746140889.256272:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1818624->1822719) req@ffff88012b181500 x1830960573865088/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.256281:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181500 with x1830960573865088 ext(1818624->1822719) 00002000:00010000:3.0:1746140889.256285:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b181500 00000100:00100000:2.0:1746140889.256329:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8865 00000100:00100000:2.0:1746140889.256337:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573865088:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140889.256467:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573865088:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 130us (449us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140889.256473:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8865 00002000:00100000:2.0:1746140889.256479:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1818624->1822719) req@ffff88012b181500 x1830960573865088/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.256486:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181500 with x1830960573865088 ext(1818624->1822719) 00002000:00010000:2.0:1746140889.256489:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b181500 00000100:00100000:0.0:1746140889.256623:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.256873:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573865216 00000100:00100000:2.0:1746140889.256877:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573865216 00000100:00100000:2.0:1746140889.256912:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17288 00000100:00100000:2.0:1746140889.256917:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+26:354:x1830960573865216:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140889.256929:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.256945:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ee4 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.256975:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 26 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.256982:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.256988:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.256995:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.257001:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 26 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.257007:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140889.257009:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140889.257011:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 8/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [2097152->2363391] (req 2097152->2363391) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 27 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.257050:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 26 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.257061:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 26 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.257078:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106112:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.257141:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 8 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.257149:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 8 pid: 24958 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.257156:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106240:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.257180:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.257188:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.257195:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106368:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.257215:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.257222:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.257229:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106496:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.257250:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 26 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.257258:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 26 pid: 32377 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.257265:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106624:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.257280:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.258747:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106112:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.258759:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106240:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.258767:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106368:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.258773:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106496:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.258779:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576106624:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.258808:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [2097152->2363391] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 27 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.258822:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c422e00, rc 0) 00000100:00100000:2.0:1746140889.259035:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+27:354:x1830960573865216:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2115us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.259042:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17288 00000100:00100000:2.0:1746140889.259857:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573864832:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6084us (6188us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.259865:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8864 00002000:00100000:2.0:1746140889.259874:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801359b0a80 x1830960573864832/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.259889:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b0a80 with x1830960573864832 ext(0->1048575) 00002000:00010000:2.0:1746140889.259894:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b0a80 00000100:00100000:2.0:1746140889.262037:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.262075:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.262103:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.262114:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.262133:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573865344 00000100:00100000:2.0:1746140889.262140:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573865344 00010000:00010000:2.0:1746140889.262178:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 9 pid: 24958 timeout: 968 lvb_type: 1 00000100:00100000:1.0:1746140889.262181:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573865600 00000100:00100000:1.0:1746140889.262185:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573865600 00000100:00100000:2.0:1746140889.262199:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573865856 00000100:00100000:2.0:1746140889.262201:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573865856 00010000:00010000:1.0:1746140889.262204:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.262211:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 10 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 27 pid: 32377 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.262221:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573865472 00000100:00100000:2.0:1746140889.262223:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573865472 00000100:00100000:1.0:1746140889.262226:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8959 00010000:00010000:2.0:1746140889.262230:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 28 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:1.0:1746140889.262232:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573865344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140889.262240:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8960 00010000:00010000:1.0:1746140889.262244:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140889.262246:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573865600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.262252:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.262265:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.262266:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 9 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.262276:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 9 pid: 24958 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.262338:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8961 00000100:00100000:3.0:1746140889.262347:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573865856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.262357:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140889.262433:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8962 00000100:00100000:0.0:1746140889.262440:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573865472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140889.262446:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.262674:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.262697:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5800/0x8156357b7fdbb05a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e4a expref: 9 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.262702:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 14 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 28 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.262710:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 12 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 28 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.262718:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140889.262728:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d214a00/0x8156357b7fdbaf8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 11 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dda expref: 28 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.262736:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.262754:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573865856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 410us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.262754:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573865344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 521us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.262760:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8961 00000100:00100000:1.0:1746140889.262763:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8959 00010000:00010000:0.0:1746140889.262814:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 26 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.262829:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 26 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.262841:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb00d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e35 expref: 26 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.262865:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140889.262881:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960573865472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 442us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.262887:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8962 00000100:00100000:0.0:1746140889.262933:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.262948:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573865728 00000100:00100000:0.0:1746140889.262951:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573865728 00010000:00010000:0.0:1746140889.262962:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:0.0:1746140889.262974:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8963 00000100:00100000:0.0:1746140889.262978:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573865728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140889.262984:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140889.262991:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.263000:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.263011:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a521b200/0x8156357b7fdbafb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1de8 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.263032:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140889.263047:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573865728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.263051:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8963 00010000:00010000:2.0:1746140889.263128:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb006 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e2e expref: 24 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.263154:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.263155:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.263161:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.263171:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.263199:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.263210:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576106752:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.263263:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.265227:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.265326:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573865984 00000100:00100000:3.0:1746140889.265334:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573865984 00000100:00100000:3.0:1746140889.265373:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17289 00000100:00100000:3.0:1746140889.265379:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+16:360:x1830960573865984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.265395:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.265411:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1eeb expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.265415:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576106752:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.265432:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140889.265435:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.265441:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.265442:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.265445:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.265461:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573865600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3215us (3386us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140889.265469:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 31 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.265469:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8960 00010000:00010000:3.0:1746140889.265479:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 31 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.265489:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576106880:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.265537:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b2579c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.266750:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576106880:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.266772:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.266785:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8ee00, rc 0) 00000100:00100000:3.0:1746140889.266812:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+17:360:x1830960573865984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1432us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.266818:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17289 00000100:00100000:0.0:1746140889.267747:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.267785:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.267845:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573866112 00000100:00100000:3.0:1746140889.267852:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573866112 00000100:00100000:2.0:1746140889.267864:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573866368 00000100:00100000:2.0:1746140889.267868:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573866368 00002000:00100000:3.0:1746140889.267885:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1155071) req@ffff880135698700 x1830960573866112/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.267888:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2359296->2363391) req@ffff88013569bb80 x1830960573866368/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.267893:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698700 with x1830960573866112 ext(1048576->1155071) 00002000:00100000:2.0:1746140889.267896:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569bb80 with x1830960573866368 ext(2359296->2363391) 00002000:00010000:2.0:1746140889.267899:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569bb80 00010000:00010000:3.0:1746140889.267901:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 32 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.267914:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 32 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.267914:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8866 00002000:00010000:3.0:1746140889.267920:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135698700 00000100:00100000:2.0:1746140889.267920:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1982:x1830960573866368:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140889.267934:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1845 00000100:00100000:3.0:1746140889.267939:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573866112:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140889.268091:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1982:x1830960573866368:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 171us (304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140889.268097:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8866 00002000:00100000:2.0:1746140889.268102:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2359296->2363391) req@ffff88013569bb80 x1830960573866368/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.268109:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569bb80 with x1830960573866368 ext(2359296->2363391) 00002000:00010000:2.0:1746140889.268111:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569bb80 00000100:00100000:1.0:1746140889.270572:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.270629:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573866624 00000100:00100000:2.0:1746140889.270636:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573866624 00000100:00100000:2.0:1746140889.270684:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4764 00000100:00100000:2.0:1746140889.270691:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+32:354:x1830960573866624:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140889.270877:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+33:354:x1830960573866624:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 186us (313us total) trans 8589945140 rc 0/0 00000100:00100000:2.0:1746140889.270883:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4764 00000100:00100000:3.0:1746140889.271781:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573866112:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3837us (4033us total) trans 17179874189 rc 0/0 00000100:00100000:3.0:1746140889.271789:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1845 00002000:00100000:3.0:1746140889.271798:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1155071) req@ffff880135698700 x1830960573866112/t17179874189(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.271807:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698700 with x1830960573866112 ext(1048576->1155071) 00010000:00010000:3.0:1746140889.271814:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 34 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.271828:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 34 pid: 20960 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.271840:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135698700 00000100:00100000:0.0:1746140889.274292:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.274397:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573866752 00000100:00100000:2.0:1746140889.274407:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573866752 00010000:00010000:2.0:1746140889.274445:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 34 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.274564:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8964 00000100:00100000:2.0:1746140889.274573:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573866752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.274587:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.274610:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 34 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.274622:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 34 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.274644:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb0ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e89 expref: 34 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.274657:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.274659:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.274667:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.274681:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.274711:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 16 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.274722:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576107008:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.274976:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.276376:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576107008:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.276399:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.276554:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573866752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1972us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.276566:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8964 00000100:00100000:0.0:1746140889.278262:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.278344:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573867008 00000100:00100000:3.0:1746140889.278352:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573867008 00002000:00100000:3.0:1746140889.278389:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88013569b800 x1830960573867008/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.278400:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b800 with x1830960573867008 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.278404:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569b800 00000100:00100000:3.0:1746140889.278420:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8867 00000100:00100000:3.0:1746140889.278426:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573867008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140889.285343:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573867008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6904us (7072us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.285355:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8867 00002000:00100000:3.0:1746140889.285368:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88013569b800 x1830960573867008/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.285377:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b800 with x1830960573867008 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.285383:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569b800 00000100:00100000:0.0:1746140889.289959:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.290610:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573867136 00000100:00100000:3.0:1746140889.290623:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573867136 00000100:00100000:3.0:1746140889.290696:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17290 00000100:00100000:3.0:1746140889.290704:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+17:360:x1830960573867136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.290724:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.290743:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ef2 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.290779:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 32 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.290786:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.290788:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.290792:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.290823:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 32 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.290835:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 32 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.290848:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576107136:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.290955:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b2579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.292532:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.292534:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576107136:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.292557:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 18 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.292572:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308f2800, rc 0) 00000100:00100000:3.0:1746140889.292610:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+18:360:x1830960573867136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1907us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.292619:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17290 00000100:00100000:2.0:1746140889.292625:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573867264 00000100:00100000:2.0:1746140889.292639:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573867264 00002000:00100000:2.0:1746140889.292692:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1720320->1822719) req@ffff880135698e00 x1830960573867264/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.292701:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698e00 with x1830960573867264 ext(1720320->1822719) 00010000:00010000:2.0:1746140889.292710:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 33 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.292726:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 33 pid: 24958 timeout: 968 lvb_type: 0 00002000:00010000:2.0:1746140889.292733:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135698e00 00000100:00100000:2.0:1746140889.292776:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1846 00000100:00100000:2.0:1746140889.292784:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573867264:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140889.299260:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573867264:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6469us (6722us total) trans 17179874190 rc 0/0 00000100:00100000:2.0:1746140889.299275:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1846 00002000:00100000:2.0:1746140889.299286:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1720320->1822719) req@ffff880135698e00 x1830960573867264/t17179874190(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.299294:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698e00 with x1830960573867264 ext(1720320->1822719) 00010000:00010000:2.0:1746140889.299322:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 35 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.299335:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 35 pid: 24958 timeout: 968 lvb_type: 0 00002000:00010000:2.0:1746140889.299342:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135698e00 00000100:00100000:0.0:1746140889.300946:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.301038:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573867392 00000100:00100000:2.0:1746140889.301045:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573867392 00010000:00010000:2.0:1746140889.301070:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 35 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.301103:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8965 00000100:00100000:2.0:1746140889.301108:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573867392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.301119:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746140889.301133:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140887 -> 1746140889 00002000:00010000:2.0:1746140889.301135:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140887 -> 1746140889 00010000:00010000:2.0:1746140889.301140:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 35 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.301150:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 35 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.301169:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8bf000/0x8156357b7fdbb172 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->1822719) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1edd expref: 35 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.301196:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.301198:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.301205:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.301213:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.301371:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.301386:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576107264:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.301586:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.302864:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7109:1830960576107264:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.302882:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.302921:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573867392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1811us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.302930:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8965 00000100:00100000:0.0:1746140889.305970:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.306034:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.306114:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573867776 00000100:00100000:1.0:1746140889.306126:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573867776 00002000:00100000:1.0:1746140889.306171:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88013569aa00 x1830960573867776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.306179:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569aa00 with x1830960573867776 ext(1048576->2097151) 00002000:00010000:1.0:1746140889.306185:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569aa00 00000100:00100000:1.0:1746140889.306217:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573867904 00000100:00100000:1.0:1746140889.306220:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573867904 00002000:00100000:1.0:1746140889.306234:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1708031) req@ffff88009b1b3100 x1830960573867904/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.306239:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b3100 with x1830960573867904 ext(1048576->1708031) 00002000:00010000:1.0:1746140889.306242:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b1b3100 00000100:00100000:1.0:1746140889.306255:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8868 00000100:00100000:1.0:1746140889.306262:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573867776:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140889.306378:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8869 00000100:00100000:0.0:1746140889.306386:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573867904:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140889.315391:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573867904:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8997us (9348us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746140889.315401:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8869 00002000:00100000:2.0:1746140889.315411:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1708031) req@ffff88009b1b3100 x1830960573867904/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 659456/659456 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.315419:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b1b3100 with x1830960573867904 ext(1048576->1708031) 00002000:00010000:2.0:1746140889.315425:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b1b3100 00000100:00100000:1.0:1746140889.316105:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573867776:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9841us (10141us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140889.316113:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8868 00002000:00100000:1.0:1746140889.316119:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88013569aa00 x1830960573867776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.316126:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569aa00 with x1830960573867776 ext(1048576->2097151) 00002000:00010000:1.0:1746140889.316130:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013569aa00 00000100:00100000:3.0:1746140889.329069:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.329089:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.329164:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573868416 00000100:00100000:2.0:1746140889.329169:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573868160 00000100:00100000:2.0:1746140889.329179:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573868160 00000100:00100000:1.0:1746140889.329179:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573868416 00002000:00100000:1.0:1746140889.329228:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2363392->3145727) req@ffff88009f120700 x1830960573868416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140889.329234:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10820 00002000:00100000:1.0:1746140889.329238:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f120700 with x1830960573868416 ext(2363392->3145727) 00000100:00100000:2.0:1746140889.329241:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+292:365:x1830960573868160:12345-192.168.204.16@tcp:101:cat.0 00002000:00010000:1.0:1746140889.329244:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f120700 00010000:00010000:2.0:1746140889.329264:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140889.329273:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8870 00000100:00100000:1.0:1746140889.329279:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573868416:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140889.329282:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73a00/0x8156357b7fdbb18e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ef9 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.329405:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.329442:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.329459:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573868672 00000100:00100000:3.0:1746140889.329463:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573868672 00002000:00100000:3.0:1746140889.329488:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f121500 x1830960573868672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.329496:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121500 with x1830960573868672 ext(2097152->3145727) 00002000:00010000:3.0:1746140889.329501:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f121500 00010000:00010000:2.0:1746140889.329514:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140889.329518:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573868928 00000100:00100000:3.0:1746140889.329520:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573868928 00010000:00010000:2.0:1746140889.329527:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00002000:00100000:3.0:1746140889.329532:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f121880 x1830960573868928/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746140889.329537:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329550:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00002000:00100000:3.0:1746140889.329553:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121880 with x1830960573868928 ext(3145728->4194303) 00002000:00010000:3.0:1746140889.329555:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f121880 00010000:00010000:2.0:1746140889.329556:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329561:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140889.329567:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8871 00000100:00100000:3.0:1746140889.329572:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573868672:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746140889.329690:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329699:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329705:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140889.329715:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.329800:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329806:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329811:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329816:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee73c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.329819:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329825:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329835:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140889.329837:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.329840:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329845:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73c00/0x8156357b7fdbb195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329858:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329863:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329868:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329871:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee73e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.329873:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329878:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329883:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f200) 00010000:00010000:2.0:1746140889.329884:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.329886:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329891:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb19c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.329926:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73a00/0x8156357b7fdbb18e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 295 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.329938:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 294 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.329944:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.329946:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140889.329948:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee73600, rc 0) 00000100:00100000:2.0:1746140889.330345:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+294:365:x1830960573868160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1103us (1255us total) trans 8589945141 rc 0/0 00000100:00100000:2.0:1746140889.330351:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10820 00000100:00100000:1.0:1746140889.330377:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8872 00000100:00100000:1.0:1746140889.330386:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573868928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.337454:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573868416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8164us (8389us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746140889.337465:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8870 00002000:00100000:1.0:1746140889.337478:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (2363392->3145727) req@ffff88009f120700 x1830960573868416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.337488:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f120700 with x1830960573868416 ext(2363392->3145727) 00002000:00010000:1.0:1746140889.337493:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f120700 00000100:00100000:0.0:1746140889.337748:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.337776:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.337802:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.337819:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573869184 00000100:00100000:0.0:1746140889.337819:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573869056 00000100:00100000:3.0:1746140889.337826:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573869184 00000100:00100000:0.0:1746140889.337826:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573869056 00000100:00100000:3.0:1746140889.337932:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573869312 00000100:00100000:3.0:1746140889.337935:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573869312 00000100:00100000:1.0:1746140889.337936:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17291 00000100:00100000:1.0:1746140889.337943:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573869184:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140889.337951:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17292 00000100:00100000:3.0:1746140889.337955:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1982:x1830960573869312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.337956:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.337959:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.337972:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f0e expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.337972:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f07 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.337992:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.337992:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.337993:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.337994:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.338000:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 37 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.338000:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 37 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.338014:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 37 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.338030:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 37 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.338040:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d214800, rc 0) 00010000:00010000:1.0:1746140889.338040:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b5efe00, rc 0) 00000100:00100000:3.0:1746140889.338158:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573869312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 202us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.338158:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573869184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 216us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.338164:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17292 00000100:00100000:1.0:1746140889.338166:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17291 00000100:00100000:1.0:1746140889.338190:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.338201:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573869440 00000100:00100000:3.0:1746140889.338204:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573869440 00000100:00100000:1.0:1746140889.338220:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.338233:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573869568 00000100:00100000:3.0:1746140889.338236:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573869568 00000100:00100000:1.0:1746140889.338242:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17293 00000100:00100000:1.0:1746140889.338247:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960573869440:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140889.338249:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17294 00000100:00100000:3.0:1746140889.338252:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573869568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.338254:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.338257:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.338263:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdbb1c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f1c expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.338263:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801308f2000/0x8156357b7fdbb1bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f15 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.338279:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdbb1c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f1c expref: 29 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.338286:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8f400/0x8156357b7fdbb1c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f1c expref: 29 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140889.338296:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576107392:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140889.338299:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f8f400, rc 0) 00000100:00100000:3.0:1746140889.338329:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573869568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 75us (109us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140889.338334:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17294 00000100:00100000:1.0:1746140889.338356:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.338540:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17295 00000100:00100000:0.0:1746140889.338546:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573869056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140889.338551:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140889.338558:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f00 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.338570:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140889.338571:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140889.338576:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.338584:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.338590:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eefec00, rc 0) 00000100:00100000:0.0:1746140889.338613:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573869056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 68us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.338618:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17295 00000100:00100000:3.0:1746140889.339525:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573868672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9951us (10118us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.339534:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8871 00002000:00100000:3.0:1746140889.339541:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f121500 x1830960573868672/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.339549:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121500 with x1830960573868672 ext(2097152->3145727) 00002000:00010000:3.0:1746140889.339553:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f121500 00002000:00010000:2.0:1746140889.340615:0:20960:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140888 -> 1746140889 00002000:00010000:2.0:1746140889.340621:0:20960:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140887 -> 1746140890 00002000:00010000:2.0:1746140889.340623:0:20960:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140888 -> 1746140889 00000100:00100000:2.0:1746140889.340643:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576107392:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140889.340670:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308f2000/0x8156357b7fdbb1bf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f15 expref: 27 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.340682:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308f2000/0x8156357b7fdbb1bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f15 expref: 27 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.340706:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308f2000, rc 0) 00000100:00100000:2.0:1746140889.340740:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1983:x1830960573869440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2492us (2548us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140889.340747:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17293 00000100:00100000:1.0:1746140889.340980:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573868928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10595us (11535us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140889.340987:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8872 00002000:00100000:1.0:1746140889.340994:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f121880 x1830960573868928/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.341002:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f121880 with x1830960573868928 ext(3145728->4194303) 00002000:00010000:1.0:1746140889.341007:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f121880 00000100:00100000:2.0:1746140889.344815:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.344884:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573869696 00000100:00100000:0.0:1746140889.344893:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573869696 00000100:00100000:0.0:1746140889.344936:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17296 00000100:00100000:0.0:1746140889.344942:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573869696:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140889.344958:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140889.345197:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eefe600/0x8156357b7fdbb1d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f23 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.345230:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eefe600/0x8156357b7fdbb1d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f23 expref: 24 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.345240:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eefe600/0x8156357b7fdbb1d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f23 expref: 24 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.345268:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eefe600, rc 0) 00000100:00100000:0.0:1746140889.345343:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573869696:12345-192.168.204.16@tcp:101:cat.0 Request processed in 401us (538us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140889.345349:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17296 00000100:00100000:0.0:1746140889.346992:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.347055:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573869824 00000100:00100000:2.0:1746140889.347062:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573869824 00000100:00100000:2.0:1746140889.347105:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17297 00000100:00100000:2.0:1746140889.347111:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+23:360:x1830960573869824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.347185:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.347199:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f2a expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.347389:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.347391:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.347398:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.347412:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 24 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.347421:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee73e00, rc 0) 00000100:00100000:2.0:1746140889.347452:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+24:360:x1830960573869824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 341us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.347458:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17297 00000100:00100000:0.0:1746140889.350414:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.350443:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.350469:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.350494:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.350578:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573870208 00000100:00100000:3.0:1746140889.350586:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573870208 00002000:00100000:3.0:1746140889.350630:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009abde300 x1830960573870208/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.350640:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abde300 with x1830960573870208 ext(4194304->4886527) 00002000:00010000:3.0:1746140889.350646:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abde300 00000100:00100000:3.0:1746140889.350664:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573870336 00000100:00100000:3.0:1746140889.350666:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573870336 00002000:00100000:3.0:1746140889.350678:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009abdfb80 x1830960573870336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.350685:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdfb80 with x1830960573870336 ext(0->1048575) 00002000:00010000:3.0:1746140889.350688:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdfb80 00000100:00100000:3.0:1746140889.350698:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573870592 00000100:00100000:3.0:1746140889.350700:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573870592 00002000:00100000:3.0:1746140889.350723:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009abddf80 x1830960573870592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.350736:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abddf80 with x1830960573870592 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.350740:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abddf80 00000100:00100000:3.0:1746140889.350750:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573870848 00000100:00100000:3.0:1746140889.350752:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573870848 00002000:00100000:3.0:1746140889.350768:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009abdc380 x1830960573870848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.350774:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc380 with x1830960573870848 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.350777:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdc380 00000100:00100000:1.0:1746140889.350791:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8873 00000100:00100000:2.0:1746140889.350923:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8874 00000100:00100000:1.0:1746140889.350930:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573870208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.350933:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1983:x1830960573870336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.350950:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8875 00000100:00100000:2.0:1746140889.350956:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8876 00000100:00100000:2.0:1746140889.350960:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573870848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.350961:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573870592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.360578:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573870208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9644us (10159us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140889.360591:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8873 00002000:00100000:1.0:1746140889.360603:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009abde300 x1830960573870208/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.360613:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abde300 with x1830960573870208 ext(4194304->4886527) 00002000:00010000:1.0:1746140889.360619:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abde300 00000100:00100000:3.0:1746140889.364724:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1983:x1830960573870592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13337us (13824us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.364736:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8875 00002000:00100000:3.0:1746140889.364754:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009abddf80 x1830960573870592/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.364763:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abddf80 with x1830960573870592 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.364769:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abddf80 00000100:00100000:2.0:1746140889.367381:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1982:x1830960573870848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16413us (16879us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.367390:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8876 00002000:00100000:2.0:1746140889.367398:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009abdc380 x1830960573870848/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.367406:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc380 with x1830960573870848 ext(1048576->2097151) 00002000:00010000:2.0:1746140889.367411:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdc380 00000100:00100000:0.0:1746140889.367561:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.367593:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573870976 00000100:00100000:2.0:1746140889.367601:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573870976 00000100:00100000:3.0:1746140889.367950:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1983:x1830960573870336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17018us (17505us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.367957:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8874 00002000:00100000:3.0:1746140889.367962:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009abdfb80 x1830960573870336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.367969:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdfb80 with x1830960573870336 ext(0->1048575) 00002000:00010000:3.0:1746140889.367974:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdfb80 00000100:00100000:2.0:1746140889.368057:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17298 00000100:00100000:2.0:1746140889.368064:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573870976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.368078:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.368094:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee73800/0x8156357b7fdbb1e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f31 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.368121:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee73800/0x8156357b7fdbb1e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f31 expref: 25 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.368136:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee73800/0x8156357b7fdbb1e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f31 expref: 25 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.368155:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee73800, rc 0) 00000100:00100000:2.0:1746140889.368174:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573870976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 111us (620us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140889.368179:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17298 00000100:00100000:0.0:1746140889.374256:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.374431:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573871104 00000100:00100000:1.0:1746140889.374440:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573871104 00000100:00100000:1.0:1746140889.374664:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17299 00000100:00100000:1.0:1746140889.374674:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573871104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.374691:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.374707:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e44600/0x8156357b7fdbb1e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f38 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.374741:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e44600/0x8156357b7fdbb1e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f38 expref: 25 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.374750:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e44600/0x8156357b7fdbb1e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f38 expref: 25 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.375083:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e44600, rc 0) 00000100:00100000:1.0:1746140889.376707:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573871104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2026us (2453us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140889.376718:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17299 00000100:00100000:0.0:1746140889.378550:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.379872:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.379925:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573871360 00000100:00100000:2.0:1746140889.379934:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573871360 00000100:00100000:2.0:1746140889.379989:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10821 00000100:00100000:2.0:1746140889.379996:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+294:367:x1830960573871360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140889.380036:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.380054:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73200/0x8156357b7fdbb1f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f3f expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.380167:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380180:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380190:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380201:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380206:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380211:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380338:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb205 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380346:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb205 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380352:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb205 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140889.380362:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.380445:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380452:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380458:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380463:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee73000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.380467:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380472:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380482:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140889.380484:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.380488:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380495:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73000/0x8156357b7fdbb1f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380509:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380513:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380518:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380521:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee72e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.380523:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380527:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380533:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f300) 00010000:00010000:2.0:1746140889.380534:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.380537:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380540:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72e00/0x8156357b7fdbb1fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.380572:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73200/0x8156357b7fdbb1f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f3f expref: 297 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.380583:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb205 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f3f expref: 296 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.380593:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.380595:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140889.380597:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee72c00, rc 0) 00000100:00100000:2.0:1746140889.380649:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:367:x1830960573871360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 654us (2106us total) trans 8589945142 rc 0/0 00000100:00100000:2.0:1746140889.380655:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10821 00000100:00100000:1.0:1746140889.380894:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573871488 00000100:00100000:1.0:1746140889.380898:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573871488 00000100:00100000:1.0:1746140889.380923:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17300 00000100:00100000:1.0:1746140889.380928:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:365:x1830960573871488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.380936:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.380946:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f46 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.380963:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.380970:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.380971:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.380975:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.380999:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 23 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.381011:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 23 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.381031:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576107520:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.381085:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140889.382619:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576107520:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.382639:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.382652:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e44800, rc 0) 00000100:00100000:1.0:1746140889.382688:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:365:x1830960573871488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1758us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.382695:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17300 00000100:00100000:0.0:1746140889.383225:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.383258:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.383291:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.383351:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573872000 00000100:00100000:3.0:1746140889.383356:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573871616 00000100:00100000:1.0:1746140889.383356:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573872000 00000100:00100000:3.0:1746140889.383366:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573871616 00000100:00100000:1.0:1746140889.383385:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4765 00000100:00100000:1.0:1746140889.383390:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:367:x1830960573872000:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140889.383392:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573871744 00000100:00100000:2.0:1746140889.383396:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573871744 00002000:00100000:3.0:1746140889.383405:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1708032->2097151) req@ffff88009abdea00 x1830960573871616/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.383414:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdea00 with x1830960573871616 ext(1708032->2097151) 00010000:00010000:3.0:1746140889.383422:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 24 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.383422:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 785 00000100:00100000:2.0:1746140889.383427:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:1983:x1830960573871744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.383434:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 24 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.383437:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746140889.383440:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abdea00 00010000:00010000:2.0:1746140889.383453:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb205 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f3f expref: 297 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.383465:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.383468:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.383488:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:1983:x1830960573871744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.383494:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 785 00000100:00100000:1.0:1746140889.383547:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:367:x1830960573872000:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 155us (254us total) trans 8589945143 rc 0/0 00000100:00100000:1.0:1746140889.383553:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4765 00000100:00100000:3.0:1746140889.383626:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1847 00000100:00100000:3.0:1746140889.383633:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573871616:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140889.385442:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.385591:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573872128 00000100:00100000:1.0:1746140889.385598:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573872128 00000100:00100000:1.0:1746140889.385645:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17301 00000100:00100000:1.0:1746140889.385652:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:367:x1830960573872128:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140889.385667:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.385683:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f4d expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.385707:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.385720:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.385727:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.385729:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.385731:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [57344->126975] (req 57344->126975) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.385758:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.385767:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 968 lvb_type: 1 00000100:00100000:1.0:1746140889.385778:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576107648:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.385942:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 25 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.385951:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.385960:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576107776:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.385996:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140889.388366:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576107648:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.388378:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576107776:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.388406:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [57344->126975] (req 57344->126975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.388420:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e44c00, rc 0) 00000100:00100000:1.0:1746140889.388456:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:367:x1830960573872128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2804us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.388464:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17301 00000100:00100000:0.0:1746140889.389870:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.389917:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.389955:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573872256 00000100:00100000:1.0:1746140889.389963:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573872256 00000100:00100000:2.0:1746140889.389967:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573872384 00000100:00100000:2.0:1746140889.389971:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573872384 00010000:00010000:1.0:1746140889.389992:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.390006:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.390042:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8966 00000100:00100000:2.0:1746140889.390048:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573872384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.390059:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140889.390075:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8967 00010000:00010000:2.0:1746140889.390077:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.390083:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573872256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.390088:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.390092:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.390193:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e000/0x8156357b7fdbb156 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec8 expref: 26 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.390195:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.390204:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140889.390206:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.390219:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eefec00/0x8156357b7fdbb1cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f00 expref: 28 pid: 8460 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.390227:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573872384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 180us (309us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140889.390227:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.390229:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140889.390233:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8966 00010000:00010000:1.0:1746140889.390235:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.390244:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.390273:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.390290:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576107904:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140889.390358:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140889.391150:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576107904:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140889.391163:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.391181:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573872256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1101us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.391188:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8967 00000100:00100000:3.0:1746140889.391549:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573871616:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7915us (8289us total) trans 21474841480 rc 0/0 00000100:00100000:3.0:1746140889.391557:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1847 00002000:00100000:3.0:1746140889.391565:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1708032->2097151) req@ffff88009abdea00 x1830960573871616/t21474841480(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.391574:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdea00 with x1830960573871616 ext(1708032->2097151) 00010000:00010000:3.0:1746140889.391581:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.391592:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.391599:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abdea00 00000100:00100000:0.0:1746140889.392515:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.392636:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573872640 00000100:00100000:3.0:1746140889.392642:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573872640 00002000:00100000:3.0:1746140889.392669:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (57344->61439) req@ffff880094af7800 x1830960573872640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.392677:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af7800 with x1830960573872640 ext(57344->61439) 00002000:00010000:3.0:1746140889.392681:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af7800 00000100:00100000:3.0:1746140889.392956:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8877 00000100:00100000:3.0:1746140889.392961:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573872640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140889.393359:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960573872640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 397us (848us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140889.393365:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8877 00002000:00100000:3.0:1746140889.393370:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (57344->61439) req@ffff880094af7800 x1830960573872640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.393377:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af7800 with x1830960573872640 ext(57344->61439) 00002000:00010000:3.0:1746140889.393380:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af7800 00000100:00100000:0.0:1746140889.393746:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.393834:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573872768 00000100:00100000:1.0:1746140889.393838:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573872768 00010000:00010000:1.0:1746140889.393855:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.393874:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8968 00000100:00100000:1.0:1746140889.393878:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573872768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.393888:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.393901:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.393915:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.393932:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f8e800/0x8156357b7fdbb16b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1708032->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ed6 expref: 25 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.393944:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.393946:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.393951:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 26 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.393959:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 26 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.393985:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 26 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.393995:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576108032:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140889.394053:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140889.395215:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576108032:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140889.395229:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.395444:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573872768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1564us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.395452:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8968 00000100:00100000:0.0:1746140889.396120:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.396204:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573873024 00000100:00100000:3.0:1746140889.396210:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573873024 00002000:00100000:3.0:1746140889.396236:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (122880->126975) req@ffff880094af5c00 x1830960573873024/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.396245:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5c00 with x1830960573873024 ext(122880->126975) 00002000:00010000:3.0:1746140889.396249:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5c00 00000100:00100000:3.0:1746140889.396272:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8878 00000100:00100000:3.0:1746140889.396278:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573873024:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140889.396452:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573873024:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 174us (334us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140889.396457:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8878 00002000:00100000:3.0:1746140889.396462:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (122880->126975) req@ffff880094af5c00 x1830960573873024/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.396469:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5c00 with x1830960573873024 ext(122880->126975) 00002000:00010000:3.0:1746140889.396471:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5c00 00000100:00100000:0.0:1746140889.397653:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.397776:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573873280 00000100:00100000:2.0:1746140889.397781:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573873280 00002000:00100000:2.0:1746140889.397804:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880094af7480 x1830960573873280/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.397812:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af7480 with x1830960573873280 ext(1048576->2097151) 00002000:00010000:2.0:1746140889.397815:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af7480 00000100:00100000:2.0:1746140889.397836:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8879 00000100:00100000:2.0:1746140889.397840:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573873280:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140889.405097:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573873280:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7244us (7434us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.405109:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8879 00002000:00100000:2.0:1746140889.405123:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880094af7480 x1830960573873280/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.405132:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af7480 with x1830960573873280 ext(1048576->2097151) 00002000:00010000:2.0:1746140889.405138:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af7480 00000100:00100000:0.0:1746140889.410424:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.410483:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573873408 00000100:00100000:1.0:1746140889.410491:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573873408 00000100:00100000:1.0:1746140889.410533:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17302 00000100:00100000:1.0:1746140889.410541:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:365:x1830960573873408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.410559:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.410579:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f54 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.410610:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.410617:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.410618:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.410622:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.410651:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 23 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.410662:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 23 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.410961:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576108160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.411062:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.414374:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.414428:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576108160:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.414467:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.414491:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e45600, rc 0) 00000100:00100000:1.0:1746140889.414553:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:365:x1830960573873408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4012us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.414562:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17302 00000100:00100000:2.0:1746140889.414618:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573873536 00000100:00100000:2.0:1746140889.414626:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573873536 00002000:00100000:2.0:1746140889.414667:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2363391) req@ffff880094af4000 x1830960573873536/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.414677:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4000 with x1830960573873536 ext(2097152->2363391) 00010000:00010000:2.0:1746140889.414686:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 24 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.414700:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 24 pid: 24958 timeout: 968 lvb_type: 0 00002000:00010000:2.0:1746140889.414705:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094af4000 00000100:00100000:2.0:1746140889.414742:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1848 00000100:00100000:2.0:1746140889.414750:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573873536:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140889.418580:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573873536:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3818us (4206us total) trans 21474841481 rc 0/0 00000100:00100000:2.0:1746140889.418591:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1848 00002000:00100000:2.0:1746140889.418602:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2363391) req@ffff880094af4000 x1830960573873536/t21474841481(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.418611:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af4000 with x1830960573873536 ext(2097152->2363391) 00010000:00010000:2.0:1746140889.418621:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 26 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.418636:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 26 pid: 24958 timeout: 968 lvb_type: 0 00002000:00010000:2.0:1746140889.418642:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094af4000 00000100:00100000:0.0:1746140889.420537:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.420648:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573873664 00000100:00100000:1.0:1746140889.420660:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573873664 00010000:00010000:1.0:1746140889.420701:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 26 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.420755:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8969 00000100:00100000:1.0:1746140889.420763:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573873664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.420777:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746140889.420797:0:7110:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140889 -> 1746140890 00010000:00010000:1.0:1746140889.420803:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 26 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.420815:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 26 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.420842:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb179 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2363391) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ee4 expref: 26 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.420873:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.420875:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.420881:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.420891:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.420937:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.420949:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576108288:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140889.421060:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140889.422487:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576108288:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140889.422504:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.422547:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573873664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1783us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.422555:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8969 00000100:00100000:0.0:1746140889.425670:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.425763:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573873920 00000100:00100000:2.0:1746140889.425773:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573873920 00002000:00100000:2.0:1746140889.425812:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880094452d80 x1830960573873920/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.425824:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094452d80 with x1830960573873920 ext(2097152->3145727) 00002000:00010000:2.0:1746140889.425828:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094452d80 00000100:00100000:2.0:1746140889.425917:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8880 00000100:00100000:2.0:1746140889.425925:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573873920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.432176:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573873920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6237us (6501us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.432189:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8880 00002000:00100000:2.0:1746140889.432200:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880094452d80 x1830960573873920/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.432210:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094452d80 with x1830960573873920 ext(2097152->3145727) 00002000:00010000:2.0:1746140889.432216:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094452d80 00000100:00100000:0.0:1746140889.439777:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.439849:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573874176 00000100:00100000:2.0:1746140889.439859:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573874176 00002000:00100000:2.0:1746140889.439903:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094453480 x1830960573874176/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.439921:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094453480 with x1830960573874176 ext(4194304->4886527) 00002000:00010000:2.0:1746140889.439926:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094453480 00000100:00100000:2.0:1746140889.439962:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8881 00000100:00100000:2.0:1746140889.439970:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573874176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.446149:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573874176:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6159us (6364us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140889.446163:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8881 00002000:00100000:2.0:1746140889.446177:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094453480 x1830960573874176/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.446187:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094453480 with x1830960573874176 ext(4194304->4886527) 00002000:00010000:2.0:1746140889.446194:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094453480 00000100:00100000:0.0:1746140889.450879:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.450971:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573874432 00000100:00100000:1.0:1746140889.450980:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573874432 00000100:00100000:1.0:1746140889.451050:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4766 00000100:00100000:1.0:1746140889.451057:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+296:365:x1830960573874432:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140889.451355:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:365:x1830960573874432:12345-192.168.204.16@tcp:35:cat.0 Request processed in 298us (486us total) trans 8589945144 rc 0/0 00000100:00100000:1.0:1746140889.451362:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4766 00000100:00100000:0.0:1746140889.488473:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.488719:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573874688 00000100:00100000:2.0:1746140889.488728:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573874688 00000100:00100000:2.0:1746140889.488785:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10822 00000100:00100000:2.0:1746140889.488793:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+33:372:x1830960573874688:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140889.488817:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.488835:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f5b expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.488937:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.488952:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.488962:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140889.488973:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.489105:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7d200/0x8156357b7fdbb228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 36 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.489136:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 35 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.489144:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.489146:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140889.489149:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c422e00, rc 0) 00000100:00100000:2.0:1746140889.489350:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+35:372:x1830960573874688:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 557us (887us total) trans 8589945145 rc 0/0 00000100:00100000:2.0:1746140889.489357:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10822 00000100:00100000:0.0:1746140889.569663:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.569735:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573874944 00000100:00100000:2.0:1746140889.569744:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573874944 00000100:00100000:2.0:1746140889.569797:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10823 00000100:00100000:2.0:1746140889.569805:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+297:375:x1830960573874944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.569832:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.569853:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb23d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f62 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.569991:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570004:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570044:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570075:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570082:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570087:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570200:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb252 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570210:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb252 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570214:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb252 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140889.570222:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.570295:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570299:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570346:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570351:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee72c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.570355:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570361:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570371:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140889.570374:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.570377:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570382:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee72c00/0x8156357b7fdbb244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570403:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570408:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570412:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570417:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff0e000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.570419:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570424:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570429:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f600) 00010000:00010000:2.0:1746140889.570431:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.570433:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570437:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb24b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.570473:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb23d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f62 expref: 300 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.570484:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb252 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f62 expref: 299 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.570489:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.570491:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140889.570494:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0e200, rc 0) 00000100:00100000:2.0:1746140889.570547:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+299:375:x1830960573874944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 743us (896us total) trans 8589945146 rc 0/0 00000100:00100000:2.0:1746140889.570554:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10823 00000100:00100000:0.0:1746140889.571983:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.572091:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573875072 00000100:00100000:1.0:1746140889.572098:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573875072 00000100:00100000:1.0:1746140889.572149:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 786 00000100:00100000:1.0:1746140889.572156:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+299:1982:x1830960573875072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.572169:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.572184:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb252 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f62 expref: 299 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.572210:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.572214:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.572241:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+298:1982:x1830960573875072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.572247:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 786 00000100:00100000:1.0:1746140889.575677:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.575740:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573875328 00000100:00100000:2.0:1746140889.575749:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573875328 00002000:00100000:2.0:1746140889.575791:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801359b3100 x1830960573875328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 504/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.575801:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b3100 with x1830960573875328 ext(0->1048575) 00002000:00010000:2.0:1746140889.575806:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b3100 00000100:00100000:2.0:1746140889.575834:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8882 00000100:00100000:2.0:1746140889.575840:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573875328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.584147:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960573875328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8296us (8467us total) trans 0 rc 978944/978944 00000100:00100000:2.0:1746140889.584158:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8882 00002000:00100000:2.0:1746140889.584169:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801359b3100 x1830960573875328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 504/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.584179:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b3100 with x1830960573875328 ext(0->1048575) 00002000:00010000:2.0:1746140889.584185:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b3100 00000100:00100000:0.0:1746140889.600021:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.600373:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.600413:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.600455:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.600480:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573875712 00000100:00100000:0.0:1746140889.600488:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573875712 00000100:00100000:0.0:1746140889.600527:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573875840 00000100:00100000:0.0:1746140889.600529:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573875840 00000100:00100000:0.0:1746140889.600540:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573875968 00000100:00100000:0.0:1746140889.600542:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573875968 00000100:00100000:2.0:1746140889.600551:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17303 00000100:00100000:2.0:1746140889.600561:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573875712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.600580:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140889.600594:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573875584 00010000:00010000:2.0:1746140889.600597:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e400/0x8156357b7fdbb260 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f69 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.600597:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573875584 00000100:00100000:1.0:1746140889.600627:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4767 00000100:00100000:1.0:1746140889.600633:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+298:375:x1830960573875584:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140889.600654:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576108416:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140889.600738:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.600882:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17304 00000100:00100000:3.0:1746140889.600890:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17305 00000100:00100000:3.0:1746140889.600899:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573875968:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140889.600900:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573875840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.600927:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.600934:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f77 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.600942:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.600946:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.600948:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.600950:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f70 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.600955:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 29 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.600961:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.600962:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.600967:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 30 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.600970:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 30 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.600975:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 30 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.600980:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c24a00, rc 0) 00010000:00010000:2.0:1746140889.600982:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0e800, rc 0) 00000100:00100000:3.0:1746140889.601007:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1983:x1830960573875968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 110us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.601007:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1983:x1830960573875840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 119us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.601025:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17304 00000100:00100000:3.0:1746140889.601029:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17305 00000100:00100000:1.0:1746140889.601040:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+299:375:x1830960573875584:12345-192.168.204.16@tcp:35:cat.0 Request processed in 407us (1040us total) trans 8589945147 rc 0/0 00000100:00100000:1.0:1746140889.601046:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4767 00002000:00010000:2.0:1746140889.602659:0:32377:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime: 1746140889 -> 1746140890 00002000:00010000:2.0:1746140889.602666:0:32377:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime: 1746140889 -> 1746140890 00002000:00010000:2.0:1746140889.602668:0:32377:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime: 1746140889 -> 1746140890 00000100:00100000:2.0:1746140889.602689:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576108416:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140889.602718:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e400/0x8156357b7fdbb260 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f69 expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.602730:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e400/0x8156357b7fdbb260 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f69 expref: 28 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.602744:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0e400, rc 0) 00000100:00100000:2.0:1746140889.602780:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573875712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2221us (2407us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140889.602786:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17303 00000100:00100000:0.0:1746140889.606215:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.607021:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573876096 00000100:00100000:2.0:1746140889.607031:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573876096 00000100:00100000:2.0:1746140889.607072:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17306 00000100:00100000:2.0:1746140889.607079:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:378:x1830960573876096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.607099:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.607121:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f7e expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.607154:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.607162:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140889.607164:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140889.607167:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.607196:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.607214:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.607226:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576108544:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.608358:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.609446:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.609797:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573876224 00000100:00100000:3.0:1746140889.609806:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573876224 00002000:00100000:3.0:1746140889.609850:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (57344->126975) req@ffff8801354bfb80 x1830960573876224/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.609861:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bfb80 with x1830960573876224 ext(57344->126975) 00010000:00010000:3.0:1746140889.609870:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.609885:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.609891:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801354bfb80 00000100:00100000:3.0:1746140889.609909:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1849 00000100:00100000:3.0:1746140889.609917:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573876224:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140889.610271:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576108544:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.610297:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 28 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.610340:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0e600, rc 0) 00000100:00100000:2.0:1746140889.610366:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+28:378:x1830960573876096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3287us (4169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.610373:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17306 00000100:00100000:0.0:1746140889.614244:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.614382:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573876480 00000100:00100000:2.0:1746140889.614392:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573876480 00000100:00100000:2.0:1746140889.614435:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10824 00000100:00100000:2.0:1746140889.614442:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+299:381:x1830960573876480:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140889.614464:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.614481:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ea00/0x8156357b7fdbb27c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f85 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.614584:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614596:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614606:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614619:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614625:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614630:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140889.614737:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573876224:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4819us (5294us total) trans 21474841482 rc 0/0 00010000:00010000:2.0:1746140889.614741:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f000/0x8156357b7fdbb291 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140889.614747:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1849 00010000:00010000:2.0:1746140889.614750:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f000/0x8156357b7fdbb291 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00002000:00100000:3.0:1746140889.614755:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (57344->126975) req@ffff8801354bfb80 x1830960573876224/t21474841482(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746140889.614756:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f000/0x8156357b7fdbb291 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140889.614764:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00002000:00100000:3.0:1746140889.614765:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bfb80 with x1830960573876224 ext(57344->126975) 00010000:00010000:3.0:1746140889.614772:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 30 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.614790:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 30 pid: 8458 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.614796:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801354bfb80 00010000:00010000:2.0:1746140889.614830:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614836:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614846:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614851:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff0ec00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.614855:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614862:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614871:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140889.614874:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.614878:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614882:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ec00/0x8156357b7fdbb283 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614896:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614901:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614906:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614910:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff0ee00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.614912:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614916:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614924:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f200) 00010000:00010000:2.0:1746140889.614926:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.614928:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614932:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb28a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.614965:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ea00/0x8156357b7fdbb27c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f85 expref: 302 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.614975:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f000/0x8156357b7fdbb291 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f85 expref: 301 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.614982:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.614984:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140889.614986:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0f000, rc 0) 00000100:00100000:2.0:1746140889.615028:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:381:x1830960573876480:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 586us (794us total) trans 8589945148 rc 0/0 00000100:00100000:2.0:1746140889.615034:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10824 00000100:00100000:0.0:1746140889.617649:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.617730:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573876608 00000100:00100000:2.0:1746140889.617738:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573876608 00000100:00100000:2.0:1746140889.617791:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 787 00000100:00100000:2.0:1746140889.617798:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:1983:x1830960573876608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.617814:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140889.618142:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140889.618216:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f000/0x8156357b7fdbb291 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f85 expref: 301 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140889.618233:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140889.618253:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.618257:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.618281:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573876864 00000100:00100000:1.0:1746140889.618285:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573876864 00000100:00100000:2.0:1746140889.618297:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:1983:x1830960573876608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 499us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.618320:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 787 00000100:00100000:1.0:1746140889.618326:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4768 00000100:00100000:1.0:1746140889.618330:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:381:x1830960573876864:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140889.618395:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573876992 00000100:00100000:3.0:1746140889.618399:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573876992 00010000:00010000:3.0:1746140889.618418:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 30 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.618446:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8970 00000100:00100000:3.0:1746140889.618452:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573876992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.618460:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.618478:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 30 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.618488:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 30 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.618502:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb21a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 57344->126975) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f4d expref: 30 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.618516:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140889.618517:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:381:x1830960573876864:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 185us (375us total) trans 8589945149 rc 0/0 00010000:00010000:3.0:1746140889.618518:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140889.618523:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4768 00010000:00010000:3.0:1746140889.618527:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.618540:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.618697:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.618710:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576108672:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140889.618777:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b2579c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.619730:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576108672:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140889.619745:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.619800:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573876992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1346us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.619807:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8970 00000100:00100000:2.0:1746140889.624758:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.624808:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.624845:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573877248 00000100:00100000:3.0:1746140889.624855:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573877248 00000100:00100000:0.0:1746140889.624880:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573877504 00000100:00100000:0.0:1746140889.624884:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573877504 00002000:00100000:3.0:1746140889.624897:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88012b181f80 x1830960573877248/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140889.624904:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012b183480 x1830960573877504/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.624906:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181f80 with x1830960573877248 ext(0->1048575) 00002000:00100000:0.0:1746140889.624911:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b183480 with x1830960573877504 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.624912:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b181f80 00002000:00010000:0.0:1746140889.624915:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b183480 00000100:00100000:3.0:1746140889.624937:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8883 00000100:00100000:3.0:1746140889.624944:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1983:x1830960573877248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140889.624949:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8884 00000100:00100000:0.0:1746140889.624956:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1983:x1830960573877504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.626256:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.626402:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573877632 00000100:00100000:2.0:1746140889.626408:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573877632 00000100:00100000:2.0:1746140889.626437:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17307 00000100:00100000:2.0:1746140889.626443:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:381:x1830960573877632:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140889.626454:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.626471:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f8c expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.626497:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 37 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.626504:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 17 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.626510:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.626511:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.626514:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3047424->3145727] (req 3047424->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 37 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.626545:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 17 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.626556:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 17 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.626567:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576108800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.627164:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 37 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.627173:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 37 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.627182:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576108928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.627207:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.631865:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.632124:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573877760 00000100:00100000:1.0:1746140889.632132:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573877760 00000100:00100000:2.0:1746140889.632188:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576108800:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.632786:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17308 00000100:00100000:1.0:1746140889.632795:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:372:x1830960573877760:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140889.632813:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.632829:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f93 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.632859:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 19 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.632868:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 37 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.632878:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.632880:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.632883:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1568768->2097151] (req 1568768->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 19 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.632914:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 37 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.632924:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 37 pid: 24958 timeout: 968 lvb_type: 1 00000100:00100000:1.0:1746140889.632936:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576109056:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.633487:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 19 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.633497:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 19 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.633505:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576109184:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.634064:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.635994:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1983:x1830960573877248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11041us (11238us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.636019:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8883 00002000:00100000:3.0:1746140889.636031:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88012b181f80 x1830960573877248/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.636040:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181f80 with x1830960573877248 ext(0->1048575) 00002000:00010000:3.0:1746140889.636045:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b181f80 00000100:00100000:0.0:1746140889.636496:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.636523:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.636524:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576108928:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.636556:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3047424->3145727] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 37 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.636571:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0ee00, rc 0) 00000100:00100000:3.0:1746140889.636587:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573877888 00000100:00100000:3.0:1746140889.636594:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573877888 00000100:00100000:2.0:1746140889.636611:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573878016 00000100:00100000:2.0:1746140889.636614:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573878016 00010000:00010000:3.0:1746140889.636616:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 20 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.636625:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 38 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.636634:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8971 00000100:00100000:3.0:1746140889.636640:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573877888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.636649:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140889.636649:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8972 00000100:00100000:2.0:1746140889.636653:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573878016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.636657:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.636667:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 20 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.636667:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 38 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.636676:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 20 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.636906:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 38 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.636926:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d215e00/0x8156357b7fdbb0fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e9e expref: 38 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.636950:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.636968:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573878016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 315us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.636975:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8972 00010000:00010000:3.0:1746140889.637130:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb148 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ec1 expref: 20 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.637150:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.637152:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.637159:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 36 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.637166:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 36 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.637195:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 36 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.637206:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576109312:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140889.637250:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.637273:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:381:x1830960573877632:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10830us (11022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.637280:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17307 00000100:00100000:1.0:1746140889.638483:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576109056:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.638491:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576109184:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.638512:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1568768->2097151] (req 1568768->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 19 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.638522:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e45c00, rc 0) 00000100:00100000:1.0:1746140889.638544:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+19:372:x1830960573877760:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5752us (6695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.638550:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17308 00000100:00100000:2.0:1746140889.638821:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573877504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13865us (14012us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.638829:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8884 00002000:00100000:2.0:1746140889.638837:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012b183480 x1830960573877504/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.638845:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b183480 with x1830960573877504 ext(1048576->2097151) 00002000:00010000:2.0:1746140889.638849:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b183480 00000100:00100000:0.0:1746140889.640812:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.640893:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.640945:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573878272 00000100:00100000:1.0:1746140889.640947:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573878400 00000100:00100000:2.0:1746140889.640954:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573878272 00000100:00100000:1.0:1746140889.640954:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573878400 00010000:00010000:2.0:1746140889.640985:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 36 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.640986:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 19 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.641024:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8973 00000100:00100000:2.0:1746140889.641030:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8974 00000100:00100000:1.0:1746140889.641030:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573878400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140889.641035:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573878272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.641044:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.641044:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.641063:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 36 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.641063:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 19 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.641073:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 36 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.641325:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 19 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.641349:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d214800/0x8156357b7fdbb1b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f0e expref: 36 pid: 24958 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.641573:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.641573:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308f2800/0x8156357b7fdbb187 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef2 expref: 19 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.641576:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.641583:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.641592:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.641663:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576109312:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140889.641682:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140889.641733:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140889.641751:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.641764:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576109440:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140889.641975:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573877888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5333us (5479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.641983:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8971 00000100:00100000:1.0:1746140889.642066:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573878400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1035us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.642072:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8973 00000100:00100000:2.0:1746140889.642090:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.642146:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.642187:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573878528 00000100:00100000:2.0:1746140889.642190:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573878528 00002000:00100000:2.0:1746140889.642215:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3047424->3051519) req@ffff8801354bd880 x1830960573878528/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.642229:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd880 with x1830960573878528 ext(3047424->3051519) 00002000:00010000:2.0:1746140889.642233:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bd880 00000100:00100000:2.0:1746140889.642246:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8885 00000100:00100000:2.0:1746140889.642252:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573878528:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140889.642413:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573878528:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 161us (267us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140889.642419:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8885 00002000:00100000:2.0:1746140889.642424:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3047424->3051519) req@ffff8801354bd880 x1830960573878528/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.642430:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bd880 with x1830960573878528 ext(3047424->3051519) 00002000:00010000:2.0:1746140889.642433:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bd880 00000100:00100000:2.0:1746140889.643853:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.643935:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576109440:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140889.643950:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140889.643988:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573878272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2953us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.643995:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8974 00000100:00100000:3.0:1746140889.644081:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573878784 00000100:00100000:3.0:1746140889.644086:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573878784 00002000:00100000:3.0:1746140889.644110:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1568768->1572863) req@ffff88012b180700 x1830960573878784/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.644122:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180700 with x1830960573878784 ext(1568768->1572863) 00002000:00010000:3.0:1746140889.644127:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b180700 00000100:00100000:3.0:1746140889.644150:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8886 00000100:00100000:3.0:1746140889.644156:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573878784:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140889.644573:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573878784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 417us (723us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140889.644579:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8886 00002000:00100000:3.0:1746140889.644583:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1568768->1572863) req@ffff88012b180700 x1830960573878784/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.644589:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180700 with x1830960573878784 ext(1568768->1572863) 00002000:00010000:3.0:1746140889.644592:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b180700 00000100:00100000:0.0:1746140889.645242:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.645373:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573878912 00000100:00100000:1.0:1746140889.645378:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573878912 00000100:00100000:1.0:1746140889.645417:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17309 00000100:00100000:1.0:1746140889.645423:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:381:x1830960573878912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140889.645433:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.645449:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1f9a expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.645482:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 30 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.645490:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 27 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.645495:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.645502:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 27 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.645508:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746140889.645510:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746140889.645513:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 7/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->3178495] (req 3145728->3178495) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 30 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.645539:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 27 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.645550:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 27 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.645560:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576109568:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.645626:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 30 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.645633:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 30 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:0.0:1746140889.646113:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.646148:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573879168 00000100:00100000:3.0:1746140889.646152:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573879168 00002000:00100000:3.0:1746140889.646173:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801354bce00 x1830960573879168/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 504/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.646185:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bce00 with x1830960573879168 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.646189:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bce00 00000100:00100000:3.0:1746140889.646210:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8887 00000100:00100000:3.0:1746140889.646215:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1983:x1830960573879168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140889.646300:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576109696:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.646379:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 27 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.646391:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 27 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:1.0:1746140889.646398:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576109824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.646420:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 30 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.646427:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 30 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.646434:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576109952:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.646448:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746140889.646968:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576109568:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140889.648036:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.648216:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573879296 00000100:00100000:1.0:1746140889.648222:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573879296 00010000:00010000:1.0:1746140889.648249:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 28 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.648272:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8975 00000100:00100000:1.0:1746140889.648279:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573879296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.648288:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.648327:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 28 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.648342:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 28 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.648363:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e5b5400/0x8156357b7fdbaff1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e12 expref: 28 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.648377:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.648405:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573879296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 127us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.648410:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8975 00000100:00100000:1.0:1746140889.648691:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576109696:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.648699:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576109824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.648704:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576109952:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.648731:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->3178495] (req 3145728->3178495) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 30 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.648740:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e45000, rc 0) 00000100:00100000:1.0:1746140889.648762:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:381:x1830960573878912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3340us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.648768:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17309 00000100:00100000:2.0:1746140889.651376:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.651436:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.651445:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573879424 00000100:00100000:1.0:1746140889.651453:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573879424 00010000:00010000:1.0:1746140889.651481:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 30 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.651521:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573879552 00000100:00100000:1.0:1746140889.651523:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573879552 00010000:00010000:1.0:1746140889.651535:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 27 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:1.0:1746140889.651560:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8976 00000100:00100000:1.0:1746140889.651567:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573879424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140889.651567:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8977 00000100:00100000:0.0:1746140889.651574:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573879552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.651578:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140889.651582:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.651600:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 30 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.651601:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 27 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.651610:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 30 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.651711:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 27 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.651732:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c400/0x8156357b7fdbafea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1e19 expref: 30 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.651736:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c24a00/0x8156357b7fdbb267 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f77 expref: 27 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.651767:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140889.651786:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140889.651799:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573879552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 226us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.651804:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1983:x1830960573879424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 239us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.651806:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8977 00000100:00100000:1.0:1746140889.651811:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8976 00000100:00100000:0.0:1746140889.653518:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.653600:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573879680 00000100:00100000:1.0:1746140889.653607:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573879680 00010000:00010000:1.0:1746140889.653639:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.653675:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8978 00000100:00100000:1.0:1746140889.653681:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573879680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140889.653691:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.653711:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.653722:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.653738:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e45600/0x8156357b7fdbb221 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f54 expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.653750:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.653752:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.653758:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.653766:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.653796:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.653807:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576110080:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140889.653883:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.655516:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.655572:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573879936 00000100:00100000:2.0:1746140889.655746:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573879936 00002000:00100000:2.0:1746140889.655781:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3174400->3178495) req@ffff8801354bea00 x1830960573879936/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.655791:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bea00 with x1830960573879936 ext(3174400->3178495) 00002000:00010000:2.0:1746140889.655796:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bea00 00000100:00100000:2.0:1746140889.655815:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8888 00000100:00100000:2.0:1746140889.655821:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573879936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140889.655979:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573879936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 158us (471us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140889.655986:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8888 00002000:00100000:2.0:1746140889.655992:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3174400->3178495) req@ffff8801354bea00 x1830960573879936/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.655998:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bea00 with x1830960573879936 ext(3174400->3178495) 00002000:00010000:2.0:1746140889.656001:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bea00 00000100:00100000:1.0:1746140889.656166:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576110080:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140889.656186:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.656224:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960573879680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2543us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.656232:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8978 00000100:00100000:3.0:1746140889.656987:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1983:x1830960573879168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10769us (10872us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746140889.656995:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8887 00002000:00100000:3.0:1746140889.657001:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801354bce00 x1830960573879168/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 504/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.657021:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bce00 with x1830960573879168 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.657026:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801354bce00 00000100:00100000:0.0:1746140889.662806:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.662872:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573880064 00000100:00100000:1.0:1746140889.662882:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573880064 00000100:00100000:1.0:1746140889.662945:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17310 00000100:00100000:1.0:1746140889.662953:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:372:x1830960573880064:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140889.662970:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.662987:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fa1 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.663028:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.663037:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 27 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.663043:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.663045:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.663048:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1548287] (req 1048576->1548287) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.663084:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 27 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.663098:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 27 pid: 8458 timeout: 968 lvb_type: 1 00000100:00100000:1.0:1746140889.663110:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576110208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.663210:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.663218:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.663226:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576110336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.663244:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.667282:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.667340:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576110208:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140889.667350:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.667354:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576110336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.667391:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1548287] (req 1048576->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.667410:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e44400, rc 0) 00000100:00100000:1.0:1746140889.667461:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+27:372:x1830960573880064:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4509us (4667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.667469:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17310 00000100:00100000:1.0:1746140889.667496:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573880320 00000100:00100000:1.0:1746140889.667501:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573880320 00000100:00100000:1.0:1746140889.667528:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17311 00000100:00100000:2.0:1746140889.667675:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573880192 00000100:00100000:2.0:1746140889.667680:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573880192 00000100:00100000:1.0:1746140889.667695:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+27:378:x1830960573880320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.667698:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.667709:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140889.667730:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8979 00000100:00100000:2.0:1746140889.667736:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573880192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.667747:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.667768:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.667778:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.667797:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e44800/0x8156357b7fdbb213 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f46 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.667816:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.667846:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960573880192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 110us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.667855:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8979 00010000:00010000:1.0:1746140889.667978:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fa8 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.668004:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.668006:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.668024:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.668034:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.668041:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e44a00, rc 0) 00000100:00100000:1.0:1746140889.668076:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:378:x1830960573880320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 543us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.668082:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17311 00000100:00100000:0.0:1746140889.668659:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.668691:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573880448 00000100:00100000:2.0:1746140889.668694:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573880448 00010000:00010000:2.0:1746140889.668705:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 28 pid: 8458 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.668728:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8980 00000100:00100000:2.0:1746140889.668731:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573880448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.668736:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.668743:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 28 pid: 8458 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.668750:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 28 pid: 8458 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.668758:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e800/0x8156357b7fdbb26e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f70 expref: 28 pid: 8458 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.668764:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.668766:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.668770:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.668774:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.668793:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.668806:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576110464:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.668860:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.670994:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576110464:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.671028:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.671058:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573880448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2326us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.671066:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8980 00000100:00100000:0.0:1746140889.673674:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.673776:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573880704 00000100:00100000:3.0:1746140889.673785:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573880704 00002000:00100000:3.0:1746140889.673828:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f729180 x1830960573880704/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.673839:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729180 with x1830960573880704 ext(2097152->3145727) 00002000:00010000:3.0:1746140889.673844:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f729180 00000100:00100000:3.0:1746140889.673948:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8889 00000100:00100000:3.0:1746140889.673956:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573880704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.676619:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.678171:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573880960 00000100:00100000:1.0:1746140889.678183:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573880960 00002000:00100000:1.0:1746140889.678231:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1544192->1548287) req@ffff88012b182d80 x1830960573880960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.678375:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182d80 with x1830960573880960 ext(1544192->1548287) 00002000:00010000:1.0:1746140889.678385:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b182d80 00000100:00100000:1.0:1746140889.678420:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8890 00000100:00100000:1.0:1746140889.678428:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573880960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.678622:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573880960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 194us (2012us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140889.678629:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8890 00002000:00100000:1.0:1746140889.678634:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1544192->1548287) req@ffff88012b182d80 x1830960573880960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.678642:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182d80 with x1830960573880960 ext(1544192->1548287) 00002000:00010000:1.0:1746140889.678645:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b182d80 00000100:00100000:3.0:1746140889.682353:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573880704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8388us (8676us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.682364:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8889 00002000:00100000:3.0:1746140889.682373:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f729180 x1830960573880704/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.682384:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729180 with x1830960573880704 ext(2097152->3145727) 00002000:00010000:3.0:1746140889.682389:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f729180 00000100:00100000:0.0:1746140889.684769:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.684892:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573881088 00000100:00100000:1.0:1746140889.684900:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573881088 00000100:00100000:1.0:1746140889.684985:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17312 00000100:00100000:1.0:1746140889.684994:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:378:x1830960573881088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.685027:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.685044:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1faf expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.685071:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 34 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.685078:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.685080:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.685083:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.685112:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 34 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.685123:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 34 pid: 32377 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.685135:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576110592:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.685212:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746140889.687661:0:1272:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746140889.687852:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.687899:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573881216 00000100:00100000:3.0:1746140889.687905:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573881216 00000100:00100000:1.0:1746140889.687908:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576110592:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.687933:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 18 pid: 8458 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140889.687941:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3047424->3145727) req@ffff88012b180380 x1830960573881216/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746140889.687948:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e44e00, rc 0) 00002000:00100000:3.0:1746140889.687955:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180380 with x1830960573881216 ext(3047424->3145727) 00010000:00010000:3.0:1746140889.687961:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 35 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.687972:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 35 pid: 32377 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.687979:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b180380 00000100:00100000:1.0:1746140889.688006:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:378:x1830960573881088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3013us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.688021:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1850 00000100:00100000:1.0:1746140889.688025:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17312 00000100:00100000:3.0:1746140889.688027:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573881216:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140889.691244:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573881216:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3205us (3389us total) trans 17179874191 rc 0/0 00000100:00100000:3.0:1746140889.691255:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1850 00002000:00100000:3.0:1746140889.691266:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3047424->3145727) req@ffff88012b180380 x1830960573881216/t17179874191(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.691276:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180380 with x1830960573881216 ext(3047424->3145727) 00010000:00010000:3.0:1746140889.691286:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 37 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.691302:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 37 pid: 32377 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.691337:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b180380 00000100:00100000:0.0:1746140889.692899:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.692953:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573881344 00000100:00100000:2.0:1746140889.692962:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573881344 00010000:00010000:2.0:1746140889.692990:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 37 pid: 32377 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.693033:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8981 00000100:00100000:2.0:1746140889.693039:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573881344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.693051:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746140889.693066:0:7111:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140889 -> 1746140890 00002000:00010000:2.0:1746140889.693069:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140889 -> 1746140890 00010000:00010000:2.0:1746140889.693074:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 37 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.693084:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 37 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.693109:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb29f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f8c expref: 37 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.693139:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.693142:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.693149:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.693157:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.693189:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.693200:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576110720:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.693392:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.694616:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576110720:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.694630:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.694651:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573881344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1613us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.694657:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8981 00000100:00100000:0.0:1746140889.696340:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.696407:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573881600 00000100:00100000:3.0:1746140889.696416:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573881600 00002000:00100000:3.0:1746140889.696450:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f728e00 x1830960573881600/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.696457:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728e00 with x1830960573881600 ext(2097152->3145727) 00002000:00010000:3.0:1746140889.696460:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f728e00 00000100:00100000:3.0:1746140889.696484:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8891 00000100:00100000:3.0:1746140889.696490:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573881600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.702563:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573881600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6060us (6248us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.702574:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8891 00002000:00100000:3.0:1746140889.702587:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f728e00 x1830960573881600/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.702596:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728e00 with x1830960573881600 ext(2097152->3145727) 00002000:00010000:3.0:1746140889.702602:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f728e00 00000100:00100000:0.0:1746140889.705956:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.706041:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573881728 00000100:00100000:1.0:1746140889.706052:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573881728 00000100:00100000:1.0:1746140889.706108:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17313 00000100:00100000:1.0:1746140889.706115:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+27:378:x1830960573881728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.706133:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.706150:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fb6 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.706185:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 26 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.706193:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.706197:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.706200:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.706229:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 26 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.706240:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 26 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.706253:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576110848:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.706375:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.708730:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.708804:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573881856 00000100:00100000:3.0:1746140889.708812:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573881856 00002000:00100000:3.0:1746140889.708853:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->3178495) req@ffff88009f729f80 x1830960573881856/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.708862:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729f80 with x1830960573881856 ext(3145728->3178495) 00010000:00010000:3.0:1746140889.708871:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.708885:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.708897:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f729f80 00000100:00100000:3.0:1746140889.708915:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1851 00000100:00100000:3.0:1746140889.708921:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960573881856:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140889.709092:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576110848:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.709116:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 28 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.709130:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e45400, rc 0) 00000100:00100000:1.0:1746140889.709166:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:378:x1830960573881728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3052us (3222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.709173:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17313 00000100:00100000:3.0:1746140889.711389:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960573881856:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2458us (2660us total) trans 21474841483 rc 0/0 00000100:00100000:3.0:1746140889.711400:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1851 00002000:00100000:3.0:1746140889.711410:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->3178495) req@ffff88009f729f80 x1830960573881856/t21474841483(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.711419:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729f80 with x1830960573881856 ext(3145728->3178495) 00010000:00010000:3.0:1746140889.711428:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.711442:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00002000:00010000:3.0:1746140889.711448:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f729f80 00000100:00100000:0.0:1746140889.712801:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.712927:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573881984 00000100:00100000:2.0:1746140889.712938:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573881984 00010000:00010000:2.0:1746140889.712975:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.713033:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8982 00000100:00100000:2.0:1746140889.713040:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1982:x1830960573881984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.713053:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746140889.713069:0:7111:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140889 -> 1746140890 00002000:00010000:2.0:1746140889.713071:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140889 -> 1746140890 00010000:00010000:2.0:1746140889.713077:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.713087:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.713108:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e45000/0x8156357b7fdbb2ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3178495) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f9a expref: 29 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.713133:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.713135:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.713141:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.713149:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.713184:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.713279:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576110976:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140889.713565:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.714469:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576110976:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140889.714486:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.714509:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960573881984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1470us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.714517:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8982 00000100:00100000:0.0:1746140889.718147:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.718212:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.718244:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573882240 00000100:00100000:3.0:1746140889.718253:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573882240 00000100:00100000:1.0:1746140889.718292:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573882496 00002000:00100000:3.0:1746140889.718294:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f729880 x1830960573882240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140889.718296:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573882496 00002000:00100000:3.0:1746140889.718326:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729880 with x1830960573882240 ext(3145728->4194303) 00002000:00010000:3.0:1746140889.718331:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f729880 00002000:00100000:1.0:1746140889.718335:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f728700 x1830960573882496/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.718343:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728700 with x1830960573882496 ext(3145728->4194303) 00002000:00010000:1.0:1746140889.718346:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f728700 00000100:00100000:3.0:1746140889.718362:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8892 00000100:00100000:3.0:1746140889.718370:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573882240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.718405:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8893 00000100:00100000:1.0:1746140889.718412:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573882496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.726123:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573882496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7698us (7897us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140889.726135:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8893 00002000:00100000:1.0:1746140889.726146:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f728700 x1830960573882496/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.726161:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f728700 with x1830960573882496 ext(3145728->4194303) 00002000:00010000:1.0:1746140889.726167:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f728700 00000100:00100000:3.0:1746140889.727434:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573882240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9057us (9287us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.727446:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8892 00002000:00100000:3.0:1746140889.727456:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f729880 x1830960573882240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.727465:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f729880 with x1830960573882240 ext(3145728->4194303) 00002000:00010000:3.0:1746140889.727470:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f729880 00000100:00100000:0.0:1746140889.740967:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.741130:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573882624 00000100:00100000:2.0:1746140889.741140:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573882624 00000100:00100000:2.0:1746140889.741195:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10825 00000100:00100000:2.0:1746140889.741202:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:386:x1830960573882624:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140889.741224:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.741242:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e400/0x8156357b7fdbb2d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fbd expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.741337:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.741349:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.741359:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.741372:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.741378:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.741383:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.741485:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.741494:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 300 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.741501:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 34 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.741506:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.741532:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 34 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.741542:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 34 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.741552:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576111104:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.741645:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 300 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.741652:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 300 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.741658:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576111232:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.741674:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.742695:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.742736:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.742782:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573883008 00000100:00100000:1.0:1746140889.742789:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573883008 00000100:00100000:1.0:1746140889.742824:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573883136 00000100:00100000:1.0:1746140889.742827:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573883136 00000100:00100000:1.0:1746140889.742841:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4769 00000100:00100000:1.0:1746140889.742846:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca78850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+35:27093:x1830960573883008:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746140889.742881:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4770 00000100:00100000:3.0:1746140889.742898:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:24364:x1830960573883136:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746140889.743029:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca78850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+36:27093:x1830960573883008:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 181us (336us total) trans 8589945150 rc 0/0 00000100:00100000:1.0:1746140889.743036:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4769 00000100:00100000:3.0:1746140889.743113:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+302:24364:x1830960573883136:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 222us (377us total) trans 8589945151 rc 0/0 00000100:00100000:3.0:1746140889.743120:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4770 00000100:00100000:2.0:1746140889.743224:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576111104:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.743233:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576111232:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.743250:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140889.744635:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.744674:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.744748:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573883392 00000100:00100000:3.0:1746140889.744757:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573883392 00010000:00010000:3.0:1746140889.744789:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 36 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.744823:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573883264 00000100:00100000:3.0:1746140889.744825:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573883264 00010000:00010000:3.0:1746140889.744835:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 302 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:0.0:1746140889.744843:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8983 00000100:00100000:0.0:1746140889.744851:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1982:x1830960573883392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140889.744865:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140889.744872:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 36 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.744881:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 36 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.744898:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c422e00/0x8156357b7fdbb22f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f5b expref: 36 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.744915:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140889.744918:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140889.744924:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140889.744927:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140889.744929:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140889.744962:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1982:x1830960573883392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.745062:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8983 00000100:00100000:3.0:1746140889.745080:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8984 00000100:00100000:3.0:1746140889.745088:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+302:1985:x1830960573883264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.745102:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.745107:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 302 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.745118:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 302 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.745137:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbb15d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ecf expref: 302 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.745150:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.745154:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.745163:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.745444:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.745474:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.745514:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:1985:x1830960573883264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 427us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.745520:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8984 00010000:00010000:2.0:1746140889.745615:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745623:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140889.745662:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140889.745666:0:14785:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746140889.745682:0:14785:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745692:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745700:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745706:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745711:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745715:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff0e000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.745719:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745728:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745736:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140889.745738:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.745740:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745745:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e000/0x8156357b7fdbb2d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745766:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745770:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745774:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745777:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff0ee00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.745779:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745783:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745787:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f700) 00010000:00010000:2.0:1746140889.745788:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.745790:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745793:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ee00/0x8156357b7fdbb2de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.745820:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e400/0x8156357b7fdbb2d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 14 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.745830:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 13 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.745835:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.745836:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140889.745838:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0e200, rc 0) 00000100:00100000:2.0:1746140889.745869:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+13:386:x1830960573882624:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4668us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.745875:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10825 00000100:00100000:0.0:1746140889.747705:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.747748:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.747780:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.747810:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573883520 00000100:00100000:0.0:1746140889.747814:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.747818:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573883520 00000100:00100000:0.0:1746140889.747829:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.747855:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.747861:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573883776 00000100:00100000:3.0:1746140889.747863:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573883776 00000100:00100000:0.0:1746140889.747871:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573884032 00000100:00100000:3.0:1746140889.747875:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573883648 00000100:00100000:0.0:1746140889.747875:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573884032 00000100:00100000:3.0:1746140889.747876:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573883648 00000100:00100000:3.0:1746140889.747884:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573883904 00000100:00100000:3.0:1746140889.747886:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573883904 00000100:00100000:0.0:1746140889.747891:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573884160 00000100:00100000:0.0:1746140889.747893:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573884160 00000100:00100000:3.0:1746140889.747900:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17314 00000100:00100000:3.0:1746140889.747906:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573883520:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140889.747921:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.747937:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fc4 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.747957:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.747959:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.747967:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.747981:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140889.747983:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17315 00000100:00100000:0.0:1746140889.747990:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573883776:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140889.747991:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42b000, rc 0) 00010000:00010000:0.0:1746140889.747999:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140889.748024:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb2f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fd2 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.748043:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573883520:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 136us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.748048:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17314 00000100:00100000:3.0:1746140889.748061:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17316 00000100:00100000:3.0:1746140889.748065:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573883648:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746140889.748067:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b892a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576111360:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140889.748070:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.748076:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fcb expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.748085:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.748086:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.748090:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.748098:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.748103:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42ba00, rc 0) 00000100:00100000:0.0:1746140889.748117:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140889.748118:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573883648:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 52us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.748122:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17316 00000100:00100000:3.0:1746140889.748130:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17317 00000100:00100000:3.0:1746140889.748134:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573884032:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746140889.748137:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17318 00010000:00010000:3.0:1746140889.748138:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.748143:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fe0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140889.748143:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573883904:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140889.748149:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.748151:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.748152:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.748155:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.748156:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5569c00/0x8156357b7fdbb308 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fd9 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.748163:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.748168:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42b400, rc 0) 00000100:00100000:3.0:1746140889.748187:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573884032:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 52us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.748192:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b893b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576111488:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140889.748193:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17317 00000100:00100000:3.0:1746140889.748204:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17319 00000100:00100000:3.0:1746140889.748209:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573884160:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746140889.748212:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119780 going to sleep for 11 seconds 00010000:00010000:3.0:1746140889.748213:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.748218:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fe7 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.748226:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.748227:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.748231:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.748237:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.748243:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42ae00, rc 0) 00000100:00100000:3.0:1746140889.748257:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573884160:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.748261:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17319 00002000:00010000:2.0:1746140889.749758:0:8460:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime: 1746140889 -> 1746140890 00002000:00010000:2.0:1746140889.749764:0:8460:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140887 -> 1746140890 00002000:00010000:2.0:1746140889.749765:0:8460:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime: 1746140889 -> 1746140890 00000100:00100000:2.0:1746140889.749786:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b892a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576111360:192.168.204.16@tcp:106: 00002000:00010000:1.0:1746140889.749805:0:32376:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140889 -> 1746140890 00002000:00010000:1.0:1746140889.749812:0:32376:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140889 -> 1746140890 00010000:00010000:2.0:1746140889.749813:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb2f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fd2 expref: 11 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.749823:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb2f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fd2 expref: 11 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140889.749830:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b893b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576111488:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140889.749831:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c25c00, rc 0) 00010000:00010000:1.0:1746140889.749853:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5569c00/0x8156357b7fdbb308 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fd9 expref: 11 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.749863:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5569c00/0x8156357b7fdbb308 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fd9 expref: 11 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140889.749886:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573883776:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1894us (2136us total) trans 0 rc 301/301 00010000:00010000:1.0:1746140889.749889:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5569c00, rc 0) 00000100:00100000:2.0:1746140889.749892:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17315 00000100:00100000:1.0:1746140889.749921:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573883904:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1777us (2090us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140889.749928:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17318 00000100:00100000:0.0:1746140889.751653:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.751716:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573884416 00000100:00100000:2.0:1746140889.751724:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573884416 00000100:00100000:2.0:1746140889.751759:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10826 00000100:00100000:2.0:1746140889.751764:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+13:386:x1830960573884416:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140889.751780:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.751795:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f400/0x8156357b7fdbb316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1fee expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.751886:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.751899:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 14 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.751905:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.751934:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 14 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.751944:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 14 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.751955:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576111616:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.752064:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.754512:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.754542:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576111616:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.754574:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140889.754576:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573884544 00000100:00100000:3.0:1746140889.754591:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573884544 00010000:00010000:3.0:1746140889.754634:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 15 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.754684:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8985 00000100:00100000:3.0:1746140889.754693:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+15:1985:x1830960573884544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.754715:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.754721:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 15 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.754733:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 15 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.754755:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e200/0x8156357b7fdbb2e5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fbd expref: 15 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.754768:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.754773:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.754782:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.754788:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.754812:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140889.754832:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140889.754837:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:0.0:1746140889.754858:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:3.0:1746140889.754898:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573884544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 205us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.754905:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8985 00010000:00010000:0.0:1746140889.755021:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f400/0x8156357b7fdbb316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fee expref: 15 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.755049:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fee expref: 14 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.755057:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140889.755060:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140889.755062:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0f200, rc 0) 00000100:00100000:0.0:1746140889.755104:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:386:x1830960573884416:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3339us (3456us total) trans 8589945152 rc 0/0 00000100:00100000:0.0:1746140889.755112:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10826 00000100:00100000:0.0:1746140889.756980:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.757380:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573884800 00000100:00100000:2.0:1746140889.757392:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573884800 00000100:00100000:2.0:1746140889.757450:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10827 00000100:00100000:2.0:1746140889.757458:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:386:x1830960573884800:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140889.757486:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.757489:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746140889.757516:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f200/0x8156357b7fdbb31d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fee expref: 14 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.757536:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.757540:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140889.757551:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ea00/0x8156357b7fdbb32b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ff5 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.757627:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f800/0x8156357b7fdbb332 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.757638:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f800/0x8156357b7fdbb332 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.757645:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f800/0x8156357b7fdbb332 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140889.757655:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.757753:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0ea00/0x8156357b7fdbb32b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ff5 expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.757764:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f800/0x8156357b7fdbb332 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ff5 expref: 15 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.757770:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.757772:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140889.757774:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0f800, rc 0) 00000100:00100000:2.0:1746140889.757831:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+15:386:x1830960573884800:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 373us (857us total) trans 8589945153 rc 0/0 00000100:00100000:2.0:1746140889.757837:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10827 00000100:00100000:0.0:1746140889.760727:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.761161:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573884928 00000100:00100000:2.0:1746140889.761172:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573884928 00000100:00100000:2.0:1746140889.761233:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10828 00000100:00100000:2.0:1746140889.761239:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+15:386:x1830960573884928:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140889.761264:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.761281:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fa00/0x8156357b7fdbb340 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a1ffc expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.761381:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fa00/0x8156357b7fdbb340 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ffc expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.761397:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fa00/0x8156357b7fdbb340 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ffc expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.761413:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.761416:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140889.761420:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0fa00, rc 0) 00000100:00100000:2.0:1746140889.761644:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+16:386:x1830960573884928:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 404us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.761650:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10828 00000100:00100000:0.0:1746140889.766022:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.766059:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.766086:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.766100:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.766115:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.766397:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573885056 00000100:00100000:1.0:1746140889.766397:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573885312 00000100:00100000:3.0:1746140889.766405:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573885056 00000100:00100000:1.0:1746140889.766405:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573885312 00000100:00100000:3.0:1746140889.766439:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573885568 00000100:00100000:3.0:1746140889.766441:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573885568 00000100:00100000:1.0:1746140889.766446:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573885184 00000100:00100000:1.0:1746140889.766448:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573885184 00000100:00100000:3.0:1746140889.766451:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573885440 00000100:00100000:3.0:1746140889.766453:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573885440 00000100:00100000:1.0:1746140889.766464:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17320 00000100:00100000:3.0:1746140889.766470:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17321 00000100:00100000:1.0:1746140889.766471:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573885056:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746140889.766476:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573885312:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140889.766509:0:9872:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.766509:0:32376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.766523:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.766524:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.766529:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140889.766531:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.766531:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.766534:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.766536:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.766537:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.766539:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.766559:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.766559:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140889.766569:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 17 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.766569:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 12 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:0.0:1746140889.766572:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.766581:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576111872:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.766581:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576111744:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140889.766649:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.766655:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.766662:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573885696 00000100:00100000:2.0:1746140889.766666:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573885696 00000100:00100000:2.0:1746140889.766685:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17322 00000100:00100000:2.0:1746140889.766691:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573885568:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746140889.766719:0:4782:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766730:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766737:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.766743:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766749:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766755:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140889.766756:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140889.766758:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 7/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766772:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 27 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766780:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 27 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.766793:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576112128:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.766839:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766846:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.766854:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576112256:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.766874:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.766881:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 12 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.766888:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576112384:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.766905:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766912:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.766919:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135699c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576112512:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.766932:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.766952:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17323 00000100:00100000:2.0:1746140889.766958:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573885184:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746140889.766972:0:24958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766982:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.766988:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.766996:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 35 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.767000:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.767001:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.767003:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.767028:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 35 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.767036:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 35 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.767044:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013569ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576112640:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.767068:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.767076:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.767083:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135698a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576112768:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.767085:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576112000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.767102:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 17 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.767107:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00010000:00010000:2.0:1746140889.767108:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 17 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.767114:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576112896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140889.767124:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17324 00000100:00100000:2.0:1746140889.767125:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140889.767130:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573885440:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:2.0:1746140889.767141:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17325 00010000:00010000:1.0:1746140889.767146:0:4186:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.767147:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573885696:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140889.767155:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.767161:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.767162:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140889.767164:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.767174:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.767178:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.767182:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.767185:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.767188:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140889.767192:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576113024:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.767193:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.767195:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.767197:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.767207:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a83c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746140889.767210:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.767217:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 12 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.767225:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576113152:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.767606:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800946b9840 going to sleep for 11 seconds 00010000:00010000:2.0:1746140889.767872:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 17 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.767884:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 17 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.767894:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576113280:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.767910:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140889.768344:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576111744:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140889.771331:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.771431:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573885824 00000100:00100000:2.0:1746140889.771439:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573885824 00010000:00010000:2.0:1746140889.771474:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.772552:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576112896:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.772689:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8986 00000100:00100000:2.0:1746140889.772698:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573885824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.772712:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.772733:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.772744:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.772762:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb2ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fc4 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:2.0:1746140889.772784:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140889.773060:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.773074:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573885952 00000100:00100000:0.0:1746140889.773078:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573885952 00000100:00100000:1.0:1746140889.773084:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576113024:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140889.773093:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:1.0:1746140889.773105:0:4186:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140889.773113:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8987 00000100:00100000:0.0:1746140889.773118:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+13:1982:x1830960573885952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140889.773124:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140889.773128:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576113152:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140889.773134:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:1.0:1746140889.773136:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576113280:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140889.773140:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:0.0:1746140889.773150:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140889.773151:0:32377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140889.773171:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+13:1982:x1830960573885952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.773177:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8987 00000100:00100000:1.0:1746140889.773196:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.773227:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573885824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 531us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.773237:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8986 00000100:00100000:2.0:1746140889.773260:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576112000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.773275:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.773287:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573886592 00000100:00100000:2.0:1746140889.773289:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573886592 00010000:00010000:2.0:1746140889.773298:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.773359:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013569ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576112640:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.773366:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135698a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576112768:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.773383:0:24958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.773407:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576112128:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.773414:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576112256:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.773421:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb301 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe0 expref: 11 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.773432:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576112384:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140889.773438:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576112512:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.773451:0:4782:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.773469:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8988 00000100:00100000:3.0:1746140889.773476:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573886592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.773484:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.773492:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.773500:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.773511:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee73e00/0x8156357b7fdbb1db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4886527) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f2a expref: 28 pid: 20960 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.773520:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.773534:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573886592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.773539:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8988 00000100:00100000:3.0:1746140889.773561:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576111872:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140889.773569:0:9872:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.773796:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.773864:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.773923:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.773949:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.773961:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.773962:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573886080 00000100:00100000:3.0:1746140889.773966:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573886080 00010000:00010000:3.0:1746140889.773979:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.774140:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.774165:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573887232 00000100:00100000:3.0:1746140889.774169:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573887232 00000100:00100000:2.0:1746140889.774170:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573886208 00000100:00100000:2.0:1746140889.774174:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573886208 00010000:00010000:3.0:1746140889.774180:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.774187:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 18 pid: 24958 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.774189:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573886464 00000100:00100000:3.0:1746140889.774191:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573886464 00010000:00010000:3.0:1746140889.774198:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 36 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.774204:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573886976 00000100:00100000:2.0:1746140889.774206:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573886976 00000100:00100000:3.0:1746140889.774208:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8989 00000100:00100000:3.0:1746140889.774212:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573886080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.774216:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.774219:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140889.774225:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8990 00010000:00010000:3.0:1746140889.774226:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.774230:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573887232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.774236:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.774238:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.774245:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.774248:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e44a00/0x8156357b7fdbb2bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa8 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.774253:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 28 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.774259:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140889.774264:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e45400/0x8156357b7fdbb2c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fb6 expref: 27 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.774273:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.774275:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140889.774278:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573886080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (483us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140889.774279:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.774284:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8989 00010000:00010000:2.0:1746140889.774287:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.774293:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8991 00000100:00100000:3.0:1746140889.774298:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573886208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.774302:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140889.774323:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.774328:0:4782:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.774334:0:4782:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.774336:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 18 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.774344:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 18 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.774351:0:4782:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.774357:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f8ee00/0x8156357b7fdbb180 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eeb expref: 18 pid: 24958 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.774357:0:4782:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.774363:0:4782:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.774366:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140889.774370:0:4782:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff0fc00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140889.774373:0:4782:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.774379:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573886208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (456us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140889.774380:0:4782:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.774387:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8991 00010000:00010000:2.0:1746140889.774389:0:4782:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.774394:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.774397:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8992 00000100:00100000:3.0:1746140889.774402:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573886464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.774407:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.774414:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 36 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.774421:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 36 pid: 20960 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.774431:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b5efe00/0x8156357b7fdbb1b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f07 expref: 36 pid: 20960 timeout: 968 lvb_type: 1 00000100:00100000:2.0:1746140889.774435:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573885568:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7744us (8348us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140889.774437:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.774443:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17322 00000100:00100000:3.0:1746140889.774449:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573886464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.774453:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8992 00000100:00100000:3.0:1746140889.774461:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8993 00000100:00100000:3.0:1746140889.774465:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573886976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140889.774467:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573887232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 237us (603us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140889.774470:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140889.774472:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8990 00010000:00010000:3.0:1746140889.774478:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.774485:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.774499:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e42ae00/0x8156357b7fdbb30f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fe7 expref: 13 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.774506:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.774518:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573886976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.774523:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8993 00000100:00100000:1.0:1746140889.774569:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.774604:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.774623:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.774637:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573887104 00000100:00100000:1.0:1746140889.774640:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573887104 00002000:00100000:1.0:1746140889.774671:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1548287) req@ffff8800a51cdf80 x1830960573887104/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.774679:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cdf80 with x1830960573887104 ext(1048576->1548287) 00010000:00010000:1.0:1746140889.774685:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 25 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.774692:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 25 pid: 8458 timeout: 968 lvb_type: 0 00002000:00010000:1.0:1746140889.774698:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cdf80 00000100:00100000:1.0:1746140889.774709:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573886720 00000100:00100000:1.0:1746140889.774711:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573886720 00002000:00100000:1.0:1746140889.774722:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1568768->2097151) req@ffff8800a51cf100 x1830960573886720/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.774728:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cf100 with x1830960573886720 ext(1568768->2097151) 00010000:00010000:1.0:1746140889.774732:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 17 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.774738:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 17 pid: 8458 timeout: 968 lvb_type: 0 00002000:00010000:1.0:1746140889.774747:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a51cf100 00000100:00100000:1.0:1746140889.774757:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1852 00000100:00100000:1.0:1746140889.774762:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573887104:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140889.774909:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573886336 00000100:00100000:3.0:1746140889.774913:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573886336 00010000:00010000:3.0:1746140889.774925:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 968 lvb_type: 1 00000100:00100000:3.0:1746140889.774937:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573886848 00000100:00100000:3.0:1746140889.774939:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573886848 00010000:00010000:3.0:1746140889.774945:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 26 pid: 32377 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.774956:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8994 00000100:00100000:3.0:1746140889.774960:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573886336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.774965:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.774972:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.774978:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.774992:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e42ba00/0x8156357b7fdbb2fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fcb expref: 12 pid: 32377 timeout: 968 lvb_type: 1 00010000:00010000:3.0:1746140889.775000:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.775002:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.775004:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775021:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775034:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140889.775051:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573886336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.775056:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8994 00000100:00100000:3.0:1746140889.775066:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8995 00000100:00100000:3.0:1746140889.775070:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573886848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.775076:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.775199:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.775207:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.775218:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb275 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f7e expref: 27 pid: 32377 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.775231:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.775232:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.775234:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775240:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775252:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.775263:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.775267:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573886848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 196us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.775272:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8995 00000100:00100000:3.0:1746140889.775280:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573887360 00000100:00100000:3.0:1746140889.775283:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573887360 00010000:00010000:3.0:1746140889.775290:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.775300:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8996 00000100:00100000:3.0:1746140889.775319:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573887360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.775325:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.775331:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.775337:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.775351:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099e44e00/0x8156357b7fdbb2c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1faf expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.775358:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.775360:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.775363:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775370:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.775378:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1853 00010000:00010000:3.0:1746140889.775390:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140889.775397:0:32377:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.775404:0:32377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140889.775408:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573887360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.775413:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8996 00010000:00010000:1.0:1746140889.775417:0:32377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.775423:0:32377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.775429:0:32377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775430:0:24958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.775434:0:32377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013738e000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140889.775436:0:32377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775437:0:24958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.775442:0:32377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775451:0:24958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.775451:0:32377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775456:0:24958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.775457:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013738e000/0x8156357b7fdbb36a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775465:0:24958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775469:0:24958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c422e00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140889.775472:0:24958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775477:0:24958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775484:0:24958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.775489:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c422e00/0x8156357b7fdbb35c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.775493:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573885696:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 8346us (8928us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.775498:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17325 00000100:00100000:3.0:1746140889.775517:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573885184:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 8559us (9415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.775517:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573886720:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746140889.775522:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17323 00010000:00010000:2.0:1746140889.775681:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.775688:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.775701:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.775707:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.775712:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.775716:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099e45a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140889.775718:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.775724:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.775732:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.775737:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e45a00/0x8156357b7fdbb347 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140889.775769:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573885056:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 9298us (9768us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.775775:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17320 00000100:00100000:2.0:1746140889.785441:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960573886720:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10047us (10808us total) trans 17179874192 rc 0/0 00000100:00100000:2.0:1746140889.785452:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1853 00002000:00100000:2.0:1746140889.785465:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1568768->2097151) req@ffff8800a51cf100 x1830960573886720/t17179874192(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.785473:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cf100 with x1830960573886720 ext(1568768->2097151) 00010000:00010000:2.0:1746140889.785483:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.785495:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00002000:00010000:2.0:1746140889.785501:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a51cf100 00000100:00100000:1.0:1746140889.786226:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573887104:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11462us (12083us total) trans 21474841484 rc 0/0 00000100:00100000:1.0:1746140889.786234:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1852 00002000:00100000:1.0:1746140889.786240:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1548287) req@ffff8800a51cdf80 x1830960573887104/t21474841484(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/448 e 0 to 0 dl 1746140900 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.786247:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cdf80 with x1830960573887104 ext(1048576->1548287) 00010000:00010000:1.0:1746140889.786253:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 26 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.786260:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 26 pid: 8458 timeout: 968 lvb_type: 0 00002000:00010000:1.0:1746140889.786265:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cdf80 00000100:00100000:0.0:1746140889.789621:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.789674:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.789762:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573887488 00000100:00100000:2.0:1746140889.789771:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573887488 00010000:00010000:2.0:1746140889.789802:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.789848:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573887616 00000100:00100000:2.0:1746140889.789850:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573887616 00010000:00010000:2.0:1746140889.789862:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 26 pid: 8458 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.789878:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8997 00000100:00100000:2.0:1746140889.789885:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573887488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.789896:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.789914:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.789925:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.789945:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099e45c00/0x8156357b7fdbb2a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1f93 expref: 18 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.789959:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.789960:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.789964:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.789972:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.789997:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.790051:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1985:x1830960573887488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.790057:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8997 00000100:00100000:2.0:1746140889.790073:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8998 00000100:00100000:2.0:1746140889.790077:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573887616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.790085:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.790097:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 26 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.790106:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 26 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.790117:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e44400/0x8156357b7fdbb2b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1fa1 expref: 26 pid: 8458 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.790124:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.790127:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.790129:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790134:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790145:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.790159:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573887616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.790164:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8998 00010000:00010000:2.0:1746140889.790201:0:9872:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790208:0:9872:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790224:0:9872:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790230:0:9872:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790237:0:9872:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790241:0:4186:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790243:0:9872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e42b600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140889.790246:0:9872:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790248:0:4186:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790253:0:9872:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790259:0:4186:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790261:0:9872:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790264:0:4186:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.790267:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e42b600/0x8156357b7fdbb34e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790270:0:4186:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790275:0:4186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099e44c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140889.790277:0:4186:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790282:0:4186:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790290:0:4186:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.790295:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099e44c00/0x8156357b7fdbb363 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140889.790359:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573885440:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 23229us (24242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.790366:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17324 00000100:00100000:2.0:1746140889.791444:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573885312:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 24965us (25382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.791451:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17321 00000100:00100000:0.0:1746140889.794473:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.794499:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573887872 00000100:00100000:2.0:1746140889.794507:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573887872 00000100:00100000:2.0:1746140889.794551:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10829 00000100:00100000:2.0:1746140889.794558:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+16:386:x1830960573887872:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:2.0:1746140889.794597:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.794619:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fa00/0x8156357b7fdbb340 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ffc expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794633:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.794637:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140889.794662:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.794673:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 34 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794679:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 300 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794684:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 34 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794689:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 34 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794699:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 300 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794704:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.794732:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 300 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794743:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 300 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.794754:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093135880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113408:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.794849:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 34 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794857:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 34 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.794865:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093134e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113536:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.794890:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 34 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794898:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 34 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.794904:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.794927:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 300 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.794933:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 300 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.795000:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093137800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113792:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.795057:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 34 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.795064:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 34 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.795071:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093135f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113920:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.795088:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.796744:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.796763:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093135880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113408:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.796773:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093134e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113536:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140889.796775:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.796780:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113664:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.796786:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093137800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113792:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140889.796789:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.796801:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.796807:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573888384 00000100:00100000:3.0:1746140889.796813:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573888384 00000100:00100000:2.0:1746140889.796816:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573888256 00000100:00100000:2.0:1746140889.796819:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573888256 00010000:00010000:2.0:1746140889.796837:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 36 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.796865:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573888512 00000100:00100000:2.0:1746140889.796867:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573888512 00010000:00010000:2.0:1746140889.796877:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 301 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:0.0:1746140889.796888:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573888000 00000100:00100000:0.0:1746140889.796892:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573888000 00000100:00100000:2.0:1746140889.796893:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8999 00000100:00100000:2.0:1746140889.796898:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1983:x1830960573888256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140889.796906:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 302 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.796907:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.796912:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 36 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.796920:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 36 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:0.0:1746140889.796922:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9000 00000100:00100000:0.0:1746140889.796928:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+302:1983:x1830960573888512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140889.796934:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.796936:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d215800/0x8156357b7fdbaf81 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1dcc expref: 36 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.796938:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 302 pid: 14785 timeout: 968 lvb_type: 0 00010000:00010000:0.0:1746140889.796946:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 302 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.796990:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4771 00000100:00100000:3.0:1746140889.796997:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+35:27321:x1830960573888384:12345-192.168.204.16@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746140889.796998:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.797003:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.797024:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140889.797031:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013547d800/0x8156357b7fdbab4b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b95 expref: 302 pid: 14785 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.797052:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1983:x1830960573888256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 153us (275us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140889.797053:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140889.797056:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140889.797058:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8999 00010000:00010000:0.0:1746140889.797062:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.797071:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9001 00000100:00100000:2.0:1746140889.797076:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:1985:x1830960573888000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140889.797079:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+301:1983:x1830960573888512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 150us (288us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140889.797082:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140889.797085:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9000 00010000:00010000:2.0:1746140889.797086:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 301 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.797098:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 300 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.797109:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee73600/0x8156357b7fdbb1a3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ef9 expref: 300 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.797118:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.797121:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.797126:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.797140:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+299:1985:x1830960573888000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.797145:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9001 00000100:00100000:0.0:1746140889.797148:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.797156:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573888640 00000100:00100000:3.0:1746140889.797158:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+35:27321:x1830960573888384:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 161us (418us total) trans 8589945154 rc 0/0 00000100:00100000:2.0:1746140889.797159:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573888640 00000100:00100000:3.0:1746140889.797167:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4771 00010000:00010000:2.0:1746140889.797167:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 36 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.797188:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9002 00000100:00100000:2.0:1746140889.797192:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573888640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.797198:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.797201:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 35 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.797208:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 35 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.797220:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.797223:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.797228:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.797242:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573888640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 50us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.797246:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9002 00010000:00010000:2.0:1746140889.797271:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5229000/0x8156357b7fdbab2f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1b80 expref: 34 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.797279:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093135f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576113920:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.797302:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140889.798020:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.798081:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573888768 00000100:00100000:2.0:1746140889.798092:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573888768 00010000:00010000:2.0:1746140889.798103:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 34 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.798125:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9003 00000100:00100000:2.0:1746140889.798131:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1983:x1830960573888768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140889.798137:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140889.798141:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 34 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.798149:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 34 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.798160:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb12c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1eac expref: 34 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:2.0:1746140889.798167:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.798170:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.798176:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.798182:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.798206:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140889.798234:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1983:x1830960573888768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.798239:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9003 00010000:00010000:3.0:1746140889.798297:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140889.798323:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000040:00080000:3.0:1746140889.798900:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3494, 88 off296144 00000004:00080000:3.0:1746140889.798908:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874602253ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.798960:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3515, 88 off298168 00000004:00080000:3.0:1746140889.798965:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868874659957ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140889.798990:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3516, 88 off298256 00000004:00080000:3.0:1746140889.798994:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868874689139ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140889.799000:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3495, 88 off296232 00000004:00080000:3.0:1746140889.799003:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874698092ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.799019:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3496, 88 off296320 00000004:00080000:3.0:1746140889.799022:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874717724ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.799030:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3517, 88 off298344 00000004:00080000:3.0:1746140889.799032:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868874727515ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140889.799038:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3518, 88 off298432 00000004:00080000:3.0:1746140889.799041:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868874736484ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140889.799047:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3519, 88 off298520 00000004:00080000:3.0:1746140889.799049:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868874744723ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140889.799056:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3497, 88 off296408 00000004:00080000:3.0:1746140889.799058:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874753713ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.799064:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3520, 88 off298608 00000004:00080000:3.0:1746140889.799066:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868874761340ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140889.799078:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3498, 88 off296496 00000004:00080000:3.0:1746140889.799080:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874775804ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.799087:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3521, 88 off298696 00000004:00080000:3.0:1746140889.799090:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868874784852ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140889.799120:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3499, 88 off296584 00000004:00080000:3.0:1746140889.799129:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874824032ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.799140:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3500, 88 off296672 00000004:00080000:3.0:1746140889.799142:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874837357ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.799149:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3501, 88 off296760 00000004:00080000:3.0:1746140889.799151:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874846180ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.799158:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3502, 88 off296848 00000004:00080000:3.0:1746140889.799161:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 868874855800ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140889.799169:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3522, 88 off298784 00000004:00080000:3.0:1746140889.799172:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868874866905ns, next at 809142599738ns, rc = 0 00000004:00010000:3.0:1746140889.814155:0:14785:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b891500 reply state ffff88009aa2e800 transno 8589945155 ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000001:00080000:1.0:1746140889.814156:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945152 is committed 00000001:00080000:1.0:1746140889.814171:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945127 is committed 00000100:00100000:3.0:1746140889.814172:0:14785:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746140889.814188:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945100 is committed 00000001:00080000:1.0:1746140889.814198:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945150 is committed 00000001:00080000:1.0:1746140889.814202:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945149 is committed 00000001:00080000:1.0:1746140889.814227:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945153 is committed 00000100:00100000:3.0:1746140889.814289:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:386:x1830960573887872:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 19726us (19817us total) trans 8589945155 rc 0/0 00000001:00080000:1.0:1746140889.814294:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945155 is committed 00000100:00100000:3.0:1746140889.814297:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10829 00000004:00080000:1.0:1746140889.814298:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2764 committed 00000004:00080000:1.0:1746140889.814322:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2747 committed 00000004:00080000:1.0:1746140889.814329:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2746 committed 00000004:00080000:1.0:1746140889.814332:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2745 committed 00000004:00080000:1.0:1746140889.814333:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2744 committed 00000004:00080000:1.0:1746140889.814334:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2763 committed 00000004:00080000:1.0:1746140889.814336:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2743 committed 00000004:00080000:1.0:1746140889.814337:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2762 committed 00000004:00080000:1.0:1746140889.814338:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2742 committed 00000004:00080000:1.0:1746140889.814340:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2761 committed 00000004:00080000:1.0:1746140889.814341:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2760 committed 00000004:00080000:1.0:1746140889.814352:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2759 committed 00000004:00080000:1.0:1746140889.814355:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2741 committed 00000004:00080000:1.0:1746140889.814356:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2740 committed 00000004:00080000:1.0:1746140889.814358:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2758 committed 00000004:00080000:1.0:1746140889.814359:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2757 committed 00000004:00080000:1.0:1746140889.814361:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2739 committed 00000001:00080000:1.0:1746140889.814365:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945154 is committed 00000001:00080000:1.0:1746140889.814368:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945151 is committed 00010000:00010000:2.0:1746140889.814473:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.814482:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.814488:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.814493:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351a3c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.814498:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.814504:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140889.814508:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576114304:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746140889.814519:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.814522:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140889.814526:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140889.814531:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3c00/0x8156357b7fdbb371 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140889.814555:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576114048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.814562:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140889.814593:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576114816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140889.814600:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140889.814623:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576114304 00000100:00100000:1.0:1746140889.814630:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576114304 00000100:00100000:0.0:1746140889.814643:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576114176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.814678:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576114048 00000100:00100000:1.0:1746140889.814680:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576114048 00000100:00100000:1.0:1746140889.814694:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17326 00000100:00100000:1.0:1746140889.814700:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3312:x1830960576114304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140889.814711:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140889.814733:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576114688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140889.814747:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140889.814771:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576114432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140889.814786:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140889.814798:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576114944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140889.814810:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140889.814830:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576114176 00000100:00100000:0.0:1746140889.814836:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576114176 00000100:00100000:0.0:1746140889.814858:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576114688 00000100:00100000:0.0:1746140889.814860:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576114688 00000100:00100000:0.0:1746140889.814870:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576114432 00000100:00100000:0.0:1746140889.814872:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576114432 00000100:00100000:0.0:1746140889.814882:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576114944 00000100:00100000:0.0:1746140889.814884:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576114944 00000100:00100000:0.0:1746140889.814895:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17327 00000100:00100000:0.0:1746140889.814901:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+43:3310:x1830960576114048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.814921:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3312:x1830960576114304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (359us total) trans 17179874193 rc 0/0 00000100:00100000:1.0:1746140889.814928:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17326 00000100:00100000:1.0:1746140889.814941:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17328 00000100:00100000:1.0:1746140889.814946:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3311:x1830960576114176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.815033:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17329 00000100:00100000:1.0:1746140889.815039:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3311:x1830960576114688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.815056:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17330 00000100:00100000:1.0:1746140889.815061:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3313:x1830960576114432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140889.815088:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+43:3310:x1830960576114048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (487us total) trans 17179874194 rc 0/0 00000100:00100000:0.0:1746140889.815094:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17327 00000100:00100000:0.0:1746140889.815106:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17331 00000100:00100000:0.0:1746140889.815110:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+42:3313:x1830960576114944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.815155:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3313:x1830960576114432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (367us total) trans 17179874195 rc 0/0 00000100:00100000:1.0:1746140889.815160:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17330 00000100:00100000:0.0:1746140889.815197:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+43:3313:x1830960576114944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (385us total) trans 17179874196 rc 0/0 00000100:00100000:0.0:1746140889.815203:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17331 00000004:00080000:0.0:1746140889.815253:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cc000/2, rc 0, transno 17179874195 00000100:00100000:1.0:1746140889.815257:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3311:x1830960576114688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (508us total) trans 17179874197 rc 0/0 00000100:00100000:0.0:1746140889.815258:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576114432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.815263:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17329 00000004:00080000:0.0:1746140889.815266:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d2a300/2, rc 0, transno 17179874196 00000100:00100000:0.0:1746140889.815269:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576114944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.815278:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140889.815287:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ce300/2, rc 0, transno 17179874197 00000100:00100000:0.0:1746140889.815290:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576114688:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140889.815342:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cc380/2, rc 0, transno 17179874193 00000100:00100000:1.0:1746140889.815347:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576114304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.815358:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576114816 00000100:00100000:1.0:1746140889.815361:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576114816 00000100:00100000:1.0:1746140889.815375:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17332 00000100:00100000:1.0:1746140889.815379:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3312:x1830960576114816:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140889.815505:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cd880/2, rc 0, transno 17179874194 00000100:00100000:1.0:1746140889.815509:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3312:x1830960576114816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (230us total) trans 17179874198 rc 0/0 00000100:00100000:2.0:1746140889.815510:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576114048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140889.815515:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576114560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140889.815515:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17332 00000100:00100000:2.0:1746140889.815535:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746140889.815535:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cc700/2, rc 0, transno 17179874198 00000100:00100000:1.0:1746140889.815539:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576114816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140889.815560:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576114560 00000100:00100000:2.0:1746140889.815563:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576114560 00000100:00100000:2.0:1746140889.815709:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17333 00000100:00100000:2.0:1746140889.815714:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3310:x1830960576114560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140889.815724:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576115200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.815746:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140889.815760:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746140889.815764:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576115072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.815781:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140889.815793:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576115328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.815794:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576115712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.815808:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140889.815810:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3310:x1830960576114560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (275us total) trans 17179874199 rc 0/0 00000100:00100000:2.0:1746140889.815816:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17333 00000100:00100000:1.0:1746140889.815819:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140889.815820:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746140889.815824:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576115584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140889.815828:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576115200 00000100:00100000:2.0:1746140889.815831:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576115200 00000100:00100000:1.0:1746140889.815836:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576115840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.815838:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140889.815845:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576115072 00000100:00100000:2.0:1746140889.815847:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576115072 00000100:00100000:1.0:1746140889.815850:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140889.815859:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576115712 00000100:00100000:2.0:1746140889.815861:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576115712 00000100:00100000:0.0:1746140889.815862:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576115328 00000100:00100000:0.0:1746140889.815864:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576115328 00000100:00100000:2.0:1746140889.815867:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576115584 00000100:00100000:1.0:1746140889.815868:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746140889.815869:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576115584 00000100:00100000:1.0:1746140889.815872:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576115456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.815872:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576115840 00000100:00100000:0.0:1746140889.815873:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576115840 00000100:00100000:2.0:1746140889.815876:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17334 00000100:00100000:2.0:1746140889.815880:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3311:x1830960576115200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.815880:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17335 00000100:00100000:0.0:1746140889.815884:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3311:x1830960576115072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140889.815886:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140889.815894:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576115968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140889.815906:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140889.815921:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576115456 00000100:00100000:1.0:1746140889.815923:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576115456 00000100:00100000:2.0:1746140889.815925:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576115968 00000100:00100000:2.0:1746140889.815928:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576115968 00000100:00100000:1.0:1746140889.815937:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17336 00000100:00100000:1.0:1746140889.815943:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3311:x1830960576115712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140889.815945:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17337 00000100:00100000:2.0:1746140889.815949:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3312:x1830960576115328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.815997:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3311:x1830960576115072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (215us total) trans 21474841485 rc 0/0 00000100:00100000:0.0:1746140889.816002:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17335 00000100:00100000:0.0:1746140889.816028:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17338 00000100:00100000:0.0:1746140889.816033:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576115584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140889.816034:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17339 00000100:00100000:1.0:1746140889.816040:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3312:x1830960576115840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140889.816055:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3312:x1830960576115328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (235us total) trans 21474841486 rc 0/0 00000100:00100000:2.0:1746140889.816060:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17337 00000100:00100000:2.0:1746140889.816071:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17340 00000100:00100000:2.0:1746140889.816075:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3312:x1830960576115456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.816107:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3311:x1830960576115584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (268us total) trans 21474841488 rc 0/0 00000100:00100000:0.0:1746140889.816113:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17338 00000100:00100000:0.0:1746140889.816122:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17341 00000100:00100000:0.0:1746140889.816126:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3312:x1830960576115968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140889.816135:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3312:x1830960576115840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (282us total) trans 21474841489 rc 0/0 00000100:00100000:1.0:1746140889.816140:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17339 00000100:00100000:2.0:1746140889.816156:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3312:x1830960576115456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (269us total) trans 21474841490 rc 0/0 00000100:00100000:2.0:1746140889.816161:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17340 00000100:00100000:1.0:1746140889.816191:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576115712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (381us total) trans 21474841487 rc 0/0 00000100:00100000:1.0:1746140889.816196:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17336 00000100:00100000:0.0:1746140889.816199:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576115200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 317us (451us total) trans 21474841491 rc 0/0 00000100:00100000:0.0:1746140889.816204:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17334 00000004:00080000:1.0:1746140889.816221:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7c700/2, rc 0, transno 21474841490 00000100:00100000:1.0:1746140889.816227:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576115456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140889.816236:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d29880/2, rc 0, transno 21474841486 00000100:00100000:1.0:1746140889.816238:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576115328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140889.816244:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354be680/2, rc 0, transno 21474841489 00000100:00100000:1.0:1746140889.816247:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576115840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.816287:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3312:x1830960576115968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (379us total) trans 21474841492 rc 0/0 00000100:00100000:0.0:1746140889.816292:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17341 00000100:00100000:1.0:1746140889.816302:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3311:x1830960576114176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1355us (1590us total) trans 17179874200 rc 0/0 00000004:00080000:0.0:1746140889.816326:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe7c380/2, rc 0, transno 21474841488 00000100:00100000:0.0:1746140889.816330:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576115584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140889.816338:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bf480/2, rc 0, transno 21474841487 00000100:00100000:0.0:1746140889.816341:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576115712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140889.816343:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17328 00000004:00080000:0.0:1746140889.816348:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d28700/2, rc 0, transno 21474841485 00000100:00100000:0.0:1746140889.816351:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576115072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140889.816357:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d2b800/2, rc 0, transno 21474841491 00000100:00100000:0.0:1746140889.816359:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576115200:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140889.816367:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51cea00/2, rc 0, transno 17179874200 00000100:00100000:0.0:1746140889.816369:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576114176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140889.816501:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ce680/2, rc 0, transno 17179874199 00000100:00100000:3.0:1746140889.816506:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576114560:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140889.816614:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bd180/2, rc 0, transno 21474841492 00000100:00100000:1.0:1746140889.816619:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576115968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.816663:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746140889.816671:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576116096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.816694:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140889.816711:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576116096 00000100:00100000:3.0:1746140889.816715:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576116096 00000100:00100000:3.0:1746140889.816736:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17342 00000100:00100000:3.0:1746140889.816740:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3311:x1830960576116096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140889.816856:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576116096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (161us total) trans 21474841493 rc 0/0 00000100:00100000:3.0:1746140889.816862:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17342 00000004:00080000:0.0:1746140889.816935:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bed80/2, rc 0, transno 21474841493 00000100:00100000:0.0:1746140889.816939:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576116096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140889.818013:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.818105:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573888896 00000100:00100000:3.0:1746140889.818113:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573888896 00000100:00100000:3.0:1746140889.818150:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10830 00000100:00100000:3.0:1746140889.818155:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+7:386:x1830960573888896:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140889.818173:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140889.818190:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2003 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.818244:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.818257:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.818273:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.818276:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140889.818279:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42ae00, rc 0) 00000100:00100000:3.0:1746140889.818360:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:386:x1830960573888896:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 203us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.818365:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10830 00000100:00100000:2.0:1746140889.823048:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.823262:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573889024 00000100:00100000:0.0:1746140889.823271:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573889024 00000100:00100000:0.0:1746140889.823404:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 788 00000100:00100000:0.0:1746140889.823414:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:386:x1830960573889024:12345-192.168.204.16@tcp:103:mirror_io.0 00010000:00010000:0.0:1746140889.823429:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140889.823452:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0f800/0x8156357b7fdbb332 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a1ff5 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.823465:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140889.823469:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140889.823523:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:386:x1830960573889024:12345-192.168.204.16@tcp:103:mirror_io.0 Request processed in 111us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.823529:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 788 00000100:00100000:0.0:1746140889.824862:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.824958:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573889280 00000100:00100000:3.0:1746140889.824965:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573889280 00000100:00100000:3.0:1746140889.825020:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4772 00000100:00100000:3.0:1746140889.825035:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:386:x1830960573889280:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746140889.825356:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:386:x1830960573889280:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 329us (498us total) trans 8589945156 rc 0/0 00000100:00100000:3.0:1746140889.825362:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4772 00000100:00100000:0.0:1746140889.826231:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.826274:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573889536 00000100:00100000:3.0:1746140889.826277:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573889536 00000100:00100000:3.0:1746140889.826299:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4773 00000100:00100000:3.0:1746140889.826325:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:386:x1830960573889536:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746140889.826425:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:386:x1830960573889536:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 101us (194us total) trans 8589945157 rc 0/0 00000100:00100000:3.0:1746140889.826431:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4773 00000100:00100000:2.0:1746140889.839187:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.839363:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573889792 00000100:00100000:0.0:1746140889.839372:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573889792 00000100:00100000:0.0:1746140889.839486:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10831 00000100:00100000:0.0:1746140889.839495:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:391:x1830960573889792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140889.839520:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140889.839538:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569c00/0x8156357b7fdbb37f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a200a expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.839662:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839674:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839684:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839695:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839701:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839707:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839818:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839825:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839832:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:0.0:1746140889.839841:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140889.839930:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839937:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839943:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839949:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5569400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140889.839957:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839962:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839973:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140889.839976:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140889.839980:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.839984:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569400/0x8156357b7fdbb386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.840015:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.840020:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.840025:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.840029:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5569800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140889.840032:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.840037:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.840043:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152100) 00010000:00010000:0.0:1746140889.840045:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140889.840047:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.840051:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569800/0x8156357b7fdbb38d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140889.840090:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569c00/0x8156357b7fdbb37f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.840106:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140889.840112:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140889.840114:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140889.840116:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5569600, rc 0) 00000100:00100000:0.0:1746140889.840180:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:391:x1830960573889792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 686us (1004us total) trans 8589945158 rc 0/0 00000100:00100000:0.0:1746140889.840187:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10831 00000100:00100000:0.0:1746140889.842595:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.842631:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.842660:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.842726:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573889920 00000100:00100000:0.0:1746140889.842733:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.842737:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573889920 00000100:00100000:0.0:1746140889.842757:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573890048 00000100:00100000:0.0:1746140889.842764:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573890048 00000100:00100000:2.0:1746140889.842778:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573890176 00000100:00100000:2.0:1746140889.842781:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573890176 00000100:00100000:0.0:1746140889.842793:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573890304 00000100:00100000:0.0:1746140889.842795:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573890304 00000100:00100000:2.0:1746140889.842803:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17343 00000100:00100000:2.0:1746140889.842810:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1983:x1830960573889920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.842934:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.842953:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2011 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140889.842982:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813feda, atime: 0x6813feda, ctime: 0x6813feda, blocks: 0x81f 00010000:00010000:2.0:1746140889.843000:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.843002:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.843022:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.843037:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140889.843048:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0afc00, rc 0) 00000100:00100000:2.0:1746140889.843095:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573889920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 285us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.843352:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17344 00000100:00100000:0.0:1746140889.843361:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573890048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140889.843376:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140889.843392:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2018 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140889.843418:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fed9, atime: 0x6813fed9, ctime: 0x6813fed9, blocks: 0x81f 00010000:00010000:0.0:1746140889.843433:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140889.843435:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140889.843444:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.843457:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140889.843467:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5569a00, rc 0) 00000100:00100000:3.0:1746140889.843608:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17345 00000100:00100000:1.0:1746140889.843617:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17346 00000100:00100000:3.0:1746140889.843618:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573890176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.843625:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140889.843625:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17343 00000100:00100000:1.0:1746140889.843628:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573890304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140889.843633:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a201f expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.843636:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746140889.843644:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813feda, atime: 0x6813feda, ctime: 0x6813feda, blocks: 0x81d 00010000:00010000:1.0:1746140889.843646:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2026 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140889.843652:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.843653:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.843657:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 38 pid: 20960 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746140889.843661:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813feda, atime: 0x6813feda, ctime: 0x6813feda, blocks: 0x81f 00010000:00010000:3.0:1746140889.843665:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 38 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.843670:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.843671:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140889.843675:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42aa00, rc 0) 00010000:00010000:1.0:1746140889.843676:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 30 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.843685:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 30 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.843692:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1b3800, rc 0) 00000100:00100000:3.0:1746140889.843707:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573890176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 92us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.843712:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17345 00000100:00100000:1.0:1746140889.843715:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1982:x1830960573890304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.843720:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17346 00000100:00100000:0.0:1746140889.843919:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573890048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 559us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140889.843924:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17344 00000100:00100000:2.0:1746140889.844233:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.844334:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573890432 00000100:00100000:1.0:1746140889.844339:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573890432 00000100:00100000:1.0:1746140889.844365:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17347 00000100:00100000:1.0:1746140889.844369:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573890432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.844376:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.844386:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a202d expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140889.844399:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813feda, atime: 0x6813feda, ctime: 0x6813feda, blocks: 0x1591 00010000:00010000:1.0:1746140889.844408:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.844409:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.844414:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 31 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.844423:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 31 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140889.844425:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140889.844430:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1b3c00, rc 0) 00000100:00100000:1.0:1746140889.844454:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573890432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.844460:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17347 00000100:00100000:1.0:1746140889.844471:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573890560 00000100:00100000:1.0:1746140889.844473:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573890560 00000100:00100000:1.0:1746140889.844495:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17348 00000100:00100000:1.0:1746140889.844501:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573890560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.844508:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.844517:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2034 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140889.844536:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813feda, atime: 0x6813fed9, ctime: 0x6813feda, blocks: 0x102b 00010000:00010000:1.0:1746140889.844547:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.844548:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.844552:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.844562:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.844568:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1b3e00, rc 0) 00000100:00100000:1.0:1746140889.844599:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1983:x1830960573890560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 99us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.844604:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17348 00000100:00100000:0.0:1746140889.850683:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.850800:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573890816 00000100:00100000:2.0:1746140889.850812:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573890816 00000100:00100000:2.0:1746140889.850874:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10832 00000100:00100000:2.0:1746140889.850880:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+6:394:x1830960573890816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.850906:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.850923:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af600/0x8156357b7fdbb3cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a203b expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.851054:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851067:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851078:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851090:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851095:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851099:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851213:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851221:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851227:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140889.851236:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140889.851370:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851377:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851382:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851387:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0af200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.851390:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851396:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851406:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140889.851409:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.851412:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851417:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af200/0x8156357b7fdbb3d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851445:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851450:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851464:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851468:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0af000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140889.851470:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851474:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851480:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880131034500) 00010000:00010000:2.0:1746140889.851481:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140889.851483:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851487:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb3da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.851525:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af600/0x8156357b7fdbb3cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.851536:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.851540:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140889.851542:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140889.851543:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0ae600, rc 0) 00000100:00100000:2.0:1746140889.851606:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:394:x1830960573890816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 725us (929us total) trans 8589945159 rc 0/0 00000100:00100000:2.0:1746140889.851611:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10832 00000100:00100000:0.0:1746140889.856047:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.856087:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.856109:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.856125:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573890944 00000100:00100000:0.0:1746140889.856129:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.856137:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573890944 00000100:00100000:0.0:1746140889.856155:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.856187:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573891328 00000100:00100000:2.0:1746140889.856190:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17349 00000100:00100000:3.0:1746140889.856192:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573891328 00000100:00100000:2.0:1746140889.856197:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573890944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140889.856216:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746140889.856227:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880092611c00 x1830960573891328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140889.856228:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573891584 00000100:00100000:1.0:1746140889.856233:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573891584 00010000:00010000:2.0:1746140889.856234:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2042 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746140889.856237:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611c00 with x1830960573891328 ext(0->1048575) 00002000:00010000:3.0:1746140889.856241:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092611c00 00002000:00100000:1.0:1746140889.856253:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092613b80 x1830960573891584/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746140889.856254:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140889.856255:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140889.856259:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573891712 00002000:00100000:1.0:1746140889.856260:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092613b80 with x1830960573891584 ext(1048576->2097151) 00000100:00100000:3.0:1746140889.856262:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573891712 00010000:00010000:2.0:1746140889.856262:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746140889.856264:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092613b80 00010000:00010000:2.0:1746140889.856275:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746140889.856276:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880092612d80 x1830960573891712/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140889.856276:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573891968 00000100:00100000:1.0:1746140889.856278:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573891968 00002000:00100000:3.0:1746140889.856281:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612d80 with x1830960573891712 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.856284:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612d80 00010000:00010000:2.0:1746140889.856286:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0aec00, rc 0) 00002000:00100000:1.0:1746140889.856289:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880092610700 x1830960573891968/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.856296:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092610700 with x1830960573891968 ext(1048576->2097151) 00000100:00100000:3.0:1746140889.856297:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8894 00002000:00010000:1.0:1746140889.856298:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092610700 00000100:00100000:3.0:1746140889.856302:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573891328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.856329:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8895 00000100:00100000:1.0:1746140889.856334:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1982:x1830960573891584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.856351:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573890944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 155us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140889.856355:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17349 00000100:00100000:2.0:1746140889.856375:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8896 00000100:00100000:2.0:1746140889.856378:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1982:x1830960573891712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.856426:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8897 00000100:00100000:3.0:1746140889.856431:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1982:x1830960573891968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140889.856720:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.856746:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.856759:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.856772:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.856791:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.856949:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573892096 00000100:00100000:1.0:1746140889.856954:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573892096 00000100:00100000:1.0:1746140889.857240:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573892224 00000100:00100000:1.0:1746140889.857243:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573892224 00000100:00100000:1.0:1746140889.857258:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573892352 00000100:00100000:1.0:1746140889.857261:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573892352 00000100:00100000:1.0:1746140889.857293:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573892480 00000100:00100000:1.0:1746140889.857295:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573892480 00000100:00100000:1.0:1746140889.857325:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573892608 00000100:00100000:1.0:1746140889.857328:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573892608 00000100:00100000:1.0:1746140889.857344:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17350 00000100:00100000:1.0:1746140889.857348:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573892096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.857362:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.857377:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2049 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.857393:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857395:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857400:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857414:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857423:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a6600, rc 0) 00000100:00100000:1.0:1746140889.857454:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573892096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.857463:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17350 00000100:00100000:1.0:1746140889.857473:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17351 00000100:00100000:1.0:1746140889.857479:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573892224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.857484:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.857490:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2050 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.857501:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857503:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857507:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857515:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857522:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a6800, rc 0) 00000100:00100000:1.0:1746140889.857536:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573892224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 58us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.857541:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17351 00000100:00100000:1.0:1746140889.857550:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17352 00000100:00100000:1.0:1746140889.857554:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573892352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.857559:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.857567:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2057 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.857576:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857578:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857581:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 28 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857590:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 28 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857596:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a6a00, rc 0) 00000100:00100000:1.0:1746140889.857607:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573892352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.857612:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17352 00000100:00100000:1.0:1746140889.857620:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17353 00000100:00100000:1.0:1746140889.857624:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573892480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.857629:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.857634:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a205e expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.857647:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857649:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857652:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 28 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857661:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 28 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857667:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a6000, rc 0) 00000100:00100000:1.0:1746140889.857680:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573892480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 56us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.857688:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17353 00000100:00100000:1.0:1746140889.857697:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17354 00000100:00100000:1.0:1746140889.857701:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573892608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.857706:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.857712:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2065 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.857721:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857723:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140889.857726:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857734:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140889.857741:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a6200, rc 0) 00000100:00100000:1.0:1746140889.857756:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573892608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 54us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.857761:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17354 00000100:00100000:3.0:1746140889.868083:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573891968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11636us (11911us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.868098:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8897 00002000:00100000:3.0:1746140889.868113:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880092610700 x1830960573891968/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.868125:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092610700 with x1830960573891968 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.868131:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092610700 00000100:00100000:2.0:1746140889.871834:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573891712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15442us (15691us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.871846:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8896 00002000:00100000:2.0:1746140889.871856:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880092612d80 x1830960573891712/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.871865:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612d80 with x1830960573891712 ext(1048576->2097151) 00002000:00010000:2.0:1746140889.871870:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612d80 00000100:00100000:2.0:1746140889.878718:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573891584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22370us (22594us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.878732:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8895 00002000:00100000:2.0:1746140889.878744:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092613b80 x1830960573891584/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.878754:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092613b80 with x1830960573891584 ext(1048576->2097151) 00002000:00010000:2.0:1746140889.878760:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092613b80 00000100:00100000:3.0:1746140889.879236:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1982:x1830960573891328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22932us (23146us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.879244:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8894 00002000:00100000:3.0:1746140889.879250:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880092611c00 x1830960573891328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.879257:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611c00 with x1830960573891328 ext(0->1048575) 00002000:00010000:3.0:1746140889.879261:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092611c00 00000100:00100000:0.0:1746140889.881430:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.881700:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573892864 00000100:00100000:2.0:1746140889.881709:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573892864 00000100:00100000:2.0:1746140889.881766:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10833 00000100:00100000:2.0:1746140889.881774:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:396:x1830960573892864:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140889.881800:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140889.881818:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a206c expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.881919:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.881933:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.881939:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.881946:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140889.881978:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.881990:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 7 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.882001:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576116224:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.882102:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140889.882109:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 269 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:2.0:1746140889.882117:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576116352:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.882131:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140889.883635:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.883683:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.883684:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576116224:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140889.883694:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576116352:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140889.883714:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:1.0:1746140889.883763:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573893504 00000100:00100000:1.0:1746140889.883769:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573893504 00010000:00010000:1.0:1746140889.883798:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 270 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.883818:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573893632 00000100:00100000:1.0:1746140889.883819:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573893632 00010000:00010000:1.0:1746140889.883829:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 8 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.883838:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9004 00000100:00100000:3.0:1746140889.883849:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1985:x1830960573893504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.883860:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140889.883866:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 270 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:1.0:1746140889.883866:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9005 00000100:00100000:1.0:1746140889.883872:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573893632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140889.883876:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 270 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.883879:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140889.883883:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 8 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.883895:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5569600/0x8156357b7fdbb394 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a200a expref: 270 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:1.0:1746140889.883952:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 8 pid: 14742 timeout: 968 lvb_type: 0 00010000:00010000:3.0:1746140889.883960:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140889.883965:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140889.883971:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140889.883976:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140889.884016:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0ae600/0x8156357b7fdbb3e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a203b expref: 8 pid: 14742 timeout: 968 lvb_type: 0 00000100:00100000:3.0:1746140889.884021:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960573893504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 175us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140889.884027:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9004 00010000:00010000:1.0:1746140889.884029:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.884033:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.884039:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.884045:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.884064:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140889.884081:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960573893632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 209us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.884087:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9005 00010000:00010000:1.0:1746140889.884435:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.884446:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140889.884464:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140889.884614:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af000/0x8156357b7fdbb419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.884626:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.884632:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.884635:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746140889.884637:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0af400, rc 0) 00000100:00100000:1.0:1746140889.884673:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:396:x1830960573892864:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2900us (3251us total) trans 8589945160 rc 0/0 00000100:00100000:1.0:1746140889.884680:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10833 00000100:00100000:0.0:1746140889.884980:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.885022:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.885050:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.885074:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.885077:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573893248 00000100:00100000:2.0:1746140889.885083:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573893248 00002000:00100000:2.0:1746140889.885112:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880092613100 x1830960573893248/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.885122:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092613100 with x1830960573893248 ext(0->1048575) 00002000:00010000:2.0:1746140889.885126:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092613100 00000100:00100000:2.0:1746140889.885143:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573893376 00000100:00100000:2.0:1746140889.885146:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573893376 00002000:00100000:2.0:1746140889.885156:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880092611f80 x1830960573893376/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140889.885160:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573894016 00002000:00100000:2.0:1746140889.885162:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611f80 with x1830960573893376 ext(1048576->2097151) 00000100:00100000:3.0:1746140889.885164:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573894016 00002000:00010000:2.0:1746140889.885166:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092611f80 00002000:00100000:3.0:1746140889.885183:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880092612a00 x1830960573894016/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140889.885186:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573893888 00000100:00100000:2.0:1746140889.885188:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573893888 00002000:00100000:3.0:1746140889.885192:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612a00 with x1830960573894016 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.885195:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612a00 00002000:00100000:2.0:1746140889.885203:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092612680 x1830960573893888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140889.885207:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8898 00002000:00100000:2.0:1746140889.885209:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612680 with x1830960573893888 ext(1048576->2097151) 00000100:00100000:3.0:1746140889.885213:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573893248:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:2.0:1746140889.885213:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612680 00000100:00100000:2.0:1746140889.885224:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8899 00000100:00100000:2.0:1746140889.885229:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573893376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.885612:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8900 00000100:00100000:1.0:1746140889.885619:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573894016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.886496:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8901 00000100:00100000:3.0:1746140889.886503:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1982:x1830960573893888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140889.888487:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.889240:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573894272 00000100:00100000:1.0:1746140889.889249:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573894272 00000100:00100000:1.0:1746140889.889331:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10834 00000100:00100000:1.0:1746140889.889339:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:391:x1830960573894272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140889.889358:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.889378:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2073 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.889609:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2073 expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.889625:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2073 expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.889643:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.889646:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140889.889650:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb000, rc 0) 00000100:00100000:1.0:1746140889.889679:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:391:x1830960573894272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 341us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.889685:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10834 00000100:00100000:2.0:1746140889.898382:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.898433:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573894528 00000100:00100000:1.0:1746140889.898442:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573894528 00000100:00100000:1.0:1746140889.898501:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10835 00000100:00100000:1.0:1746140889.898508:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:398:x1830960573894528:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140889.898528:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140889.898546:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a207a expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.898651:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898664:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898674:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898686:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898696:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898700:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898800:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb44a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898807:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb44a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898813:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb44a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:1.0:1746140889.898821:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140889.898904:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898910:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898915:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898919:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140889.898922:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898934:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898948:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140889.898952:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140889.898955:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898960:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb43c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898982:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898986:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898991:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.898995:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140889.898997:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.899001:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.899019:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4020900) 00010000:00010000:1.0:1746140889.899021:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140889.899023:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.899027:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb443 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140889.899061:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a207a expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.899076:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb44a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a207a expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.899082:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.899084:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746140889.899086:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb800, rc 0) 00000100:00100000:1.0:1746140889.899129:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:398:x1830960573894528:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 622us (759us total) trans 8589945161 rc 0/0 00000100:00100000:1.0:1746140889.899135:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10835 00000100:00100000:3.0:1746140889.899910:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1982:x1830960573893248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14689us (14922us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.899921:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8898 00002000:00100000:3.0:1746140889.899930:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880092613100 x1830960573893248/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.899938:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092613100 with x1830960573893248 ext(0->1048575) 00002000:00010000:3.0:1746140889.899943:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092613100 00000100:00100000:2.0:1746140889.900276:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573893376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15044us (15251us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.900283:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8899 00002000:00100000:2.0:1746140889.900289:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880092611f80 x1830960573893376/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.900296:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611f80 with x1830960573893376 ext(1048576->2097151) 00002000:00010000:2.0:1746140889.900300:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092611f80 00000100:00100000:1.0:1746140889.900917:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1982:x1830960573894016:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15297us (15864us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140889.900925:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8900 00002000:00100000:1.0:1746140889.900935:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880092612a00 x1830960573894016/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.900942:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612a00 with x1830960573894016 ext(1048576->2097151) 00002000:00010000:1.0:1746140889.900945:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612a00 00000100:00100000:0.0:1746140889.904224:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.904346:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573894656 00000100:00100000:1.0:1746140889.904356:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573894656 00000100:00100000:1.0:1746140889.904422:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10836 00000100:00100000:3.0:1746140889.904423:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573893888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17916us (19343us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140889.904430:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+9:394:x1830960573894656:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140889.904432:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8901 00002000:00100000:3.0:1746140889.904441:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880092612680 x1830960573893888/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746140889.904446:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746140889.904449:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612680 with x1830960573893888 ext(1048576->2097151) 00002000:00010000:3.0:1746140889.904454:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612680 00010000:00010000:1.0:1746140889.904463:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fba00/0x8156357b7fdbb458 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2081 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.904514:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fba00/0x8156357b7fdbb458 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2081 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.904527:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fba00/0x8156357b7fdbb458 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2081 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140889.904541:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140889.904544:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140889.904547:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fba00, rc 0) 00000100:00100000:1.0:1746140889.904581:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+10:394:x1830960573894656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 151us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140889.904586:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10836 00000100:00100000:0.0:1746140889.917357:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.917459:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573894912 00000100:00100000:3.0:1746140889.917467:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573894912 00002000:00100000:3.0:1746140889.917504:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f519c00 x1830960573894912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.917512:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519c00 with x1830960573894912 ext(2097152->3145727) 00002000:00010000:3.0:1746140889.917516:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f519c00 00000100:00100000:3.0:1746140889.917531:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8902 00000100:00100000:3.0:1746140889.917535:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573894912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140889.923760:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.923801:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.923833:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140889.923978:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573895168 00000100:00100000:1.0:1746140889.923989:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573895168 00000100:00100000:2.0:1746140889.924048:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573895424 00002000:00100000:1.0:1746140889.924051:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f51b480 x1830960573895168/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140889.924052:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573895424 00002000:00100000:1.0:1746140889.924062:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51b480 with x1830960573895168 ext(3145728->4194303) 00002000:00010000:1.0:1746140889.924068:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51b480 00002000:00100000:2.0:1746140889.924073:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f51bb80 x1830960573895424/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.924082:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51bb80 with x1830960573895424 ext(2097152->3145727) 00002000:00010000:2.0:1746140889.924085:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f51bb80 00000100:00100000:1.0:1746140889.924094:0:21689:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573895680 00000100:00100000:1.0:1746140889.924098:0:21689:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573895680 00000100:00100000:2.0:1746140889.924100:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8903 00000100:00100000:2.0:1746140889.924107:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573895168:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746140889.924115:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f518a80 x1830960573895680/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.924122:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518a80 with x1830960573895680 ext(3145728->4194303) 00002000:00010000:1.0:1746140889.924125:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f518a80 00000100:00100000:1.0:1746140889.924142:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8904 00000100:00100000:1.0:1746140889.924149:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573895424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.924447:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8905 00000100:00100000:3.0:1746140889.924463:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573895680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.926271:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573894912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8728us (8918us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.926282:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8902 00002000:00100000:3.0:1746140889.926291:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f519c00 x1830960573894912/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.926299:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519c00 with x1830960573894912 ext(2097152->3145727) 00002000:00010000:3.0:1746140889.926320:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f519c00 00000100:00100000:0.0:1746140889.932686:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.933749:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.933791:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.933810:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573896064 00000100:00100000:0.0:1746140889.933817:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573896064 00002000:00100000:0.0:1746140889.933854:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f519880 x1830960573896064/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140889.933863:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519880 with x1830960573896064 ext(2097152->3145727) 00002000:00010000:0.0:1746140889.933868:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f519880 00000100:00100000:0.0:1746140889.933881:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573896192 00000100:00100000:0.0:1746140889.933882:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573896192 00002000:00100000:0.0:1746140889.933888:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f51aa00 x1830960573896192/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140889.933894:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51aa00 with x1830960573896192 ext(3145728->4194303) 00002000:00010000:0.0:1746140889.933896:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51aa00 00000100:00100000:0.0:1746140889.933902:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573896576 00000100:00100000:0.0:1746140889.933904:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573896576 00002000:00100000:0.0:1746140889.933911:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f518000 x1830960573896576/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140889.933915:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518000 with x1830960573896576 ext(3145728->4194303) 00002000:00010000:0.0:1746140889.933918:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f518000 00000100:00100000:0.0:1746140889.933927:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8906 00000100:00100000:0.0:1746140889.933932:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573896064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140889.933947:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8907 00000100:00100000:1.0:1746140889.933957:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573896192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.934344:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8908 00000100:00100000:3.0:1746140889.934353:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573896576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.935297:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573895680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10840us (11461us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.935324:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8905 00002000:00100000:2.0:1746140889.935331:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f518a80 x1830960573895680/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.935342:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518a80 with x1830960573895680 ext(3145728->4194303) 00002000:00010000:2.0:1746140889.935347:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f518a80 00000100:00100000:0.0:1746140889.935348:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140889.935363:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573896448 00000100:00100000:0.0:1746140889.935367:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573896448 00002000:00100000:0.0:1746140889.935394:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f519f80 x1830960573896448/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140889.935400:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519f80 with x1830960573896448 ext(2097152->3145727) 00002000:00010000:0.0:1746140889.935403:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f519f80 00000100:00100000:0.0:1746140889.935422:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8909 00000100:00100000:0.0:1746140889.935427:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1982:x1830960573896448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140889.936043:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573895168:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11935us (12292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.936050:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8903 00002000:00100000:3.0:1746140889.936056:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f51b480 x1830960573895168/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.936063:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51b480 with x1830960573895168 ext(3145728->4194303) 00002000:00010000:3.0:1746140889.936066:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51b480 00000100:00100000:1.0:1746140889.936622:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573895424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12472us (12818us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140889.936629:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8904 00002000:00100000:1.0:1746140889.936634:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f51bb80 x1830960573895424/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140889.936642:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51bb80 with x1830960573895424 ext(2097152->3145727) 00002000:00010000:1.0:1746140889.936644:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f51bb80 00000100:00100000:2.0:1746140889.945346:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1982:x1830960573896064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11359us (12615us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.945360:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8906 00002000:00100000:2.0:1746140889.945374:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f519880 x1830960573896064/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.945383:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519880 with x1830960573896064 ext(2097152->3145727) 00002000:00010000:2.0:1746140889.945389:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f519880 00000100:00100000:2.0:1746140889.949706:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573896192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15741us (15948us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.949719:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8907 00002000:00100000:2.0:1746140889.949733:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f51aa00 x1830960573896192/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.949742:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51aa00 with x1830960573896192 ext(3145728->4194303) 00002000:00010000:2.0:1746140889.949748:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51aa00 00000100:00100000:3.0:1746140889.950200:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1982:x1830960573896576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15848us (16406us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140889.950209:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8908 00002000:00100000:3.0:1746140889.950215:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f518000 x1830960573896576/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140889.950222:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518000 with x1830960573896576 ext(3145728->4194303) 00002000:00010000:3.0:1746140889.950225:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f518000 00000100:00100000:2.0:1746140889.952592:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960573896448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17158us (17236us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140889.952601:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8909 00002000:00100000:2.0:1746140889.952610:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f519f80 x1830960573896448/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.952618:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f519f80 with x1830960573896448 ext(2097152->3145727) 00002000:00010000:2.0:1746140889.952625:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f519f80 00000100:00100000:0.0:1746140889.954025:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.954247:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573896960 00000100:00100000:2.0:1746140889.954257:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573896960 00002000:00100000:2.0:1746140889.954301:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f51ad80 x1830960573896960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.954348:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51ad80 with x1830960573896960 ext(4194304->4886527) 00002000:00010000:2.0:1746140889.954353:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51ad80 00000100:00100000:2.0:1746140889.954397:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8910 00000100:00100000:2.0:1746140889.954407:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573896960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140889.959696:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573896960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5282us (5669us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140889.959708:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8910 00002000:00100000:2.0:1746140889.959720:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f51ad80 x1830960573896960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.959728:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51ad80 with x1830960573896960 ext(4194304->4886527) 00002000:00010000:2.0:1746140889.959733:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51ad80 00000100:00100000:0.0:1746140889.960639:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140889.960723:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573897216 00000100:00100000:2.0:1746140889.960731:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573897216 00002000:00100000:2.0:1746140889.960767:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f51b100 x1830960573897216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/0 e 0 to 0 dl 1746140900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.960775:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51b100 with x1830960573897216 ext(4194304->4886527) 00002000:00010000:2.0:1746140889.960780:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51b100 00000100:00100000:2.0:1746140889.960806:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8911 00000100:00100000:2.0:1746140889.960814:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573897216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140889.966413:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.966512:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573897472 00000100:00100000:3.0:1746140889.966522:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573897472 00000100:00100000:3.0:1746140889.966587:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4774 00000100:00100000:3.0:1746140889.966594:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:391:x1830960573897472:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140889.966904:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:391:x1830960573897472:12345-192.168.204.16@tcp:35:cat.0 Request processed in 310us (503us total) trans 8589945162 rc 0/0 00000100:00100000:3.0:1746140889.966914:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4774 00000100:00100000:2.0:1746140889.967075:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573897216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6260us (6447us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140889.967084:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8911 00002000:00100000:2.0:1746140889.967094:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f51b100 x1830960573897216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:305/0 lens 488/440 e 0 to 0 dl 1746140900 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140889.967103:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51b100 with x1830960573897216 ext(4194304->4886527) 00002000:00010000:2.0:1746140889.967109:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51b100 00000100:00100000:0.0:1746140889.971479:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140889.971771:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573897728 00000100:00100000:3.0:1746140889.971783:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573897728 00000100:00100000:3.0:1746140889.971898:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4775 00000100:00100000:3.0:1746140889.971907:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca7b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:394:x1830960573897728:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140889.972259:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca7b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:394:x1830960573897728:12345-192.168.204.16@tcp:35:cat.0 Request processed in 352us (801us total) trans 8589945163 rc 0/0 00000100:00100000:3.0:1746140889.972266:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4775 00000100:00100000:0.0:1746140890.007210:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.007348:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573897984 00000100:00100000:2.0:1746140890.007358:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573897984 00000100:00100000:2.0:1746140890.007420:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10837 00000100:00100000:2.0:1746140890.007428:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:398:x1830960573897984:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.007454:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.007458:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746140890.007492:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fba00/0x8156357b7fdbb458 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2081 expref: 11 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.007526:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb44a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a207a expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.007537:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.007541:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140890.007554:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb45f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2088 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.007602:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00000100:00080000:0.0:1746140890.007645:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746140890.007684:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.007691:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2073 expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.007696:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.007723:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2073 expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.007734:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2073 expref: 270 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.007744:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576116480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.008520:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.008534:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 8 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.008549:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576116608:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.008573:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d3879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140890.009341:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.009502:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573898240 00000100:00100000:2.0:1746140890.009509:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573898240 00000100:00100000:2.0:1746140890.009568:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10838 00000100:00100000:2.0:1746140890.009574:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:396:x1830960573898240:12345-192.168.204.16@tcp:101:multiop.0 00000100:00080000:0.0:1746140890.009583:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746140890.009592:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.009595:0:14742:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746140890.009610:0:14742:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2073 expref: 271 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.009630:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.009634:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.009641:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.009645:0:14742:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140890.009655:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb46d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a208f expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.009699:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.009709:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.009716:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.009729:0:14742:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.009740:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.010727:0:14785:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from blocking AST (req@ffff88009b1b3b80 x1830960576116480) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2073 expref: 272 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.010741:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb42e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2073 expref: 272 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.010755:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576116480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.010768:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576116608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.010776:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140890.010786:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.010790:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.010797:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.010804:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140890.010834:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573898368 00000100:00100000:1.0:1746140890.010843:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573898368 00010000:00010000:1.0:1746140890.010977:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 9 pid: 14785 timeout: 969 lvb_type: 0 00000100:00080000:2.0:1746140890.010996:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746140890.011010:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9006 00000100:00100000:1.0:1746140890.011018:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573898368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.011028:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.011033:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 9 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.011042:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 9 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.011055:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ae00/0x8156357b7fdbb378 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2003 expref: 9 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.011072:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.011076:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.011082:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.011088:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.011093:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140890.011097:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140890.011109:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.011163:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573898368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 146us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.011170:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9006 00010000:00010000:3.0:1746140890.011822:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.011830:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00000040:00080000:3.0:1746140890.012645:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3503, 88 off296936 00000004:00080000:3.0:1746140890.012655:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869088348985ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.012714:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3523, 88 off298872 00000004:00080000:3.0:1746140890.012719:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869088414525ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140890.013876:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3524, 88 off298960 00000004:00080000:3.0:1746140890.013881:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869089575700ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140890.013891:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3504, 88 off297024 00000004:00080000:3.0:1746140890.013894:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869089588934ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.013905:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3505, 88 off297112 00000004:00080000:3.0:1746140890.013907:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869089602633ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.013915:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3525, 88 off299048 00000004:00080000:3.0:1746140890.013918:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869089612833ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140890.013926:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3526, 88 off299136 00000004:00080000:3.0:1746140890.013929:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869089624133ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140890.013937:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3527, 88 off299224 00000004:00080000:3.0:1746140890.013939:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869089634303ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140890.013947:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3506, 88 off297200 00000004:00080000:3.0:1746140890.013951:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869089646014ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.013965:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3528, 88 off299312 00000004:00080000:3.0:1746140890.013968:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869089663570ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140890.013982:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3507, 88 off297288 00000004:00080000:3.0:1746140890.013985:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869089680223ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.013993:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3529, 88 off299400 00000004:00080000:3.0:1746140890.013996:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869089691485ns, next at 809142599738ns, rc = 0 00000040:00080000:3.0:1746140890.014016:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3508, 88 off297376 00000004:00080000:3.0:1746140890.014019:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869089714034ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.014028:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3509, 88 off297464 00000004:00080000:3.0:1746140890.014031:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869089726465ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.014037:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3510, 88 off297552 00000004:00080000:3.0:1746140890.014040:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869089735620ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.014047:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3511, 88 off297640 00000004:00080000:3.0:1746140890.014050:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869089744874ns, next at 849271537162ns, rc = 0 00000040:00080000:3.0:1746140890.014057:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3530, 88 off299488 00000004:00080000:3.0:1746140890.014059:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869089754307ns, next at 809142599738ns, rc = 0 00000001:00080000:1.0:1746140890.029054:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945158 is committed 00000001:00080000:1.0:1746140890.029067:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945161 is committed 00000001:00080000:1.0:1746140890.029071:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945160 is committed 00000001:00080000:1.0:1746140890.029079:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945164 is committed 00010000:00010000:2.0:1746140890.029082:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746140890.029083:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2772 committed 00000004:00080000:1.0:1746140890.029091:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2756 committed 00010000:00010000:2.0:1746140890.029095:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.029098:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1746140890.029101:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2755 committed 00010000:00010000:2.0:1746140890.029102:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00080000:1.0:1746140890.029102:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2754 committed 00000004:00080000:1.0:1746140890.029108:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2753 committed 00010000:00010000:2.0:1746140890.029110:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746140890.029110:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2771 committed 00000004:00080000:1.0:1746140890.029113:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2752 committed 00000004:00080000:1.0:1746140890.029114:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2770 committed 00010000:00010000:2.0:1746140890.029116:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00080000:1.0:1746140890.029116:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2751 committed 00000004:00080000:1.0:1746140890.029118:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2769 committed 00000004:00080000:1.0:1746140890.029119:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2768 committed 00000004:00080000:1.0:1746140890.029121:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2767 committed 00000004:00080000:1.0:1746140890.029122:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2750 committed 00000004:00080000:1.0:1746140890.029124:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2749 committed 00000004:00080000:1.0:1746140890.029125:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2766 committed 00000004:00080000:1.0:1746140890.029127:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2765 committed 00000004:00080000:1.0:1746140890.029128:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2748 committed 00000001:00080000:1.0:1746140890.029133:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945162 is committed 00000001:00080000:1.0:1746140890.029137:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945157 is committed 00010000:00010000:2.0:1746140890.029150:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.029162:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 8 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.029176:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576116736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.029216:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576116864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.029263:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.029295:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576117376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.029331:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.029344:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576117888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.029346:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576116992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.029360:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140890.029382:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.029382:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576118400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.029387:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576117248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.029397:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576117504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.029400:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.029413:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576116864 00000100:00100000:1.0:1746140890.029413:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.029420:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576116864 00000100:00100000:0.0:1746140890.029421:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801359b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576117120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.029422:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576118016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.029438:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.029441:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140890.029447:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576118528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.029449:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576117376 00000100:00100000:3.0:1746140890.029451:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576117376 00000100:00100000:0.0:1746140890.029455:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576117632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.029459:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.029463:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.029467:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576117888 00000100:00100000:3.0:1746140890.029469:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576117888 00000100:00100000:0.0:1746140890.029469:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.029479:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576116992 00000100:00100000:3.0:1746140890.029480:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576118400 00000100:00100000:0.0:1746140890.029480:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576118144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.029481:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576118400 00000100:00100000:1.0:1746140890.029481:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576117504 00000100:00100000:2.0:1746140890.029482:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576116992 00000100:00100000:1.0:1746140890.029484:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576117504 00000100:00100000:3.0:1746140890.029490:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576118016 00000100:00100000:0.0:1746140890.029492:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.029493:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576118016 00000100:00100000:2.0:1746140890.029495:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576117120 00000100:00100000:1.0:1746140890.029496:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576118528 00000100:00100000:2.0:1746140890.029497:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576117120 00000100:00100000:1.0:1746140890.029498:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576118528 00000100:00100000:0.0:1746140890.029498:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576118656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.029499:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576117632 00000100:00100000:3.0:1746140890.029500:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576117632 00000100:00100000:2.0:1746140890.029504:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576118144 00000100:00100000:2.0:1746140890.029506:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576118144 00000100:00100000:1.0:1746140890.029508:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17355 00000100:00100000:0.0:1746140890.029509:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.029512:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17356 00000100:00100000:1.0:1746140890.029514:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576116864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.029517:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3311:x1830960576117376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.029520:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576118656 00000100:00100000:2.0:1746140890.029522:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576118656 00000100:00100000:0.0:1746140890.029526:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17357 00000100:00100000:3.0:1746140890.029530:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17358 00000100:00100000:0.0:1746140890.029531:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3311:x1830960576117888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.029534:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3311:x1830960576118400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.029534:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17359 00000100:00100000:2.0:1746140890.029539:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3312:x1830960576116992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.029568:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17360 00000100:00100000:2.0:1746140890.029573:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3312:x1830960576117504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.029587:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17361 00000100:00100000:3.0:1746140890.029591:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3312:x1830960576118016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.029646:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17362 00000100:00100000:1.0:1746140890.029651:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960576117120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140890.029661:0:8458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140890.029664:0:8458:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.029667:0:8458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.029669:0:8458:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.029671:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140890.029671:0:8458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:3.0:1746140890.029673:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.029675:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.029676:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.029678:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746140890.029680:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+52:3312:x1830960576117504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (265us total) trans 17179874201 rc 0/0 00000100:00100000:2.0:1746140890.029686:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17360 00000100:00100000:3.0:1746140890.029693:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3312:x1830960576118016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (254us total) trans 21474841495 rc 0/0 00000100:00100000:0.0:1746140890.029693:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3311:x1830960576117888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (332us total) trans 21474841494 rc 0/0 00000100:00100000:3.0:1746140890.029698:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17361 00000100:00100000:0.0:1746140890.029701:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17357 00000100:00100000:2.0:1746140890.029704:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17363 00000100:00100000:2.0:1746140890.029708:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3312:x1830960576118528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.029709:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17364 00000100:00100000:3.0:1746140890.029711:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17365 00000100:00100000:0.0:1746140890.029713:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960576117632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.029715:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3313:x1830960576118144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140890.029722:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746140890.029725:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:1.0:1746140890.029727:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:1.0:1746140890.029728:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:1.0:1746140890.029730:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746140890.029752:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960576117120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (309us total) trans 17179874203 rc 0/0 00000100:00100000:1.0:1746140890.029758:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17362 00000100:00100000:1.0:1746140890.029769:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17366 00000100:00100000:1.0:1746140890.029773:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3313:x1830960576118656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140890.029775:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:3.0:1746140890.029777:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.029779:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.029781:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.029783:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5521 -> 5521 00000100:00100000:2.0:1746140890.029784:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3312:x1830960576118528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (324us total) trans 21474841496 rc 0/0 00000100:00100000:0.0:1746140890.029784:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3313:x1830960576117632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (314us total) trans 17179874204 rc 0/0 00000100:00100000:0.0:1746140890.029789:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17364 00000100:00100000:2.0:1746140890.029793:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17363 00000100:00100000:3.0:1746140890.029796:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3313:x1830960576118144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (302us total) trans 21474841497 rc 0/0 00000100:00100000:3.0:1746140890.029800:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17365 00000100:00100000:1.0:1746140890.029850:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3313:x1830960576118656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (340us total) trans 21474841498 rc 0/0 00002000:00010000:2.0:1746140890.029856:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746140890.029856:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17366 00000100:00100000:3.0:1746140890.029857:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3311:x1830960576118400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 323us (456us total) trans 21474841499 rc 0/0 00002000:00010000:2.0:1746140890.029859:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.029861:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00000100:00100000:3.0:1746140890.029862:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17358 00002000:00010000:2.0:1746140890.029863:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.029865:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746140890.029883:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3312:x1830960576116992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 344us (500us total) trans 17179874205 rc 0/0 00000100:00100000:2.0:1746140890.029888:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17359 00000004:00080000:1.0:1746140890.029892:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b1180/2, rc 0, transno 17179874205 00000100:00100000:1.0:1746140890.029896:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576116992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140890.029903:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b2680/2, rc 0, transno 17179874201 00000100:00100000:1.0:1746140890.029907:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576117504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140890.029931:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1efb80/2, rc 0, transno 21474841495 00000100:00100000:1.0:1746140890.029937:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576118016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140890.029943:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ed880/2, rc 0, transno 21474841496 00000100:00100000:1.0:1746140890.029946:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576118528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.029947:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3311:x1830960576117376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 429us (615us total) trans 17179874206 rc 0/0 00000004:00080000:0.0:1746140890.029951:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b0000/2, rc 0, transno 17179874203 00000100:00100000:3.0:1746140890.029952:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17356 00000100:00100000:0.0:1746140890.029955:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576117120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140890.029961:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1edf80/2, rc 0, transno 17179874204 00000100:00100000:0.0:1746140890.029964:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576117632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140890.029970:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ec380/2, rc 0, transno 21474841497 00000100:00100000:0.0:1746140890.029973:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576118144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.029978:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ed500/2, rc 0, transno 21474841498 00000100:00100000:0.0:1746140890.029980:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576118656:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746140890.029988:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140890.029990:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140889 -> 1746140889 00000100:00100000:0.0:1746140890.029990:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576118912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.029992:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746140890.029993:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:1.0:1746140890.029995:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140889 -> 1746140889 00002000:00010000:1.0:1746140890.029997:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140890.030019:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.030023:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576117760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.030027:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3311:x1830960576116864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 513us (764us total) trans 17179874202 rc 0/0 00000100:00100000:1.0:1746140890.030032:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17355 00000004:00080000:0.0:1746140890.030033:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ec000/2, rc 0, transno 21474841499 00000100:00100000:0.0:1746140890.030036:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576118400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.030038:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140890.030042:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b1500/2, rc 0, transno 17179874206 00000100:00100000:0.0:1746140890.030045:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576117376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.030046:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576118272:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.030050:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ee300/2, rc 0, transno 21474841494 00000100:00100000:0.0:1746140890.030052:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576117888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.030059:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140890.030059:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801354bc700/2, rc 0, transno 17179874202 00000100:00100000:0.0:1746140890.030061:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576116864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.030198:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576117248 00000100:00100000:2.0:1746140890.030201:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576118912 00000100:00100000:1.0:1746140890.030201:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576117248 00000100:00100000:0.0:1746140890.030201:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576117760 00000100:00100000:0.0:1746140890.030204:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576117760 00000100:00100000:2.0:1746140890.030205:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576118912 00000100:00100000:3.0:1746140890.030207:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576118784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.030215:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576118272 00000100:00100000:1.0:1746140890.030216:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576118272 00000100:00100000:0.0:1746140890.030218:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17367 00000100:00100000:3.0:1746140890.030221:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.030223:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17368 00000100:00100000:0.0:1746140890.030223:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3310:x1830960576117248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.030227:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3310:x1830960576117760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.030229:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576118784 00000100:00100000:1.0:1746140890.030231:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576118784 00000100:00100000:3.0:1746140890.030239:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17369 00000100:00100000:1.0:1746140890.030243:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17370 00000100:00100000:3.0:1746140890.030244:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3311:x1830960576118912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.030247:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3310:x1830960576118272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.030267:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17371 00000100:00100000:3.0:1746140890.030271:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3310:x1830960576118784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.030324:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3310:x1830960576117760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (285us total) trans 17179874207 rc 0/0 00000100:00100000:2.0:1746140890.030330:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17368 00000100:00100000:0.0:1746140890.030338:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3310:x1830960576117248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (345us total) trans 17179874208 rc 0/0 00000100:00100000:1.0:1746140890.030340:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960576118272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (279us total) trans 21474841500 rc 0/0 00000100:00100000:0.0:1746140890.030344:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17367 00000100:00100000:1.0:1746140890.030351:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17370 00000100:00100000:3.0:1746140890.030354:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960576118784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (132us total) trans 21474841501 rc 0/0 00000100:00100000:3.0:1746140890.030358:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17371 00000100:00100000:3.0:1746140890.030431:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3311:x1830960576118912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (410us total) trans 21474841502 rc 0/0 00000100:00100000:3.0:1746140890.030436:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17369 00000004:00080000:3.0:1746140890.030454:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801359b2d80/2, rc 0, transno 17179874208 00000100:00100000:3.0:1746140890.030457:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801359b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576117248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140890.030462:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1eed80/2, rc 0, transno 17179874207 00000100:00100000:3.0:1746140890.030464:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576117760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140890.030470:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1eca80/2, rc 0, transno 21474841500 00000100:00100000:3.0:1746140890.030472:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576118272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140890.030476:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ee680/2, rc 0, transno 21474841501 00000100:00100000:3.0:1746140890.030478:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576118784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140890.030504:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ec700/2, rc 0, transno 21474841502 00000100:00100000:1.0:1746140890.030507:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576118912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.031379:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576116736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.031411:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0e600/0x8156357b7fdbb45f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 8 pid: 14785 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746140890.031428:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 7 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.031437:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 7 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.031472:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff0fc00, rc 0) 00000100:00100000:2.0:1746140890.031515:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:398:x1830960573897984:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 24089us (24317us total) trans 8589945164 rc 0/0 00000100:00100000:2.0:1746140890.031523:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10837 00000100:00100000:0.0:1746140890.033172:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.033242:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.033328:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573898496 00000100:00100000:1.0:1746140890.033328:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573898624 00000100:00100000:2.0:1746140890.033334:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573898496 00000100:00100000:1.0:1746140890.033334:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573898624 00010000:00010000:1.0:1746140890.033355:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 8 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.033370:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9007 00000100:00100000:2.0:1746140890.033372:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10839 00000100:00100000:1.0:1746140890.033374:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573898624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140890.033378:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:398:x1830960573898496:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140890.033381:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.033386:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 8 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.033392:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.033393:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 8 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.033403:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2096 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.033405:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff0fc00/0x8156357b7fdbb466 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2088 expref: 8 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.033413:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.033416:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140890.033422:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140890.033426:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:1.0:1746140890.033439:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.033456:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1983:x1830960573898624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.033459:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9007 00010000:00010000:2.0:1746140890.033620:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.033629:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.033643:0:14785:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.033652:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.033660:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.033662:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140890.033665:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.033671:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4c600, rc 0) 00000100:00100000:2.0:1746140890.033703:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:398:x1830960573898496:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 324us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.033708:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10839 00010000:00010000:2.0:1746140890.033726:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.033733:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14742 initiator: MDT0 00000040:00080000:2.0:1746140890.034575:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3512, 88 off297728 00000004:00080000:2.0:1746140890.034582:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110277004ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034670:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3531, 88 off299576 00000004:00080000:2.0:1746140890.034674:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869110369177ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.034773:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3532, 88 off299664 00000004:00080000:2.0:1746140890.034777:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869110472325ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.034785:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3513, 88 off297816 00000004:00080000:2.0:1746140890.034788:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110482743ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034806:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3514, 88 off297904 00000004:00080000:2.0:1746140890.034810:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110504707ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034839:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3533, 88 off299752 00000004:00080000:2.0:1746140890.034843:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869110538007ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.034852:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3534, 88 off299840 00000004:00080000:2.0:1746140890.034855:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869110549910ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.034861:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3535, 88 off299928 00000004:00080000:2.0:1746140890.034864:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869110558823ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.034870:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3515, 88 off297992 00000004:00080000:2.0:1746140890.034874:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110569114ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034881:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3536, 88 off300016 00000004:00080000:2.0:1746140890.034883:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869110578593ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.034889:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3516, 88 off298080 00000004:00080000:2.0:1746140890.034892:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110586992ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034898:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3537, 88 off300104 00000004:00080000:2.0:1746140890.034901:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869110596339ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.034907:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3517, 88 off298168 00000004:00080000:2.0:1746140890.034910:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110605002ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034916:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3518, 88 off298256 00000004:00080000:2.0:1746140890.034919:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110614042ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034926:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3519, 88 off298344 00000004:00080000:2.0:1746140890.034928:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110623799ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034941:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3520, 88 off298432 00000004:00080000:2.0:1746140890.034944:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869110639295ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.034951:0:14742:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3538, 88 off300192 00000004:00080000:2.0:1746140890.034954:0:14742:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869110649450ns, next at 809142599738ns, rc = 0 00000001:00080000:1.0:1746140890.051158:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945165 is committed 00000004:00080000:1.0:1746140890.051166:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2780 committed 00000004:00080000:1.0:1746140890.051173:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2765 committed 00000004:00080000:1.0:1746140890.051178:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2764 committed 00000004:00080000:1.0:1746140890.051180:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2763 committed 00000004:00080000:1.0:1746140890.051182:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2762 committed 00000004:00080000:1.0:1746140890.051184:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2779 committed 00000004:00080000:1.0:1746140890.051185:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2761 committed 00000004:00080000:1.0:1746140890.051188:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2778 committed 00000004:00080000:1.0:1746140890.051189:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2760 committed 00000004:00080000:1.0:1746140890.051191:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2777 committed 00000004:00080000:1.0:1746140890.051193:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2776 committed 00000004:00080000:1.0:1746140890.051194:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2775 committed 00000004:00080000:1.0:1746140890.051196:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2759 committed 00000004:00080000:1.0:1746140890.051197:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2758 committed 00000004:00080000:1.0:1746140890.051199:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2774 committed 00000004:00080000:1.0:1746140890.051201:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2773 committed 00000004:00080000:1.0:1746140890.051202:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2757 committed 00010000:00010000:3.0:1746140890.051208:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.051221:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.051223:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746140890.051227:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 6 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.051236:0:14742:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 6 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.051243:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 6 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.051265:0:14742:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 6 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.051281:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576119168:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.051357:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576119040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.051371:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fae40 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.051381:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576119424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.051391:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576119296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.051397:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.051418:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576119040 00000100:00100000:0.0:1746140890.051420:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140890.051421:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576119552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.051424:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576119040 00000100:00100000:0.0:1746140890.051434:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576119808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.051439:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.051448:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140890.051451:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576120192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.051458:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576120320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.051459:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576119296 00000100:00100000:3.0:1746140890.051461:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576119296 00000100:00100000:0.0:1746140890.051469:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.051473:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576119552 00000100:00100000:3.0:1746140890.051475:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576119552 00000100:00100000:0.0:1746140890.051477:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576120832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.051485:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576119808 00000100:00100000:3.0:1746140890.051486:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576119808 00000100:00100000:0.0:1746140890.051487:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.051496:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576120320 00000100:00100000:3.0:1746140890.051497:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576120320 00000100:00100000:0.0:1746140890.051498:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746140890.051502:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576120704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.051505:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576120832 00000100:00100000:3.0:1746140890.051507:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576120832 00000100:00100000:0.0:1746140890.051513:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.051516:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576120704 00000100:00100000:3.0:1746140890.051518:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576120704 00000100:00100000:2.0:1746140890.051526:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17372 00000100:00100000:3.0:1746140890.051534:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17373 00000100:00100000:2.0:1746140890.051538:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3312:x1830960576119040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.051539:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3313:x1830960576119296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.051606:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17374 00000100:00100000:3.0:1746140890.051610:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3312:x1830960576119552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140890.051699:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140890.051702:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.051704:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.051705:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.051707:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:3.0:1746140890.051710:0:4785:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140890.051712:0:4785:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140889 -> 1746140889 00002000:00010000:3.0:1746140890.051714:0:4785:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:3.0:1746140890.051716:0:4785:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140889 -> 1746140889 00002000:00010000:3.0:1746140890.051718:0:4785:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746140890.051734:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3312:x1830960576119040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (336us total) trans 21474841503 rc 0/0 00000100:00100000:3.0:1746140890.051739:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3312:x1830960576119552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (299us total) trans 17179874209 rc 0/0 00000100:00100000:2.0:1746140890.051743:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17372 00000100:00100000:3.0:1746140890.051746:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17374 00000100:00100000:3.0:1746140890.051756:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17375 00000100:00100000:3.0:1746140890.051760:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3313:x1830960576119808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.051760:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17376 00000100:00100000:2.0:1746140890.051764:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3313:x1830960576120320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.051790:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17377 00000100:00100000:3.0:1746140890.051793:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3313:x1830960576120832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.051872:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.051889:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576120192 00000100:00100000:0.0:1746140890.051893:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576120192 00000004:00080000:1.0:1746140890.051897:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ed180/2, rc 0, transno 21474841503 00000100:00100000:1.0:1746140890.051905:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576119040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.051907:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17378 00000100:00100000:0.0:1746140890.051912:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3313:x1830960576120704:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140890.051914:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7aa300/2, rc 0, transno 17179874209 00000100:00100000:1.0:1746140890.051917:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576119552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.051922:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+64:3313:x1830960576120320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (452us total) trans 21474841504 rc 0/0 00000100:00100000:3.0:1746140890.051923:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3313:x1830960576120832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (433us total) trans 17179874210 rc 0/0 00000100:00100000:2.0:1746140890.051928:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17376 00000100:00100000:1.0:1746140890.051928:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576119680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.051931:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17377 00000100:00100000:2.0:1746140890.051938:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17379 00000100:00100000:2.0:1746140890.051942:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3312:x1830960576120192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.051946:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.051956:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576119680 00000100:00100000:3.0:1746140890.051958:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576119680 00000100:00100000:1.0:1746140890.051958:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576120064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.051969:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17380 00000100:00100000:1.0:1746140890.051971:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.051972:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3311:x1830960576119680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.051980:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576120576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.051992:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140890.052014:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576121088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.052019:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3313:x1830960576120704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (503us total) trans 17179874211 rc 0/0 00000100:00100000:0.0:1746140890.052025:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17378 00000100:00100000:1.0:1746140890.052028:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.052034:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+65:3312:x1830960576120192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (162us total) trans 21474841505 rc 0/0 00000100:00100000:0.0:1746140890.052034:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576120064 00000100:00100000:0.0:1746140890.052036:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576120064 00000100:00100000:1.0:1746140890.052037:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746140890.052040:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17379 00000100:00100000:1.0:1746140890.052040:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576120960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.052046:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576120576 00000100:00100000:0.0:1746140890.052048:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576120576 00000100:00100000:2.0:1746140890.052049:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576121088 00000100:00100000:1.0:1746140890.052051:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.052052:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576121088 00000100:00100000:0.0:1746140890.052055:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576120960 00000100:00100000:0.0:1746140890.052057:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576120960 00000100:00100000:2.0:1746140890.052062:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17381 00000100:00100000:2.0:1746140890.052066:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3311:x1830960576120064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.052070:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3311:x1830960576119680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (122us total) trans 21474841506 rc 0/0 00000100:00100000:0.0:1746140890.052073:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17382 00000100:00100000:1.0:1746140890.052077:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17383 00000100:00100000:0.0:1746140890.052077:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3311:x1830960576120576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.052080:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17380 00000100:00100000:1.0:1746140890.052083:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3311:x1830960576121088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.052088:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17384 00000100:00100000:3.0:1746140890.052092:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3311:x1830960576120960:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140890.052121:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a8380/2, rc 0, transno 17179874211 00000004:00080000:1.0:1746140890.052124:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ef100/2, rc 0, transno 21474841506 00000100:00100000:0.0:1746140890.052125:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576120704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.052127:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576119680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.052133:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07a300/2, rc 0, transno 21474841504 00000004:00080000:1.0:1746140890.052134:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f078700/2, rc 0, transno 21474841507 00000100:00100000:2.0:1746140890.052135:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3311:x1830960576120064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (163us total) trans 21474841507 rc 0/0 00000100:00100000:0.0:1746140890.052136:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576120320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.052137:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576120064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.052139:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17381 00000004:00080000:0.0:1746140890.052143:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a8000/2, rc 0, transno 17179874210 00000100:00100000:0.0:1746140890.052145:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576120832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.052155:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3311:x1830960576120960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (103us total) trans 17179874212 rc 0/0 00000100:00100000:3.0:1746140890.052160:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17384 00000100:00100000:3.0:1746140890.052174:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.052184:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576119936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.052196:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746140890.052198:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.052202:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f07b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576121216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.052205:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576120448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.052222:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140890.052224:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+60:3311:x1830960576121088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (193us total) trans 17179874213 rc 0/0 00000100:00100000:1.0:1746140890.052229:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17383 00000100:00100000:3.0:1746140890.052238:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576119424 00000100:00100000:1.0:1746140890.052238:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576119936 00000100:00100000:3.0:1746140890.052240:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576119424 00000100:00100000:1.0:1746140890.052240:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576119936 00000100:00100000:3.0:1746140890.052249:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576120448 00000100:00100000:3.0:1746140890.052251:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576120448 00000100:00100000:0.0:1746140890.052254:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3311:x1830960576120576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (260us total) trans 17179874214 rc 0/0 00000100:00100000:1.0:1746140890.052255:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17385 00000100:00100000:1.0:1746140890.052258:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+67:3310:x1830960576119424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.052260:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17382 00000100:00100000:3.0:1746140890.052262:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17386 00000100:00100000:3.0:1746140890.052266:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960576119936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.052270:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17387 00000100:00100000:0.0:1746140890.052275:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3310:x1830960576120448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746140890.052344:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:3.0:1746140890.052345:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140890.052346:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.052347:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:1.0:1746140890.052348:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.052349:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:1.0:1746140890.052349:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.052351:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:1.0:1746140890.052351:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5521 -> 5521 00002000:00010000:3.0:1746140890.052353:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00010000:0.0:1746140890.052368:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140890.052370:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.052372:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00000100:00100000:3.0:1746140890.052373:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3310:x1830960576119936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (174us total) trans 17179874215 rc 0/0 00000100:00100000:1.0:1746140890.052373:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+68:3310:x1830960576119424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (197us total) trans 21474841509 rc 0/0 00002000:00010000:0.0:1746140890.052374:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.052376:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746140890.052377:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17386 00000100:00100000:1.0:1746140890.052382:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17385 00000100:00100000:0.0:1746140890.052397:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3310:x1830960576120448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (174us total) trans 17179874216 rc 0/0 00000004:00080000:1.0:1746140890.052401:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a9180/2, rc 0, transno 17179874212 00000004:00080000:3.0:1746140890.052402:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ef800/2, rc 0, transno 21474841509 00000100:00100000:0.0:1746140890.052403:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17387 00000100:00100000:3.0:1746140890.052405:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576119424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.052405:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576120960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140890.052411:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a8700/2, rc 0, transno 17179874214 00000004:00080000:3.0:1746140890.052413:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a8a80/2, rc 0, transno 17179874215 00000100:00100000:1.0:1746140890.052414:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576120576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.052416:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576119936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140890.052419:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7a9500/2, rc 0, transno 17179874213 00000004:00080000:3.0:1746140890.052422:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f7abb80/2, rc 0, transno 17179874216 00000100:00100000:1.0:1746140890.052422:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576121088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.052425:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576120448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.052425:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.052433:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576121216 00000100:00100000:3.0:1746140890.052435:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576121216 00000100:00100000:3.0:1746140890.052446:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17388 00000100:00100000:3.0:1746140890.052449:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3313:x1830960576121216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.052501:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3313:x1830960576119808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 740us (1051us total) trans 21474841508 rc 0/0 00000100:00100000:2.0:1746140890.052507:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17375 00000004:00080000:0.0:1746140890.052511:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07aa00/2, rc 0, transno 21474841508 00000100:00100000:0.0:1746140890.052516:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576119808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.052521:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3313:x1830960576121216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (95us total) trans 21474841510 rc 0/0 00000004:00080000:0.0:1746140890.052522:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f07b100/2, rc 0, transno 21474841510 00000100:00100000:0.0:1746140890.052525:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f07b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576121216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.052526:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17388 00002000:00010000:2.0:1746140890.052567:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140890.052569:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.052571:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.052573:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.052575:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746140890.052593:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3313:x1830960576119296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1055us (1173us total) trans 21474841511 rc 0/0 00000100:00100000:2.0:1746140890.052598:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17373 00000004:00080000:0.0:1746140890.052602:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ef480/2, rc 0, transno 21474841511 00000100:00100000:0.0:1746140890.052605:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576119296:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140890.052618:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f078a80/2, rc 0, transno 21474841505 00000100:00100000:2.0:1746140890.052621:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576120192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.053439:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.053442:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576119168:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140890.053472:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f773600/0x8156357b7fdbb46d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746140890.053488:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.053488:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573898752 00000100:00100000:2.0:1746140890.053492:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573898752 00010000:00010000:3.0:1746140890.053513:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d000, rc 0) 00000100:00100000:2.0:1746140890.053532:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4776 00000100:00100000:2.0:1746140890.053538:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:398:x1830960573898752:12345-192.168.204.16@tcp:49:multiop.0 00000100:00100000:3.0:1746140890.053540:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:396:x1830960573898240:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 43966us (44207us total) trans 8589945165 rc 0/0 00000100:00100000:3.0:1746140890.053546:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10838 00000100:00100000:2.0:1746140890.053658:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:398:x1830960573898752:12345-192.168.204.16@tcp:49:multiop.0 Request processed in 120us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.053664:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4776 00000100:00100000:0.0:1746140890.065020:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.065125:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573898880 00000100:00100000:2.0:1746140890.065135:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573898880 00000100:00100000:2.0:1746140890.065181:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17389 00000100:00100000:2.0:1746140890.065188:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+20:398:x1830960573898880:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.065209:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.065226:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a209d expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.065252:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.065261:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 21 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.065271:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.065273:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.065277:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1142784->1892351] (req 1142784->1892351) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 21 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.065331:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 21 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.065341:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.065352:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576121344:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.065442:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.065450:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 37 pid: 12255 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.065459:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576121472:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.065479:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387300 going to sleep for 11 seconds 00000100:00100000:1.0:1746140890.065671:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.065840:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573899008 00000100:00100000:0.0:1746140890.065845:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573899008 00000100:00100000:0.0:1746140890.065874:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17390 00000100:00100000:0.0:1746140890.065879:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:396:x1830960573899008:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140890.065887:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.065901:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20a4 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.065915:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 39 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.065922:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 21 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.065927:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.065928:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.065931:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1839104->2097151] (req 1839104->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 39 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.065950:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 21 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.065957:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.065964:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092611880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576121600:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.066026:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 39 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.066037:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 39 pid: 20960 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.066047:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092611180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576121728:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.066065:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.066678:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576121344:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.066687:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576121472:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.066706:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1142784->1892351] (req 1142784->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 21 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.066718:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c25a00, rc 0) 00000100:00100000:2.0:1746140890.066745:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+21:398:x1830960573898880:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1557us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.066751:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17389 00000100:00100000:0.0:1746140890.066844:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.066869:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.066883:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573899264 00000100:00100000:2.0:1746140890.066884:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573899136 00000100:00100000:2.0:1746140890.066886:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573899136 00000100:00100000:0.0:1746140890.066886:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573899264 00010000:00010000:2.0:1746140890.066901:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.066901:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 40 pid: 12255 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.066929:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9008 00000100:00100000:2.0:1746140890.066932:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9009 00000100:00100000:0.0:1746140890.066934:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573899264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140890.066936:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573899136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.066944:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140890.066944:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.066965:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.066965:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 40 pid: 12255 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.066974:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.066982:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 40 pid: 12255 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.066997:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6600/0x8156357b7fdbb3f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2049 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.067000:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5569a00/0x8156357b7fdbb3a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2018 expref: 40 pid: 12255 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.067021:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.067022:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.067027:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 20 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.067038:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 20 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.067045:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140890.067054:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 20 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.067062:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576121856:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140890.067067:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573899264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.067073:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9008 00000100:00100000:2.0:1746140890.067087:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.067243:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.067273:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092611880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576121600:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.067278:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.067281:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092611180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576121728:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.067294:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1839104->2097151] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 38 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.067327:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f822200, rc 0) 00000100:00100000:1.0:1746140890.067342:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573899520 00000100:00100000:1.0:1746140890.067350:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573899520 00000100:00100000:2.0:1746140890.067351:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:396:x1830960573899008:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1471us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.067356:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17390 00010000:00010000:1.0:1746140890.067378:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 38 pid: 20960 timeout: 969 lvb_type: 1 00000100:00100000:1.0:1746140890.067402:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573899392 00000100:00100000:1.0:1746140890.067404:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573899392 00000100:00100000:2.0:1746140890.067411:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9010 00010000:00010000:1.0:1746140890.067417:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.067418:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573899520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.067426:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.067436:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 38 pid: 20960 timeout: 969 lvb_type: 1 00000100:00100000:1.0:1746140890.067441:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9011 00010000:00010000:2.0:1746140890.067448:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 38 pid: 20960 timeout: 969 lvb_type: 1 00000100:00100000:1.0:1746140890.067448:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573899392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.067458:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e42aa00/0x8156357b7fdbb3b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a201f expref: 38 pid: 20960 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.067458:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.067465:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140890.067475:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.067485:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.067496:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573899520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.067502:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9010 00010000:00010000:1.0:1746140890.067503:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6800/0x8156357b7fdbb3fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2050 expref: 21 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.067534:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.067740:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.067747:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.067755:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.067783:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.067793:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f079180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576121984:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.068030:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.068402:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.068409:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576121856:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140890.068421:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.068444:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573899136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1506us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.068450:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9009 00000100:00100000:3.0:1746140890.068464:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573899776 00000100:00100000:3.0:1746140890.068468:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573899776 00002000:00100000:3.0:1746140890.068585:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1142784->1146879) req@ffff880092611180 x1830960573899776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.068595:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611180 with x1830960573899776 ext(1142784->1146879) 00002000:00010000:3.0:1746140890.068599:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092611180 00000100:00100000:3.0:1746140890.068627:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8912 00000100:00100000:3.0:1746140890.068634:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573899776:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.068755:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573899776:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 122us (354us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.068762:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8912 00002000:00100000:3.0:1746140890.068768:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1142784->1146879) req@ffff880092611180 x1830960573899776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.068775:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611180 with x1830960573899776 ext(1142784->1146879) 00002000:00010000:3.0:1746140890.068783:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092611180 00000100:00100000:0.0:1746140890.069862:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.069902:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f079180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576121984:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140890.069917:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.069954:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1985:x1830960573899392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2506us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.069962:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9011 00000100:00100000:3.0:1746140890.070242:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573900032 00000100:00100000:3.0:1746140890.070247:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573900032 00002000:00100000:3.0:1746140890.070273:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1839104->1843199) req@ffff880092611880 x1830960573900032/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.070281:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611880 with x1830960573900032 ext(1839104->1843199) 00002000:00010000:3.0:1746140890.070285:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092611880 00000100:00100000:3.0:1746140890.070592:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8913 00000100:00100000:3.0:1746140890.070600:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573900032:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.070740:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573900032:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 141us (880us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.070747:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8913 00002000:00100000:3.0:1746140890.070752:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1839104->1843199) req@ffff880092611880 x1830960573900032/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.070759:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092611880 with x1830960573900032 ext(1839104->1843199) 00002000:00010000:3.0:1746140890.070762:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092611880 00000100:00100000:0.0:1746140890.074386:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.074492:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.074568:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573900288 00000100:00100000:3.0:1746140890.074577:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573900288 00000100:00100000:2.0:1746140890.074599:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573900416 00000100:00100000:2.0:1746140890.074610:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573900416 00002000:00100000:3.0:1746140890.074620:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1888256->1892351) req@ffff880092610a80 x1830960573900288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.074630:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092610a80 with x1830960573900288 ext(1888256->1892351) 00002000:00010000:3.0:1746140890.074636:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092610a80 00000100:00100000:3.0:1746140890.074663:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8914 00000100:00100000:3.0:1746140890.074670:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573900288:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140890.074712:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17391 00000100:00100000:2.0:1746140890.074721:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:396:x1830960573900416:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.074735:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.074751:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20ab expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.074777:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 32 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.074791:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.074796:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.074798:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.074801:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1740799] (req 1048576->1740799) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 32 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.074828:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.074838:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 27 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.074848:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576122112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.074904:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960573900288:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 234us (526us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.074910:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8914 00002000:00100000:3.0:1746140890.074915:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1888256->1892351) req@ffff880092610a80 x1830960573900288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.074923:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092610a80 with x1830960573900288 ext(1888256->1892351) 00002000:00010000:3.0:1746140890.074926:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092610a80 00010000:00010000:2.0:1746140890.074965:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 32 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.074973:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 32 pid: 32376 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.074981:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576122240:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.075177:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.076797:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.076825:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.076876:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.076924:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573900544 00000100:00100000:3.0:1746140890.076930:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573900544 00000100:00100000:1.0:1746140890.076994:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573900672 00000100:00100000:2.0:1746140890.077012:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576122112:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.077014:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573900672 00000100:00100000:2.0:1746140890.077026:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576122240:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.077048:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 33 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.077054:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1048576->1740799] (req 1048576->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 33 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.077070:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42b200, rc 0) 00000100:00100000:1.0:1746140890.077082:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9012 00000100:00100000:1.0:1746140890.077089:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573900672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.077100:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140890.077103:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:396:x1830960573900416:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2383us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.077110:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17391 00010000:00010000:1.0:1746140890.077118:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 33 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.077127:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 32 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.077147:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb3b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2026 expref: 32 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.077167:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.077197:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573900672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.077203:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9012 00000100:00080000:2.0:1746140890.077268:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746140890.077271:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 28 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.077281:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573900928 00000100:00100000:2.0:1746140890.077284:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573900928 00000100:00100000:3.0:1746140890.077289:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9013 00000100:00100000:3.0:1746140890.077295:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573900544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.077323:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140890.077323:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4777 00000100:00100000:2.0:1746140890.077328:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+7:398:x1830960573900928:12345-192.168.204.16@tcp:35:multiop.0 00010000:00010000:3.0:1746140890.077337:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 28 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:3.0:1746140890.077346:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 28 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:3.0:1746140890.077363:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6a00/0x8156357b7fdbb404 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2057 expref: 28 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:3.0:1746140890.077376:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.077378:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.077384:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.077391:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.077415:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.077425:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576122368:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140890.077488:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.077812:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:398:x1830960573900928:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 482us (934us total) trans 8589945166 rc 0/0 00000100:00100000:2.0:1746140890.077818:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4777 00000100:00100000:3.0:1746140890.079028:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576122368:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140890.079038:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140890.079072:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573900544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1777us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.079080:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9013 00000100:00100000:0.0:1746140890.084894:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.085012:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573901184 00000100:00100000:3.0:1746140890.085022:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573901184 00002000:00100000:3.0:1746140890.085062:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1736704->1740799) req@ffff88009f518380 x1830960573901184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.085070:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518380 with x1830960573901184 ext(1736704->1740799) 00002000:00010000:3.0:1746140890.085075:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f518380 00000100:00100000:3.0:1746140890.085102:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8915 00000100:00100000:3.0:1746140890.085112:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573901184:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.085289:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573901184:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 180us (407us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.085296:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8915 00002000:00100000:3.0:1746140890.085302:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1736704->1740799) req@ffff88009f518380 x1830960573901184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.085341:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f518380 with x1830960573901184 ext(1736704->1740799) 00002000:00010000:3.0:1746140890.085344:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f518380 00000100:00100000:0.0:1746140890.145050:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.145256:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573901312 00000100:00100000:3.0:1746140890.145267:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573901312 00000100:00100000:3.0:1746140890.145347:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10840 00000100:00100000:3.0:1746140890.145356:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+6:403:x1830960573901312:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140890.145381:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.145400:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb497 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20b2 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.145466:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.145479:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.145488:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.145501:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.145507:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.145513:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.145627:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.145637:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 267 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.145643:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.145674:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 267 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.145686:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 267 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.145697:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576122496:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.145858:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.146853:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576122496:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.146868:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:0.0:1746140890.147114:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.147179:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573901568 00000100:00100000:2.0:1746140890.147184:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573901568 00000100:00100000:2.0:1746140890.147218:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4778 00000100:00100000:2.0:1746140890.147224:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:27093:x1830960573901568:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746140890.147469:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:27093:x1830960573901568:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 244us (355us total) trans 8589945167 rc 0/0 00000100:00100000:2.0:1746140890.147476:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4778 00000100:00100000:0.0:1746140890.148357:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.148402:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573901696 00000100:00100000:3.0:1746140890.148406:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573901696 00010000:00010000:3.0:1746140890.148428:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.148454:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9014 00000100:00100000:3.0:1746140890.148459:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1984:x1830960573901696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.148467:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.148471:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.148478:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.148493:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0af400/0x8156357b7fdbb420 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a206c expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.148509:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.148513:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.148521:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.148528:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.148543:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140890.148550:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148556:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140890.148581:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1984:x1830960573901696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.148586:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9014 00000004:00200000:0.0:1746140890.148587:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140890.148591:0:14742:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140890.148605:0:14742:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148616:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148624:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148629:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148635:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148640:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140890.148644:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148650:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148658:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140890.148660:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140890.148663:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148671:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb49e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148694:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148699:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148738:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148742:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50faa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140890.148744:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148797:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148805:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388100) 00010000:00010000:0.0:1746140890.148807:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140890.148810:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148814:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb4a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:0.0:1746140890.148843:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb497 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.148854:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.148865:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140890.148867:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140890.148869:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbc00, rc 0) 00000100:00100000:0.0:1746140890.148906:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:403:x1830960573901312:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3551us (3870us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.148912:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10840 00000100:00100000:0.0:1746140890.150531:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.150611:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.150638:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.150694:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.150703:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573901824 00000100:00100000:2.0:1746140890.150709:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573901824 00000100:00100000:3.0:1746140890.150710:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573901952 00000100:00100000:3.0:1746140890.150715:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573901952 00000100:00100000:0.0:1746140890.150717:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.150737:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573902080 00000100:00100000:3.0:1746140890.150739:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573902336 00000100:00100000:2.0:1746140890.150739:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573902080 00000100:00100000:3.0:1746140890.150741:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573902336 00000100:00100000:0.0:1746140890.150748:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573902208 00000100:00100000:0.0:1746140890.150751:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573902208 00000100:00100000:2.0:1746140890.150755:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17392 00000100:00100000:3.0:1746140890.150760:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17393 00000100:00100000:2.0:1746140890.150761:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573901824:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:3.0:1746140890.150766:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573901952:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746140890.150768:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17394 00000100:00100000:0.0:1746140890.150773:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573902080:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:1.0:1746140890.150775:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17395 00010000:00010000:3.0:1746140890.150776:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.150776:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.150778:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140890.150786:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573902336:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140890.150789:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb200/0x8156357b7fdbb4ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20c0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.150789:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20b9 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.150789:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbb4b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20c7 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.150793:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.150801:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20d5 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.150808:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.150809:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.150812:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.150813:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.150816:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.150819:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.150826:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 12 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.150829:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140890.150831:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576122624:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140890.150831:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576122752:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140890.150836:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42bc00, rc 0) 00010000:00010000:1.0:1746140890.150837:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308f2400, rc 0) 00000100:00100000:2.0:1746140890.150867:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573901824:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 107us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.150868:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573902336:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 86us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.150871:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17392 00000100:00100000:1.0:1746140890.150874:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17395 00000100:00100000:2.0:1746140890.150881:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17396 00000100:00100000:2.0:1746140890.150884:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573902208:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140890.150888:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140890.150889:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746140890.150892:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e42a600/0x8156357b7fdbb4cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20ce expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.150893:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.150909:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576122880:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140890.150929:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.151183:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.152090:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573902464 00000100:00100000:1.0:1746140890.152104:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573902464 00000100:00100000:1.0:1746140890.152178:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17397 00000100:00100000:1.0:1746140890.152186:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573902464:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140890.152203:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.152219:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20dc expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.152238:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.152241:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.152249:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 13 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.152263:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 13 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.152273:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e308800, rc 0) 00000100:00100000:1.0:1746140890.152361:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573902464:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 175us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.152368:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17397 00000100:00100000:0.0:1746140890.152479:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576122752:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140890.152501:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbb4b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20c7 expref: 12 pid: 4784 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140890.152504:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576122880:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140890.152518:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f7c200/0x8156357b7fdbb4b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20c7 expref: 12 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.152527:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e42a600/0x8156357b7fdbb4cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ce expref: 11 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.152528:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f7c200, rc 0) 00010000:00010000:2.0:1746140890.152537:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e42a600/0x8156357b7fdbb4cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ce expref: 11 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.152550:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42a600, rc 0) 00000100:00100000:0.0:1746140890.152555:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573902080:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1782us (1916us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140890.152561:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17394 00000100:00100000:2.0:1746140890.152572:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573902208:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1686us (1853us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140890.152578:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17396 00002000:00010000:2.0:1746140890.152629:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime: 1746140889 -> 1746140890 00002000:00010000:2.0:1746140890.152632:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime: 1746140889 -> 1746140890 00000100:00100000:2.0:1746140890.152642:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576122624:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140890.152656:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb200/0x8156357b7fdbb4ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20c0 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.152664:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb200/0x8156357b7fdbb4ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20c0 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.152672:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb200, rc 0) 00000100:00100000:2.0:1746140890.152687:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573901952:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1922us (2076us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140890.152692:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17393 00000100:00100000:0.0:1746140890.155110:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.155236:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573902720 00000100:00100000:2.0:1746140890.155248:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573902720 00000100:00100000:2.0:1746140890.155343:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10841 00000100:00100000:2.0:1746140890.155353:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:403:x1830960573902720:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140890.155372:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.155390:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb4dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20e3 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.155475:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.155487:0:14742:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.155493:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.155520:0:14742:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.155531:0:14742:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 8 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.155541:0:14742:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576123008:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.155633:0:14742:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.157910:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.157912:0:14742:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14742:1830960576123008:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.157938:0:14742:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:3.0:1746140890.158008:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573902848 00000100:00100000:3.0:1746140890.158014:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573902848 00010000:00010000:3.0:1746140890.158044:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 9 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.158077:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9015 00000100:00100000:3.0:1746140890.158083:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573902848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.158095:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.158100:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 9 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.158110:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 9 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.158129:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb4ac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b2 expref: 9 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.158143:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.158450:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.158462:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.158468:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.158491:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140890.158516:0:14742:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.158524:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140890.158542:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140890.158685:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b000/0x8156357b7fdbb4dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20e3 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.158698:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20e3 expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.158703:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.158706:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140890.158707:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42aa00, rc 0) 00000100:00100000:3.0:1746140890.158804:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573902848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 719us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.158811:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9015 00000100:00100000:2.0:1746140890.158811:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:403:x1830960573902720:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3459us (3717us total) trans 8589945168 rc 0/0 00000100:00100000:2.0:1746140890.158817:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10841 00000100:00100000:0.0:1746140890.161033:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.161092:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573903104 00000100:00100000:2.0:1746140890.161100:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573903104 00000100:00100000:2.0:1746140890.161141:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10842 00000100:00100000:2.0:1746140890.161147:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:403:x1830960573903104:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140890.161166:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.161169:0:14742:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746140890.161190:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42aa00/0x8156357b7fdbb4e4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20e3 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.161203:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.161207:0:14742:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140890.161218:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ac00/0x8156357b7fdbb4f2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20ea expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.161301:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.161348:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.161356:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:2.0:1746140890.161366:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140890.161472:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42ac00/0x8156357b7fdbb4f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.161483:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.161489:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.161491:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140890.161493:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42b400, rc 0) 00000100:00100000:2.0:1746140890.161545:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:403:x1830960573903104:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 398us (522us total) trans 8589945169 rc 0/0 00000100:00100000:2.0:1746140890.161550:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10842 00000100:00100000:0.0:1746140890.164231:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.164338:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573903232 00000100:00100000:2.0:1746140890.164347:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573903232 00000100:00100000:2.0:1746140890.164405:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10843 00000100:00100000:2.0:1746140890.164411:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:403:x1830960573903232:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140890.164610:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.164629:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a600/0x8156357b7fdbb507 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20f1 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.164683:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a600/0x8156357b7fdbb507 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20f1 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.164696:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a600/0x8156357b7fdbb507 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20f1 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.164712:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.164715:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140890.164718:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42a600, rc 0) 00000100:00100000:2.0:1746140890.164773:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:403:x1830960573903232:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 362us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.164779:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10843 00000100:00100000:3.0:1746140890.167655:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.167723:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573903360 00000100:00100000:2.0:1746140890.167731:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573903360 00000100:00100000:2.0:1746140890.167777:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17398 00000100:00100000:2.0:1746140890.167785:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573903360:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746140890.167826:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.167845:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.167851:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.167862:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.167867:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.167868:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.167871:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.167900:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140890.167907:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140890.167911:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 26 pid: 12255 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.167924:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576123136:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.167937:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.167951:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573903488 00000100:00100000:0.0:1746140890.167956:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573903488 00000100:00100000:1.0:1746140890.167958:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140890.167993:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 10 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.168013:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 10 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.168021:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573903744 00000100:00100000:2.0:1746140890.168021:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576123264:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.168025:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573903744 00000100:00100000:3.0:1746140890.168041:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573904000 00000100:00100000:3.0:1746140890.168042:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573904000 00000100:00100000:3.0:1746140890.168053:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17399 00000100:00100000:3.0:1746140890.168058:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573903744:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140890.168073:0:32376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.168081:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140890.168083:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.168088:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.168090:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.168092:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.168094:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.168107:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.168107:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 30 pid: 24958 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.168115:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576123392:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.168117:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 30 pid: 9872 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.168124:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576123520:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.168134:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.168138:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573903616 00000100:00100000:0.0:1746140890.168141:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573903616 00000100:00100000:1.0:1746140890.168144:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.168145:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.168157:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573903872 00000100:00100000:0.0:1746140890.168159:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573903872 00000100:00100000:1.0:1746140890.168162:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17400 00000100:00100000:3.0:1746140890.168171:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17401 00000100:00100000:1.0:1746140890.168171:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573904000:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746140890.168177:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573903488:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140890.168191:0:8459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.168192:0:8460:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.168202:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 18 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.168202:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 36 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.168207:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.168208:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140890.168209:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 11 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.168211:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.168213:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17402 00010000:00010000:1.0:1746140890.168215:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 18 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140890.168219:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573903616:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140890.168219:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.168220:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.168222:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.168224:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 18 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.168231:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 18 pid: 32376 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.168236:0:4186:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.168239:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 18 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140890.168240:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576123648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.168246:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.168247:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 18 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.168251:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140890.168253:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140890.168255:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.168255:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576123776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.168264:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.168268:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17403 00010000:00010000:2.0:1746140890.168269:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.168277:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 36 pid: 9872 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.168283:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573903872:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:2.0:1746140890.168284:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f72a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576123904:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.168291:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 11 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.168298:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 11 pid: 4785 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.168302:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387300 going to sleep for 11 seconds 00000100:00100000:1.0:1746140890.168325:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576124032:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.168361:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.168371:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 36 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.168377:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 30 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.168378:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 36 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:1.0:1746140890.168385:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576124160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.168405:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41b7540 going to sleep for 11 seconds 00010000:00010000:0.0:1746140890.168459:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.168467:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 26 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.168473:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.168475:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.168478:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.168503:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 26 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.168513:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 26 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.168528:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576124288:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.168603:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 12 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.168611:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 12 pid: 8460 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.168620:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576124416:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.168674:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 30 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.168693:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 30 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.168701:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576124544:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.168720:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.169801:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576123136:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.169812:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576123264:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.169855:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576123392:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.169858:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140890.169877:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140890.169889:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.169950:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573904256 00000100:00100000:3.0:1746140890.169956:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573904256 00000100:00100000:1.0:1746140890.169970:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573904128 00000100:00100000:1.0:1746140890.169974:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573904128 00010000:00010000:3.0:1746140890.169981:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 13 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.169991:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 27 pid: 12255 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.170021:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9016 00000100:00100000:3.0:1746140890.170026:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573904256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.170038:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.170066:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 13 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:3.0:1746140890.170075:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 13 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.170076:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140890.170093:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e42bc00/0x8156357b7fdbb4c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20b9 expref: 13 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:1.0:1746140890.170100:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573904384 00000100:00100000:1.0:1746140890.170102:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573904384 00010000:00010000:3.0:1746140890.170109:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140890.170109:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9017 00010000:00010000:1.0:1746140890.170114:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 31 pid: 24958 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.170115:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573904128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140890.170122:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140890.170130:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9018 00010000:00010000:0.0:1746140890.170130:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 27 pid: 12255 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.170134:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573904256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.170136:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960573904384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140890.170138:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 27 pid: 12255 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.170140:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9016 00010000:00010000:1.0:1746140890.170143:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140890.170149:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0aec00/0x8156357b7fdbb3ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2042 expref: 27 pid: 12255 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.170161:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140890.170173:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573904128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.170179:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9017 00010000:00010000:1.0:1746140890.170185:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 31 pid: 24958 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.170193:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 31 pid: 24958 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.170205:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0afc00/0x8156357b7fdbb3a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2011 expref: 31 pid: 24958 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.170219:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.170220:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.170224:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.170231:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.170262:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.170289:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1983:x1830960573904384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 153us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.170295:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9018 00010000:00010000:2.0:1746140890.170373:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.170381:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.170406:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.170412:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.170418:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.170423:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b3800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140890.170426:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.170436:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.170455:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.170459:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb50e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.170516:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573903360:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 2730us (2868us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.170524:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17398 00000100:00100000:3.0:1746140890.172036:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576123520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.172053:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.172090:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8459:1830960576123648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.172107:0:8459:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.172265:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576123776:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.173351:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.173371:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.173400:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.173411:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.173427:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.173442:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573904768 00000100:00100000:0.0:1746140890.173448:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573904768 00010000:00010000:0.0:1746140890.173473:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 19 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.173492:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573905024 00000100:00100000:0.0:1746140890.173493:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573905024 00010000:00010000:0.0:1746140890.173502:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 26 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.173511:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573905152 00000100:00100000:0.0:1746140890.173512:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573905152 00010000:00010000:0.0:1746140890.173520:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 37 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.173526:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573904896 00000100:00100000:0.0:1746140890.173527:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573904896 00010000:00010000:0.0:1746140890.173534:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 12 pid: 4785 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.173542:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9019 00000100:00100000:0.0:1746140890.173547:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960573904768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140890.173558:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140890.173576:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 19 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173584:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 19 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173602:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3a6200/0x8156357b7fdbb412 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2065 expref: 19 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173616:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.173639:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9020 00000100:00100000:2.0:1746140890.173647:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573905024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140890.173647:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1982:x1830960573904768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.173653:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9019 00010000:00010000:2.0:1746140890.173655:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140890.173667:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9021 00000100:00100000:0.0:1746140890.173671:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573905152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140890.173677:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140890.173683:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 37 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173690:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 37 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173699:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140890.173710:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573905152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 39us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.173714:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9021 00000100:00100000:0.0:1746140890.173721:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9022 00000100:00100000:0.0:1746140890.173725:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960573904896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140890.173729:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140890.173733:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 12 pid: 4785 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173739:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 12 pid: 4785 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173746:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.173748:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 26 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173748:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.173751:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.173757:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.173758:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 26 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:0.0:1746140890.173768:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140890.173775:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140890.173777:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+12:1982:x1830960573904896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.173781:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9022 00000100:00100000:2.0:1746140890.173792:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573905024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 147us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.173798:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9020 00010000:00010000:0.0:1746140890.173803:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6000/0x8156357b7fdbb40b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a205e expref: 26 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.173811:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576124288:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.173819:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576124416:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.173821:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f72a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576123904:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.173825:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576124544:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.173835:0:4186:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.173839:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.173940:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e308800/0x8156357b7fdbb4d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20dc expref: 11 pid: 4785 timeout: 969 lvb_type: 1 00000100:00100000:1.0:1746140890.173948:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576124032:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.173955:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb3c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2034 expref: 36 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:1.0:1746140890.173962:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576124160:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.173978:0:8460:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.173984:0:8460:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.173989:0:8460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.174030:0:8460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.174036:0:8460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.174046:0:8460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.174054:0:8460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e5b5400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140890.174057:0:8460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.174063:0:8460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.174072:0:8460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.174077:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e5b5400/0x8156357b7fdbb523 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.174111:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573904000:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 5944us (6152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.174122:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17400 00000100:00100000:3.0:1746140890.174206:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573904512 00000100:00100000:3.0:1746140890.174210:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573904512 00002000:00100000:3.0:1746140890.174236:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1740799) req@ffff880129e0ed80 x1830960573904512/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.174244:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0ed80 with x1830960573904512 ext(1048576->1740799) 00010000:00010000:3.0:1746140890.174249:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 30 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.174257:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 30 pid: 9872 timeout: 969 lvb_type: 0 00002000:00010000:3.0:1746140890.174262:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e0ed80 00000100:00100000:3.0:1746140890.174274:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1854 00000100:00100000:3.0:1746140890.174278:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960573904512:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140890.175157:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.175283:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.175295:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.175331:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573905536 00000100:00100000:2.0:1746140890.175335:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573905536 00010000:00010000:2.0:1746140890.175351:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 11 pid: 8460 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.175365:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9023 00000100:00100000:2.0:1746140890.175369:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1982:x1830960573905536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.175375:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.175385:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 11 pid: 8460 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.175392:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 11 pid: 8460 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.175403:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308f2400/0x8156357b7fdbb4c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20d5 expref: 11 pid: 8460 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.175421:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.175437:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+10:1982:x1830960573905536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.175442:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9023 00000100:00100000:0.0:1746140890.175572:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.175605:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573904640 00000100:00100000:1.0:1746140890.175608:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573904640 00002000:00100000:1.0:1746140890.175625:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1142784->1892351) req@ffff880135b64700 x1830960573904640/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.175632:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64700 with x1830960573904640 ext(1142784->1892351) 00010000:00010000:1.0:1746140890.175637:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 18 pid: 32376 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.175645:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 18 pid: 32376 timeout: 969 lvb_type: 0 00002000:00010000:1.0:1746140890.175650:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b64700 00000100:00100000:1.0:1746140890.175658:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573905280 00000100:00100000:1.0:1746140890.175660:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573905280 00002000:00100000:1.0:1746140890.175667:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1839104->2097151) req@ffff880135b65180 x1830960573905280/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.175673:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b65180 with x1830960573905280 ext(1839104->2097151) 00010000:00010000:1.0:1746140890.175676:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 36 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.175682:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 36 pid: 9872 timeout: 969 lvb_type: 0 00002000:00010000:1.0:1746140890.175686:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b65180 00000100:00100000:1.0:1746140890.175693:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1855 00000100:00100000:1.0:1746140890.175696:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1985:x1830960573904640:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140890.176129:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573905408 00000100:00100000:2.0:1746140890.176132:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573905408 00000100:00100000:2.0:1746140890.176145:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1856 00000100:00100000:2.0:1746140890.176150:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573905280:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:2.0:1746140890.176409:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 32 pid: 9872 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.176582:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9024 00000100:00100000:2.0:1746140890.176588:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1985:x1830960573905408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.176597:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.176606:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 32 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.176614:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 32 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.176628:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb3be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a202d expref: 32 pid: 9872 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.176638:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.176640:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.176644:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.176651:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.176681:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.176709:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573905408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.176715:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9024 00010000:00010000:0.0:1746140890.176779:0:4784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.176787:0:4784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.176804:0:4784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.176811:0:4784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.176817:0:4784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.176823:0:4784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f7c200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140890.176826:0:4784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.176832:0:4784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.176848:0:4784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.176853:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f7c200/0x8156357b7fdbb531 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140890.176907:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573903872:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 8630us (8761us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.176914:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17403 00000100:00100000:3.0:1746140890.183931:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960573904512:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9639us (10545us total) trans 21474841512 rc 0/0 00000100:00100000:3.0:1746140890.183944:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1854 00002000:00100000:3.0:1746140890.183955:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1740799) req@ffff880129e0ed80 x1830960573904512/t21474841512(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.183964:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0ed80 with x1830960573904512 ext(1048576->1740799) 00010000:00010000:3.0:1746140890.183973:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 31 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.183990:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 31 pid: 9872 timeout: 969 lvb_type: 0 00002000:00010000:3.0:1746140890.183997:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e0ed80 00000100:00100000:0.0:1746140890.185262:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.185762:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573905792 00000100:00100000:3.0:1746140890.185771:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573905792 00000100:00100000:3.0:1746140890.185833:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10844 00000100:00100000:3.0:1746140890.185839:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:407:x1830960573905792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.185855:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.185877:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20f8 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.185967:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.185979:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.185988:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186010:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186016:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186022:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000100:00100000:2.0:1746140890.186067:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573905280:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9915us (10768us total) trans 17179874217 rc 0/0 00000100:00100000:2.0:1746140890.186075:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1856 00002000:00100000:2.0:1746140890.186083:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1839104->2097151) req@ffff880135b65180 x1830960573905280/t17179874217(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.186091:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b65180 with x1830960573905280 ext(1839104->2097151) 00010000:00010000:2.0:1746140890.186097:0:32428:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 38 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.186107:0:32428:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 38 pid: 9872 timeout: 969 lvb_type: 0 00002000:00010000:2.0:1746140890.186113:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b65180 00010000:00010000:3.0:1746140890.186126:0:14742:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186133:0:14742:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186138:0:14742:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 00000004:00200000:3.0:1746140890.186147:0:14742:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140890.186203:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186210:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186215:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186220:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.186224:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186229:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186238:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.186241:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140890.186244:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186248:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb54d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186274:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186279:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186283:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186287:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.186289:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186293:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186298:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140890.186300:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.186301:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186324:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb53f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186332:0:14742:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186336:0:14742:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186340:0:14742:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186344:0:14742:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50faa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.186347:0:14742:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186352:0:14742:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186357:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388100) 00010000:00010000:3.0:1746140890.186359:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.186361:0:14742:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:3.0:1746140890.186365:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb546 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 00010000:00010000:2.0:1746140890.186435:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb538 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20f8 expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.186447:0:14742:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20f8 expref: 270 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.186455:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa000, rc 0) 00000100:00100000:2.0:1746140890.186487:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:407:x1830960573905792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 648us (1229us total) trans 8589945170 rc 301/301 00000100:00100000:2.0:1746140890.186492:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10844 00000100:00100000:2.0:1746140890.188853:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.188990:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.190084:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573905920 00000100:00100000:3.0:1746140890.190093:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573905920 00010000:00010000:3.0:1746140890.190123:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 31 pid: 9872 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.190153:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573906048 00000100:00100000:3.0:1746140890.190156:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573906048 00010000:00010000:3.0:1746140890.190167:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 38 pid: 9872 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.190178:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9025 00000100:00100000:1.0:1746140890.190189:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573905920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140890.190190:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9026 00000100:00100000:3.0:1746140890.190195:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573906048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.190201:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.190203:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.190219:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 38 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.190219:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 31 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.190232:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 38 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.190233:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 31 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.190251:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f822200/0x8156357b7fdbb489 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20a4 expref: 38 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.190251:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e42b200/0x8156357b7fdbb490 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ab expref: 31 pid: 9872 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.190263:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.190265:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.190266:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.190267:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.190269:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.190270:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.190276:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.190277:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.190293:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140890.190294:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.190340:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573905920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 154us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.190347:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9025 00000100:00100000:0.0:1746140890.190354:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140890.190356:0:4186:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.190363:0:4186:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.190378:0:4186:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.190385:0:4186:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.190392:0:4186:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.190397:0:4186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131c24a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140890.190401:0:4186:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.190401:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573904640:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 14703us (15118us total) trans 17179874218 rc 0/0 00010000:00010000:2.0:1746140890.190408:0:4186:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.190408:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1855 00002000:00100000:1.0:1746140890.190416:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1142784->1892351) req@ffff880135b64700 x1830960573904640/t17179874218(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746140890.190418:0:4186:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.190424:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c24a00/0x8156357b7fdbb52a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746140890.190425:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64700 with x1830960573904640 ext(1142784->1892351) 00000100:00100000:0.0:1746140890.190431:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140890.190432:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 20 pid: 32376 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.190443:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 20 pid: 32376 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.190446:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573906176 00002000:00010000:1.0:1746140890.190448:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b64700 00000100:00100000:0.0:1746140890.190449:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573906176 00000100:00100000:2.0:1746140890.190463:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573903616:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 22244us (22382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.190469:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573906432 00000100:00100000:2.0:1746140890.190470:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17402 00000100:00100000:0.0:1746140890.190471:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573906432 00000100:00100000:0.0:1746140890.190483:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10845 00000100:00100000:0.0:1746140890.190488:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:407:x1830960573906176:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140890.190498:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10846 00000100:00100000:1.0:1746140890.190504:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:410:x1830960573906432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140890.190509:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.190513:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.190522:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78a00/0x8156357b7fdbb55b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2106 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.190522:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f823400/0x8156357b7fdbb562 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a20ff expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.190553:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573906048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 357us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.190558:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9026 00010000:00010000:3.0:1746140890.190575:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.190581:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.190585:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140890.190593:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.190594:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140890.190598:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.190604:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.190605:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140890.190606:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.190609:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.190613:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140890.190613:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.190615:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.190620:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.190624:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.190628:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.190629:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.190634:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb515 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.190634:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:0.0:1746140890.190636:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140890.190639:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140890.190652:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140890.190667:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573903744:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 22609us (22730us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140890.190669:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f823400/0x8156357b7fdbb562 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.190674:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17399 00010000:00010000:0.0:1746140890.190680:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 270 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.190686:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140890.190689:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140890.190691:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1b3e00, rc 0) 00000100:00100000:0.0:1746140890.190714:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:407:x1830960573906176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 225us (360us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140890.190718:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140890.190719:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10845 00010000:00010000:1.0:1746140890.190725:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190730:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:1.0:1746140890.190736:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140890.190800:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190805:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190809:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190813:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e79000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140890.190816:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190821:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190828:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.190831:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140890.190833:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190837:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79000/0x8156357b7fdbb57e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190847:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190856:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190860:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190864:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e78c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140890.190866:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190871:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190877:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140890.190879:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140890.190881:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190886:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78c00/0x8156357b7fdbb570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190891:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190895:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190900:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190903:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e78e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140890.190905:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190913:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190919:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630ab00) 00010000:00010000:1.0:1746140890.190920:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140890.190922:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190926:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78e00/0x8156357b7fdbb577 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.190948:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78a00/0x8156357b7fdbb55b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2106 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.190955:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e78a00/0x8156357b7fdbb55b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2106 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.190962:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e78a00, rc 0) 00000100:00100000:1.0:1746140890.190990:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:410:x1830960573906432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 486us (559us total) trans 8589945171 rc 301/301 00000100:00100000:1.0:1746140890.190995:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10846 00000100:00100000:2.0:1746140890.194143:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.194183:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.194226:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.194301:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.194388:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573906816 00000100:00100000:1.0:1746140890.194397:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573906816 00000100:00100000:1.0:1746140890.194441:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10847 00000100:00100000:1.0:1746140890.194448:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:410:x1830960573906816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.194470:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.194486:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79400/0x8156357b7fdbb58c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2114 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.194513:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573906688 00000100:00100000:3.0:1746140890.194518:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573906688 00000100:00100000:3.0:1746140890.194539:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573906944 00000100:00100000:3.0:1746140890.194541:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573906944 00000100:00100000:3.0:1746140890.194561:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17404 00000100:00100000:3.0:1746140890.194567:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960573906688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.194576:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140890.194580:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17405 00000100:00100000:0.0:1746140890.194588:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573906944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.194589:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a210d expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.194596:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.194606:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb59a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a211b expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140890.194611:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813feda, atime: 0x6813feda, ctime: 0x6813feda, blocks: 0x81f 00010000:00010000:3.0:1746140890.194622:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.194625:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.194632:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 31 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.194646:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 31 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140890.194648:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576124672:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140890.194656:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbe00, rc 0) 00000100:00100000:2.0:1746140890.194671:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573906560 00000100:00100000:2.0:1746140890.194675:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573906560 00000100:00100000:3.0:1746140890.194698:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573906688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 132us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.194704:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17404 00010000:00010000:1.0:1746140890.194727:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140890.194750:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 20 pid: 32376 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.194769:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9027 00000100:00100000:2.0:1746140890.194775:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573906560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.194782:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140890.194787:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746140890.194807:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 20 pid: 32376 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.194818:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 20 pid: 32376 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.194838:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.194901:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:1.0:1746140890.195160:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140890.195165:0:14741:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140890.195183:0:14741:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.195212:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79400/0x8156357b7fdbb58c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.195227:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.195233:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.195236:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140890.195238:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79600, rc 0) 00000100:00100000:1.0:1746140890.195270:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:410:x1830960573906816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 822us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.195275:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10847 00010000:00010000:2.0:1746140890.195345:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.195347:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.195350:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.195358:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.195389:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.195415:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1984:x1830960573906560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 640us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.195421:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9027 00010000:00010000:0.0:1746140890.195705:0:8459:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.195714:0:8459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.195728:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140890.195732:0:8459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.195739:0:8459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.195746:0:8459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.195752:0:8459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140890.195756:0:8459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.195757:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140890.195763:0:8459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.195769:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573907072 00000100:00100000:2.0:1746140890.195772:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573907072 00010000:00010000:0.0:1746140890.195773:0:8459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.195778:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbb51c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.195797:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573907200 00000100:00100000:2.0:1746140890.195800:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573907200 00000100:00100000:2.0:1746140890.195814:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17406 00000100:00100000:0.0:1746140890.195814:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573903488:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 27637us (27907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.195820:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573907072:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140890.195821:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17401 00010000:00010000:2.0:1746140890.195827:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.195836:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2122 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140890.195853:0:4186:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813feda, atime: 0x6813feda, ctime: 0x6813feda, blocks: 0x81d 00010000:00010000:2.0:1746140890.195862:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.195863:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140890.195866:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17407 00010000:00010000:2.0:1746140890.195867:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 40 pid: 4186 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140890.195874:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960573907200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140890.195877:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 40 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.195881:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.195883:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c25c00, rc 0) 00010000:00010000:3.0:1746140890.195890:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2129 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.195899:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573907072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 80us (172us total) trans 0 rc 0/0 00002000:00010000:3.0:1746140890.195905:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813feda, atime: 0x6813feda, ctime: 0x6813feda, blocks: 0x81f 00000100:00100000:2.0:1746140890.195905:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17406 00010000:00010000:3.0:1746140890.195913:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.195915:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.195920:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 32 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140890.195932:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140890.195937:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 32 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140890.195942:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573907328 00010000:00010000:3.0:1746140890.195944:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fac00, rc 0) 00000100:00100000:2.0:1746140890.195945:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573907328 00000100:00100000:2.0:1746140890.195958:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17408 00000100:00100000:3.0:1746140890.195960:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573907200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 88us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.195963:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573907328:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140890.195966:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17407 00010000:00010000:2.0:1746140890.195969:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140890.196017:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.196036:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573907456 00000100:00100000:1.0:1746140890.196038:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573907456 00000100:00100000:1.0:1746140890.196055:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17409 00000100:00100000:1.0:1746140890.196059:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573907456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.196065:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.196073:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2137 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140890.196092:0:8460:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813feda, atime: 0x6813fed9, ctime: 0x6813feda, blocks: 0x102b 00010000:00010000:1.0:1746140890.196099:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.196101:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.196105:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 41 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.196114:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 41 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.196120:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79800, rc 0) 00000100:00100000:1.0:1746140890.196137:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573907456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.196142:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17409 00010000:00010000:2.0:1746140890.196192:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2130 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140890.196204:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813feda, atime: 0x6813feda, ctime: 0x6813feda, blocks: 0x1591 00010000:00010000:2.0:1746140890.196212:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.196213:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.196218:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 33 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.196231:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 33 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.196238:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3a6c00, rc 0) 00000100:00100000:2.0:1746140890.196252:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573907328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 289us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.196257:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17408 00010000:00010000:1.0:1746140890.196386:0:4784:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880135b64380 x1830960576124672) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 19 pid: 32376 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.196402:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c25a00/0x8156357b7fdbb482 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a209d expref: 19 pid: 32376 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.196411:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4784:1830960576124672:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140890.196429:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb59a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a211b expref: 40 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.196443:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb59a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a211b expref: 40 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.196452:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1b3c00, rc 0) 00000100:00100000:1.0:1746140890.196480:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573906944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1893us (2178us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140890.196486:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17405 00000100:00100000:0.0:1746140890.196625:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.196739:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573907584 00000100:00100000:1.0:1746140890.196743:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573907584 00000100:00100000:1.0:1746140890.196764:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17410 00000100:00100000:1.0:1746140890.196769:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1983:x1830960573907584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.196775:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.196780:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a213e expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.196791:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.196792:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.196795:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 26 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.196804:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 26 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.196811:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79a00, rc 0) 00000100:00100000:1.0:1746140890.196835:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1983:x1830960573907584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.196843:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17410 00000100:00100000:0.0:1746140890.198396:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.198430:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.198454:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.198466:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.198496:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.198513:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573907712 00000100:00100000:0.0:1746140890.198518:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573907712 00000100:00100000:0.0:1746140890.198544:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573907968 00000100:00100000:0.0:1746140890.198546:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573907968 00000100:00100000:0.0:1746140890.198555:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573908224 00000100:00100000:0.0:1746140890.198557:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573908224 00000100:00100000:3.0:1746140890.199070:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573907840 00000100:00100000:1.0:1746140890.199070:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573908096 00000100:00100000:3.0:1746140890.199075:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573907840 00000100:00100000:3.0:1746140890.199107:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17411 00000100:00100000:3.0:1746140890.199113:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573907712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.199130:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.199145:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2145 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140890.199155:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17412 00000100:00100000:0.0:1746140890.199161:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1983:x1830960573907968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140890.199168:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746140890.199169:0:4782:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813feda, atime: 0x6813fed9, ctime: 0x6813feda, blocks: 0x81f 00010000:00010000:0.0:1746140890.199177:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2153 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.199186:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.199188:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.199188:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.199189:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.199195:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.199195:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 27 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.199207:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 22 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.199207:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 27 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.199216:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f823c00, rc 0) 00010000:00010000:3.0:1746140890.199218:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa400, rc 0) 00000100:00100000:0.0:1746140890.199252:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573907968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 91us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.199256:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1983:x1830960573907712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 139us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.199257:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17412 00000100:00100000:3.0:1746140890.199262:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17411 00000100:00100000:0.0:1746140890.199273:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17413 00000100:00100000:3.0:1746140890.199277:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17414 00000100:00100000:0.0:1746140890.199277:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573908224:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140890.199282:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573907840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140890.199283:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.199288:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.199290:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2161 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.199295:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a214c expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.199302:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.199329:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.199330:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.199331:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.199335:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 23 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.199336:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 23 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.199344:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 23 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.199345:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 23 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.199350:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f823800, rc 0) 00010000:00010000:3.0:1746140890.199352:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbc00, rc 0) 00000100:00100000:0.0:1746140890.199367:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573908224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 89us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.199369:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573907840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 88us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.199372:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17413 00000100:00100000:3.0:1746140890.199376:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17414 00000100:00100000:0.0:1746140890.199457:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.199501:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.199516:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573908480 00000100:00100000:0.0:1746140890.199519:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573908480 00000100:00100000:0.0:1746140890.199550:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573908736 00000100:00100000:0.0:1746140890.199552:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573908736 00000100:00100000:0.0:1746140890.199568:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10848 00000100:00100000:0.0:1746140890.199572:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:403:x1830960573908480:12345-192.168.204.16@tcp:36:mirror_io.0 00000100:00100000:1.0:1746140890.199580:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573908096 00000100:00100000:1.0:1746140890.199605:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17415 00010000:00010000:0.0:1746140890.199606:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140890.199610:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573908096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.199617:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.199624:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a215a expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.199624:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a600/0x8156357b7fdbb507 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20f1 expref: 10 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.199635:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.199635:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.199637:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.199638:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140890.199641:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.199651:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.199657:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79c00, rc 0) 00010000:00010000:0.0:1746140890.199661:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140890.199671:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.199674:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573908096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (1177us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140890.199677:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.199679:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17415 00010000:00010000:0.0:1746140890.199683:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 269 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.199689:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.199694:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 7/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00000100:00100000:1.0:1746140890.199702:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10849 00000100:00100000:1.0:1746140890.199707:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:411:x1830960573908736:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140890.199713:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.199720:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.199722:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79200/0x8156357b7fdbb5f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2168 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.199732:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 11 pid: 14741 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.199748:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576124800:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.199803:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 269 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.199809:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.199810:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 269 pid: 27790 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.199817:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576124928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.199828:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.199838:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.199844:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 11 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.199851:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576125056:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.199867:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.199874:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.199879:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801354bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576125184:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.199895:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119780 going to sleep for 11 seconds 00010000:00010000:1.0:1746140890.199957:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.199970:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.199975:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.199980:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140890.201230:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.201278:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573908992 00000100:00100000:1.0:1746140890.201284:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573908992 00002000:00100000:1.0:1746140890.201339:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801354bc380 x1830960573908992/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.201349:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bc380 with x1830960573908992 ext(0->1048575) 00002000:00010000:1.0:1746140890.201354:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bc380 00000100:00100000:1.0:1746140890.201382:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8916 00000100:00100000:1.0:1746140890.201389:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573908992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.204443:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576124800:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.204549:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.204619:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573909248 00000100:00100000:3.0:1746140890.204626:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573909248 00010000:00010000:3.0:1746140890.204659:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 270 pid: 27790 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.204672:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.204728:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576124928:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.204735:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576125056:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.204740:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801354bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576125184:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.204772:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140890.204778:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573909120 00000100:00100000:3.0:1746140890.204781:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573909120 00010000:00010000:3.0:1746140890.204794:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 12 pid: 14741 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.204794:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9028 00000100:00100000:2.0:1746140890.204806:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1985:x1830960573909248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140890.204812:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9029 00000100:00100000:3.0:1746140890.204817:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960573909120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.204825:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.204827:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.204832:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 12 pid: 14741 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.204835:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 270 pid: 27790 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.204844:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 12 pid: 14741 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.204854:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 270 pid: 27790 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.204874:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79600/0x8156357b7fdbb5a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2114 expref: 12 pid: 14741 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.204885:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb569 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ff expref: 270 pid: 27790 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.204889:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.204892:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140890.204898:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140890.204910:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.204914:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140890.204924:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140890.204937:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960573909120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.204944:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9029 00000100:00100000:2.0:1746140890.204954:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960573909248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 153us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.204960:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9028 00000100:00100000:0.0:1746140890.205009:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.205085:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573909376 00000100:00100000:3.0:1746140890.205088:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573909376 00010000:00010000:3.0:1746140890.205100:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.205124:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9030 00000100:00100000:3.0:1746140890.205129:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960573909376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.205136:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.205139:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.205147:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.205163:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb474 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a208f expref: 269 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.205172:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.205175:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140890.205180:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140890.205210:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1985:x1830960573909376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.205215:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9030 00000100:00100000:0.0:1746140890.205791:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.205816:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.205835:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573909888 00000100:00100000:3.0:1746140890.205839:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573909888 00000100:00100000:2.0:1746140890.205852:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.205868:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573909632 00000100:00100000:3.0:1746140890.205871:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573909632 00000100:00100000:3.0:1746140890.205897:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10850 00000100:00100000:3.0:1746140890.205903:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:413:x1830960573909888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140890.205919:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.205932:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb60a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2176 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.206044:0:20524:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10851 00000100:00100000:1.0:1746140890.206055:0:20524:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+11:410:x1830960573909632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.206063:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.206066:0:20524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.206076:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.206081:0:20524:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a216f expref: -99 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.206083:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.206091:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.206096:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.206101:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.206117:0:20524:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140890.206124:0:20524:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 12 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.206141:0:20524:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140890.206152:0:20524:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 12 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.206163:0:20524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.206166:0:20524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140890.206168:0:20524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140890.206173:0:20524:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9ac000, rc 0) 00000100:00100000:1.0:1746140890.206199:0:20524:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+12:410:x1830960573909632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 148us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.206205:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573909504 00000100:00100000:1.0:1746140890.206205:0:20524:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10851 00000100:00100000:3.0:1746140890.206208:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573909504 00010000:00010000:3.0:1746140890.206270:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 12 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.206295:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9031 00000100:00100000:3.0:1746140890.206301:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960573909504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.206328:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.206332:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 12 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.206341:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 12 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.206352:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbb47b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2096 expref: 12 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.206363:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.206366:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140890.206372:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140890.206376:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140890.206382:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 11 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.206396:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140890.206485:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960573909504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 183us (670us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140890.206526:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140890.206532:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00000040:00080000:0.0:1746140890.207072:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3521, 88 off298520 00000004:00080000:0.0:1746140890.207078:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869282772217ns, next at 849271537162ns, rc = 0 00000100:00100000:3.0:1746140890.207127:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9031 00000040:00080000:0.0:1746140890.207129:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3539, 88 off300280 00000004:00080000:0.0:1746140890.207133:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869282827875ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.207145:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3540, 88 off300368 00000004:00080000:0.0:1746140890.207148:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869282843192ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.207155:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3522, 88 off298608 00000004:00080000:0.0:1746140890.207158:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869282852909ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.207163:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3523, 88 off298696 00000004:00080000:0.0:1746140890.207166:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869282860993ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.207172:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3541, 88 off300456 00000004:00080000:0.0:1746140890.207175:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869282870429ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.207181:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3542, 88 off300544 00000004:00080000:0.0:1746140890.207183:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869282878567ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.207189:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3543, 88 off300632 00000004:00080000:0.0:1746140890.207191:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869282886304ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.207254:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3524, 88 off298784 00000004:00080000:2.0:1746140890.207260:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869282955402ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.207284:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3544, 88 off300720 00000004:00080000:2.0:1746140890.207287:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869282982625ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.207319:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3525, 88 off298872 00000004:00080000:2.0:1746140890.207322:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869283017077ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.207328:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3545, 88 off300808 00000004:00080000:2.0:1746140890.207330:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869283025522ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140890.207336:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3526, 88 off298960 00000004:00080000:2.0:1746140890.207339:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869283034213ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.207346:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3527, 88 off299048 00000004:00080000:2.0:1746140890.207348:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869283043410ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.207354:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3528, 88 off299136 00000004:00080000:2.0:1746140890.207356:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869283051394ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.207362:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3529, 88 off299224 00000004:00080000:2.0:1746140890.207366:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869283061213ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140890.207375:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3546, 88 off300896 00000004:00080000:2.0:1746140890.207378:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869283073543ns, next at 809142599738ns, rc = 0 00000100:00100000:2.0:1746140890.209122:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573908992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7727us (7889us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.209227:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8916 00002000:00100000:2.0:1746140890.209242:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801354bc380 x1830960573908992/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.209252:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801354bc380 with x1830960573908992 ext(0->1048575) 00002000:00010000:2.0:1746140890.209258:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801354bc380 00000100:00100000:1.0:1746140890.214899:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.214928:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573910016 00000100:00100000:2.0:1746140890.214938:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573910016 00000100:00100000:2.0:1746140890.214982:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17416 00000100:00100000:2.0:1746140890.214991:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:407:x1830960573910016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140890.215017:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.215035:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a217d expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.215061:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.215063:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.215071:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 40 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.215086:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 40 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.215096:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79600, rc 0) 00000100:00100000:2.0:1746140890.215143:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:407:x1830960573910016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 153us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.215149:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17416 00000100:00100000:0.0:1746140890.216878:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.216907:0:14742:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573910144 00000100:00100000:0.0:1746140890.216914:0:14742:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573910144 00000100:00100000:0.0:1746140890.216953:0:14742:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10852 00000100:00100000:0.0:1746140890.216960:0:14742:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:407:x1830960573910144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140890.216973:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.217119:0:14742:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a400/0x8156357b7fdbb62d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2184 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.217181:0:14742:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a400/0x8156357b7fdbb62d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2184 expref: 271 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.217192:0:14742:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a400/0x8156357b7fdbb62d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2184 expref: 271 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.217287:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140890.217290:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140890.217294:0:14742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 10 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.217299:0:14742:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e42a400, rc 0) 00000100:00100000:0.0:1746140890.217353:0:14742:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:407:x1830960573910144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 394us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.217360:0:14742:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10852 00000004:00010000:2.0:1746140890.225926:0:27790:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f519180 reply state ffff880136136400 transno 8589945172 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140890.225941:0:27790:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746140890.226050:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:403:x1830960573908480:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 26473us (26588us total) trans 8589945172 rc 0/0 00000100:00100000:2.0:1746140890.226058:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10848 00010000:00010000:3.0:1746140890.226127:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00000001:00080000:1.0:1746140890.226129:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945172 is committed 00000004:00080000:1.0:1746140890.226134:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2788 committed 00010000:00010000:3.0:1746140890.226140:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746140890.226142:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2774 committed 00010000:00010000:3.0:1746140890.226147:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000004:00080000:1.0:1746140890.226147:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2773 committed 00000004:00080000:1.0:1746140890.226150:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2772 committed 00000004:00080000:1.0:1746140890.226151:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2771 committed 00000004:00080000:1.0:1746140890.226153:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2787 committed 00000004:00080000:1.0:1746140890.226154:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2770 committed 00000004:00080000:1.0:1746140890.226155:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2786 committed 00000004:00080000:1.0:1746140890.226156:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2769 committed 00000004:00080000:1.0:1746140890.226158:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2785 committed 00000004:00080000:1.0:1746140890.226159:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2784 committed 00000004:00080000:1.0:1746140890.226160:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2783 committed 00000004:00080000:1.0:1746140890.226162:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2768 committed 00000004:00080000:1.0:1746140890.226163:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2767 committed 00000004:00080000:1.0:1746140890.226164:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2782 committed 00000004:00080000:1.0:1746140890.226166:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2781 committed 00000004:00080000:1.0:1746140890.226167:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2766 committed 00000001:00080000:1.0:1746140890.226173:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945171 is committed 00010000:00010000:3.0:1746140890.226175:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 9 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.226185:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 7 pid: 14742 timeout: 969 lvb_type: 0 00000001:00080000:1.0:1746140890.226191:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945167 is committed 00000100:00100000:3.0:1746140890.226196:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576125312:192.168.204.16@tcp:104: 00000001:00080000:1.0:1746140890.226198:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945170 is committed 00000100:00100000:3.0:1746140890.226234:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3faf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.226248:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576125568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.226283:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.226319:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576126080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.226335:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.226349:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576126592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.226363:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.226375:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1746140890.226378:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576127104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.226388:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576127232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.226389:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.226398:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576125696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.226405:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.226415:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576125568 00000100:00100000:3.0:1746140890.226421:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576125568 00000100:00100000:1.0:1746140890.226431:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576126080 00000100:00100000:1.0:1746140890.226433:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576126080 00000100:00100000:3.0:1746140890.226446:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576126592 00000100:00100000:3.0:1746140890.226448:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576126592 00010000:00010000:0.0:1746140890.226477:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.226484:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.226491:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140890.226587:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576125440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.226605:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746140890.226641:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140890.226647:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140890.226657:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140890.226663:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ac9a4200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140890.226666:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140890.226676:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140890.226694:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.226696:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140890.226700:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 8 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.226710:0:3297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 8 pid: 20524 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.226716:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576127104 00000100:00100000:1.0:1746140890.226719:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576127104 00010000:00010000:2.0:1746140890.226720:0:3297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 8 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.226732:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a400/0x8156357b7fdbb62d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2184 expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.226736:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576127232 00000100:00100000:1.0:1746140890.226737:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576127232 00010000:00010000:2.0:1746140890.226738:0:3297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a400/0x8156357b7fdbb62d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2184 expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.226744:0:3297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a400/0x8156357b7fdbb62d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2184 expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.226747:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576125440 00000100:00100000:1.0:1746140890.226749:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576125440 00000100:00100000:0.0:1746140890.226758:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576125952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.226759:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17417 00010000:00010000:2.0:1746140890.226764:0:3297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a400/0x8156357b7fdbb62d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2184 expref: 268 pid: 14742 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.226765:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+63:3310:x1830960576125568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.226772:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09b800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3297:1830960576127488:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140890.226808:0:3297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 8 pid: 20524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140890.226808:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.226815:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3297:1830960576127616:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140890.226825:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576126464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.226832:0:3297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.226842:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576125824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.226842:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.226856:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576126976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.226861:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.226872:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576126336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.226873:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.226885:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.226893:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093133100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576126848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.226904:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.226911:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576127360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.226911:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576125952 00002000:00010000:1.0:1746140890.226917:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746140890.226917:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576125952 00002000:00010000:1.0:1746140890.226920:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00000100:00100000:2.0:1746140890.226922:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746140890.226923:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:1.0:1746140890.226925:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:1.0:1746140890.226927:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746140890.226943:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576126464 00000100:00100000:1.0:1746140890.226944:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+65:3310:x1830960576125568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (661us total) trans 17179874219 rc 0/0 00000100:00100000:0.0:1746140890.226944:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576125824 00000100:00100000:2.0:1746140890.226946:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576126464 00000100:00100000:0.0:1746140890.226946:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576125824 00000100:00100000:1.0:1746140890.226950:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17417 00000100:00100000:0.0:1746140890.226955:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576126976 00000100:00100000:0.0:1746140890.226956:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576126976 00000100:00100000:2.0:1746140890.226958:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576126336 00000100:00100000:1.0:1746140890.226958:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576126848 00000100:00100000:2.0:1746140890.226960:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576126336 00000100:00100000:1.0:1746140890.226960:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576126848 00000100:00100000:0.0:1746140890.226964:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576127360 00000100:00100000:0.0:1746140890.226966:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576127360 00000100:00100000:1.0:1746140890.226968:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17418 00000100:00100000:1.0:1746140890.226972:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3310:x1830960576126080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.227056:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3310:x1830960576126080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (719us total) trans 17179874220 rc 0/0 00000100:00100000:2.0:1746140890.227210:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17419 00000100:00100000:2.0:1746140890.227216:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3310:x1830960576127104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.227222:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17420 00000100:00100000:0.0:1746140890.227229:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3311:x1830960576127232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.227334:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3310:x1830960576127104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (942us total) trans 21474841513 rc 0/0 00000100:00100000:2.0:1746140890.227339:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17419 00000100:00100000:2.0:1746140890.227351:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17421 00000100:00100000:2.0:1746140890.227355:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3313:x1830960576125440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140890.227416:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140890.227419:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.227421:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:2.0:1746140890.227422:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.227424:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746140890.227450:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3313:x1830960576125440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (844us total) trans 17179874221 rc 0/0 00000100:00100000:2.0:1746140890.227454:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17421 00000100:00100000:2.0:1746140890.227463:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17422 00000100:00100000:2.0:1746140890.227467:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3313:x1830960576125952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.227531:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3313:x1830960576125952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (724us total) trans 17179874222 rc 0/0 00000100:00100000:2.0:1746140890.227535:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17422 00000100:00100000:2.0:1746140890.227544:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17423 00000100:00100000:2.0:1746140890.227548:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3312:x1830960576125824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.227608:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3312:x1830960576125824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (746us total) trans 17179874223 rc 0/0 00000100:00100000:2.0:1746140890.227613:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17423 00000100:00100000:2.0:1746140890.227620:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17424 00000100:00100000:2.0:1746140890.227624:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960576126464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.227671:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3311:x1830960576127232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 441us (1263us total) trans 21474841514 rc 0/0 00000100:00100000:0.0:1746140890.227678:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17420 00002000:00010000:2.0:1746140890.227684:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140890.227686:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.227688:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.227690:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.227692:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140890.227693:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17425 00000100:00100000:0.0:1746140890.227698:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960576126976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.227708:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960576126464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (865us total) trans 21474841515 rc 0/0 00000100:00100000:2.0:1746140890.227712:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17424 00000100:00100000:2.0:1746140890.227722:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17426 00000100:00100000:2.0:1746140890.227726:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3312:x1830960576126336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.227789:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3312:x1830960576126336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (902us total) trans 17179874224 rc 0/0 00000100:00100000:2.0:1746140890.227794:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17426 00000100:00100000:2.0:1746140890.227803:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17427 00000100:00100000:2.0:1746140890.227807:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3312:x1830960576126848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.227872:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576126848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (967us total) trans 21474841517 rc 0/0 00000100:00100000:2.0:1746140890.227877:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17427 00000100:00100000:2.0:1746140890.227886:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17428 00000100:00100000:2.0:1746140890.227890:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3312:x1830960576127360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.227944:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576127360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (1020us total) trans 21474841518 rc 0/0 00000100:00100000:2.0:1746140890.227948:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17428 00000004:00080000:2.0:1746140890.227977:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6f100/2, rc 0, transno 17179874223 00000100:00100000:2.0:1746140890.227982:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576125824:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.227988:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092613800/2, rc 0, transno 17179874224 00000100:00100000:2.0:1746140890.227991:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576126336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.228010:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093133100/2, rc 0, transno 21474841517 00000100:00100000:2.0:1746140890.228017:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093133100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576126848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.228018:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3313:x1830960576126976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 319us (1143us total) trans 21474841516 rc 0/0 00000004:00080000:2.0:1746140890.228025:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093133b80/2, rc 0, transno 21474841518 00000100:00100000:0.0:1746140890.228026:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17425 00000100:00100000:2.0:1746140890.228027:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576127360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.228053:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746140890.228059:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576127744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.228076:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746140890.228095:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6d180/2, rc 0, transno 17179874221 00000100:00100000:2.0:1746140890.228097:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576125440:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.228103:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6ce00/2, rc 0, transno 17179874222 00000100:00100000:2.0:1746140890.228105:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576125952:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.228111:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092613480/2, rc 0, transno 21474841515 00000100:00100000:2.0:1746140890.228113:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576126464:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140890.228119:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093132a00/2, rc 0, transno 21474841516 00000100:00100000:2.0:1746140890.228121:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576126976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.228131:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576127744 00000100:00100000:2.0:1746140890.228133:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576127744 00000100:00100000:2.0:1746140890.228143:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17429 00000100:00100000:2.0:1746140890.228147:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576127744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.228212:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576127744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (136us total) trans 21474841519 rc 0/0 00000100:00100000:2.0:1746140890.228217:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17429 00000004:00080000:2.0:1746140890.228234:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d080380/2, rc 0, transno 21474841519 00000100:00100000:1.0:1746140890.228285:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17418 00000100:00100000:3.0:1746140890.228291:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17430 00000100:00100000:3.0:1746140890.228296:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3310:x1830960576126592:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140890.228331:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093132d80/2, rc 0, transno 21474841514 00000100:00100000:1.0:1746140890.228334:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576127232:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140890.228384:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140890.228387:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.228388:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.228390:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.228392:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746140890.228410:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3310:x1830960576126592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (2047us total) trans 21474841520 rc 0/0 00000100:00100000:3.0:1746140890.228415:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17430 00000100:00100000:3.0:1746140890.228498:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.228516:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576126208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.228533:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.228547:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576126720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.228553:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.228558:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746140890.228574:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092610e00/2, rc 0, transno 21474841520 00000100:00100000:3.0:1746140890.228577:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576126592:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140890.228584:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6d500/2, rc 0, transno 17179874220 00000100:00100000:3.0:1746140890.228586:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576126080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140890.228593:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6df80/2, rc 0, transno 17179874219 00000100:00100000:3.0:1746140890.228595:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576125568:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140890.228603:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093131880/2, rc 0, transno 21474841513 00000100:00100000:3.0:1746140890.228605:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576127104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.228616:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576125696 00000100:00100000:3.0:1746140890.228618:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576125696 00000100:00100000:3.0:1746140890.228630:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576126208 00000100:00100000:3.0:1746140890.228632:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576126208 00000100:00100000:0.0:1746140890.228647:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.228649:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576126720 00000100:00100000:3.0:1746140890.228651:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576126720 00000100:00100000:3.0:1746140890.228662:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17431 00000100:00100000:3.0:1746140890.228666:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3310:x1830960576125696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.228670:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17432 00000100:00100000:1.0:1746140890.228676:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+68:3310:x1830960576126208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.228684:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17433 00000100:00100000:0.0:1746140890.228690:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3310:x1830960576126720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140890.228732:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746140890.228734:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.228736:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:3.0:1746140890.228738:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.228739:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746140890.228749:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+70:3310:x1830960576126208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (214us total) trans 17179874225 rc 0/0 00000100:00100000:3.0:1746140890.228753:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3310:x1830960576125696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (255us total) trans 17179874226 rc 0/0 00000100:00100000:1.0:1746140890.228754:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17432 00000100:00100000:3.0:1746140890.228757:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17431 00000100:00100000:3.0:1746140890.228769:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573910400 00000100:00100000:3.0:1746140890.228772:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573910400 00002000:00010000:0.0:1746140890.228782:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:0.0:1746140890.228785:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00010000:00010000:3.0:1746140890.228786:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 8 pid: 14742 timeout: 969 lvb_type: 0 00002000:00010000:0.0:1746140890.228787:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.228789:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.228790:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5521 -> 5521 00000100:00100000:3.0:1746140890.228802:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9032 00000100:00100000:3.0:1746140890.228806:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573910400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140890.228813:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3310:x1830960576126720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (253us total) trans 21474841521 rc 0/0 00010000:00010000:3.0:1746140890.228814:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.228818:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 8 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.228819:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17433 00010000:00010000:3.0:1746140890.228827:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 8 pid: 14742 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.228852:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.228856:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.228869:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.228874:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.228883:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.228887:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.228890:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.228906:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140890.228921:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.228929:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:3.0:1746140890.228933:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960573910400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 125us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.228938:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9032 00000004:00080000:3.0:1746140890.228989:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6f800/2, rc 0, transno 17179874226 00000100:00100000:3.0:1746140890.228993:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576125696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140890.229012:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092610380/2, rc 0, transno 17179874225 00000100:00100000:3.0:1746140890.229014:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576126208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746140890.229022:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093130700/2, rc 0, transno 21474841521 00000100:00100000:3.0:1746140890.229025:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576126720:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746140890.229042:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42b400/0x8156357b7fdbb4f9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a20ea expref: 7 pid: 14742 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.229051:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576125312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.229062:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229068:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229073:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140890.229083:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140890.229109:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140890.229173:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229179:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.229184:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.229184:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.229191:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229196:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140890.229247:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576127744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.229263:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573910272 00000100:00100000:2.0:1746140890.229266:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573910272 00000100:00100000:2.0:1746140890.229287:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10853 00000100:00100000:2.0:1746140890.229291:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:403:x1830960573910272:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140890.229320:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.229329:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a218b expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.229346:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4922c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140890.229351:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140890.229359:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.229549:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09b800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3297:1830960576127488:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.229556:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3297:1830960576127616:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140890.229568:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140890.229573:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ac9a4200/0x8156357b7fdbb5ee lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140890.229616:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140890.229618:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 7 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.229631:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140890.229633:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140890.229636:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140890.229636:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140890.229638:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140890.229641:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e308800, rc 0) 00010000:00010000:0.0:1746140890.229641:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4922c00/0x8156357b7fdbb63b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229660:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140890.229662:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:403:x1830960573910272:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 370us (1111us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140890.229665:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140890.229668:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10853 00010000:00010000:0.0:1746140890.229669:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229672:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e79e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140890.229674:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229679:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229687:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140890.229689:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140890.229691:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229696:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79e00/0x8156357b7fdbb5fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229706:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229710:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229715:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229719:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b3800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140890.229721:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.229743:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.229747:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229753:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229761:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.229763:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140890.229766:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229771:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb634 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.229771:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140890.229777:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630a500) 00010000:00010000:0.0:1746140890.229780:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140890.229782:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.229786:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.229787:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140890.229791:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229796:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229800:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.229802:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229806:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229811:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140890.229813:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.229815:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229819:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb611 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229826:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.229829:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79200/0x8156357b7fdbb5f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2168 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.229830:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229834:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.229836:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79200/0x8156357b7fdbb5f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2168 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.229837:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fae00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.229840:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.229844:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79200, rc 0) 00010000:00010000:3.0:1746140890.229845:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229850:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630a500) 00010000:00010000:3.0:1746140890.229852:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.229854:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.229858:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb61f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:0.0:1746140890.229876:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:411:x1830960573908736:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 30168us (30373us total) trans 8589945174 rc 301/301 00000100:00100000:0.0:1746140890.229882:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10849 00010000:00010000:3.0:1746140890.229890:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb60a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2176 expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.229896:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbb60a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2176 expref: 269 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.229902:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa600, rc 0) 00000100:00100000:3.0:1746140890.229919:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:413:x1830960573909888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 24018us (24129us total) trans 8589945173 rc 301/301 00000100:00100000:3.0:1746140890.229925:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10850 00000100:00100000:1.0:1746140890.230046:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.230082:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.230138:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573910528 00000100:00100000:0.0:1746140890.230143:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573910528 00000100:00100000:3.0:1746140890.230159:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573910656 00000100:00100000:3.0:1746140890.230162:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573910656 00000100:00100000:0.0:1746140890.230171:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4779 00000100:00100000:0.0:1746140890.230176:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:407:x1830960573910528:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:3.0:1746140890.230183:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4780 00000100:00100000:3.0:1746140890.230188:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca7a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:410:x1830960573910656:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:3.0:1746140890.230416:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca7a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:410:x1830960573910656:12345-192.168.204.16@tcp:49:cat.0 Request processed in 228us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.230424:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:407:x1830960573910528:12345-192.168.204.16@tcp:49:cat.0 Request processed in 246us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.230425:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4780 00000100:00100000:0.0:1746140890.230432:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4779 00000100:00100000:0.0:1746140890.232819:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.232959:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573910912 00000100:00100000:2.0:1746140890.232968:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573910912 00000100:00100000:2.0:1746140890.233020:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4781 00000100:00100000:2.0:1746140890.233027:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:403:x1830960573910912:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140890.233238:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:403:x1830960573910912:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 211us (426us total) trans 8589945175 rc 0/0 00000100:00100000:2.0:1746140890.233245:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4781 00000100:00100000:0.0:1746140890.235592:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.235652:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573911168 00000100:00100000:2.0:1746140890.235660:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573911168 00000100:00100000:2.0:1746140890.235701:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4782 00000100:00100000:2.0:1746140890.235706:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:403:x1830960573911168:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140890.235871:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:403:x1830960573911168:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 165us (289us total) trans 8589945176 rc 0/0 00000100:00100000:2.0:1746140890.235876:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4782 00000100:00100000:1.0:1746140890.240705:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.241289:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573911424 00000100:00100000:2.0:1746140890.241298:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573911424 00002000:00100000:2.0:1746140890.241380:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880093130380 x1830960573911424/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.241390:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130380 with x1830960573911424 ext(1048576->2097151) 00002000:00010000:2.0:1746140890.241395:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130380 00000100:00100000:2.0:1746140890.241416:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8917 00000100:00100000:2.0:1746140890.241422:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573911424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.246723:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.246750:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.246775:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.246836:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573911680 00000100:00100000:2.0:1746140890.246845:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573911680 00000100:00100000:0.0:1746140890.246877:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140890.246882:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f51b800 x1830960573911680/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.246891:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51b800 with x1830960573911680 ext(0->1048575) 00002000:00010000:2.0:1746140890.246895:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51b800 00000100:00100000:3.0:1746140890.246958:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573911936 00000100:00100000:3.0:1746140890.246962:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573911936 00002000:00100000:3.0:1746140890.246978:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88008f07ad80 x1830960573911936/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.246985:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07ad80 with x1830960573911936 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.246988:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07ad80 00000100:00100000:1.0:1746140890.247012:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573912192 00000100:00100000:1.0:1746140890.247015:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573912192 00000100:00100000:2.0:1746140890.247022:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573912448 00000100:00100000:2.0:1746140890.247024:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573912448 00002000:00100000:1.0:1746140890.247031:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f079880 x1830960573912192/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.247033:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f07bb80 x1830960573912448/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.247037:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079880 with x1830960573912192 ext(1048576->2097151) 00002000:00100000:2.0:1746140890.247039:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07bb80 with x1830960573912448 ext(1048576->2097151) 00002000:00010000:1.0:1746140890.247040:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f079880 00002000:00010000:2.0:1746140890.247041:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f07bb80 00000100:00100000:1.0:1746140890.247062:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8918 00000100:00100000:3.0:1746140890.247069:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8919 00000100:00100000:1.0:1746140890.247072:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573911680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140890.247073:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573911936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.247607:0:32428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8920 00000100:00100000:2.0:1746140890.247613:0:32428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573912192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.247617:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8921 00000100:00100000:0.0:1746140890.247625:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573912448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.252687:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573911424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11258us (11982us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.252695:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8917 00002000:00100000:2.0:1746140890.252703:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880093130380 x1830960573911424/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.252709:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130380 with x1830960573911424 ext(1048576->2097151) 00002000:00010000:2.0:1746140890.252713:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130380 00000100:00100000:1.0:1746140890.261928:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573911680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14848us (15202us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140890.261939:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8918 00002000:00100000:1.0:1746140890.261951:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009f51b800 x1830960573911680/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.261959:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f51b800 with x1830960573911680 ext(0->1048575) 00002000:00010000:1.0:1746140890.261965:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f51b800 00000100:00100000:3.0:1746140890.263448:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573911936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16369us (16692us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.263456:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8919 00002000:00100000:3.0:1746140890.263462:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88008f07ad80 x1830960573911936/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.263469:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07ad80 with x1830960573911936 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.263474:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07ad80 00000100:00100000:0.0:1746140890.265911:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.265962:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573912704 00000100:00100000:3.0:1746140890.265970:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573912704 00002000:00100000:3.0:1746140890.266017:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f07a680 x1830960573912704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.266203:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07a680 with x1830960573912704 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.266208:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07a680 00000100:00100000:3.0:1746140890.266240:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8922 00000100:00100000:3.0:1746140890.266247:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573912704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140890.267470:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573912448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19842us (20588us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140890.267478:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8921 00002000:00100000:1.0:1746140890.267486:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f07bb80 x1830960573912448/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.267498:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07bb80 with x1830960573912448 ext(1048576->2097151) 00002000:00010000:1.0:1746140890.267502:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f07bb80 00000100:00100000:2.0:1746140890.270094:0:32428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573912192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22474us (23311us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.270103:0:32428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8920 00002000:00100000:2.0:1746140890.270114:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f079880 x1830960573912192/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.270129:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079880 with x1830960573912192 ext(1048576->2097151) 00002000:00010000:2.0:1746140890.270133:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f079880 00000100:00100000:3.0:1746140890.275469:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573912704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9213us (9555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.275478:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8922 00002000:00100000:3.0:1746140890.275487:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008f07a680 x1830960573912704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.275493:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07a680 with x1830960573912704 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.275498:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07a680 00000100:00100000:0.0:1746140890.283365:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.283499:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573912960 00000100:00100000:3.0:1746140890.283508:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573912960 00002000:00100000:3.0:1746140890.283549:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f079c00 x1830960573912960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.283559:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079c00 with x1830960573912960 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.283564:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f079c00 00000100:00100000:3.0:1746140890.283593:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8923 00000100:00100000:3.0:1746140890.283600:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1983:x1830960573912960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.290006:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.290040:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.290397:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.290537:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.290611:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573913216 00000100:00100000:2.0:1746140890.290612:0:32428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573913472 00000100:00100000:2.0:1746140890.290620:0:32428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573913472 00000100:00100000:1.0:1746140890.290620:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573913216 00002000:00100000:1.0:1746140890.290656:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88008f07b800 x1830960573913216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.290657:0:32428:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008f079500 x1830960573913472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.290665:0:32428:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079500 with x1830960573913472 ext(3145728->4194303) 00002000:00100000:1.0:1746140890.290665:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07b800 with x1830960573913216 ext(2097152->3145727) 00002000:00010000:2.0:1746140890.290671:0:32428:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f079500 00002000:00010000:1.0:1746140890.290671:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f07b800 00000100:00100000:1.0:1746140890.290787:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573913728 00000100:00100000:1.0:1746140890.290790:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573913728 00002000:00100000:1.0:1746140890.290803:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008f07b480 x1830960573913728/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.290810:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07b480 with x1830960573913728 ext(2097152->3145727) 00002000:00010000:1.0:1746140890.290814:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07b480 00000100:00100000:1.0:1746140890.290822:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573913856 00000100:00100000:1.0:1746140890.290823:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573913856 00002000:00100000:1.0:1746140890.290829:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f078380 x1830960573913856/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.290835:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f078380 with x1830960573913856 ext(3145728->4194303) 00002000:00010000:1.0:1746140890.290837:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f078380 00000100:00100000:1.0:1746140890.290846:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8924 00000100:00100000:1.0:1746140890.290852:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573913472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.291162:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8925 00000100:00100000:2.0:1746140890.291169:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573913216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.291492:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8926 00000100:00100000:0.0:1746140890.291499:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573913728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140890.291614:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8927 00000100:00100000:3.0:1746140890.291621:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960573913856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140890.293828:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1983:x1830960573912960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10216us (10459us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.293839:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8923 00002000:00100000:3.0:1746140890.293850:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008f079c00 x1830960573912960/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.293861:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079c00 with x1830960573912960 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.293867:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f079c00 00000100:00100000:3.0:1746140890.303258:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573913216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12081us (13259us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.303270:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8925 00002000:00100000:3.0:1746140890.303283:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88008f07b800 x1830960573913216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.303293:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07b800 with x1830960573913216 ext(2097152->3145727) 00002000:00010000:3.0:1746140890.303298:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f07b800 00000100:00100000:3.0:1746140890.307838:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573913856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16209us (17291us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.307853:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8927 00002000:00100000:3.0:1746140890.307864:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f078380 x1830960573913856/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.307873:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f078380 with x1830960573913856 ext(3145728->4194303) 00002000:00010000:3.0:1746140890.307879:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f078380 00000100:00100000:1.0:1746140890.309671:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573913728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18162us (19263us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140890.309684:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8926 00002000:00100000:1.0:1746140890.309693:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008f07b480 x1830960573913728/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.309702:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f07b480 with x1830960573913728 ext(2097152->3145727) 00002000:00010000:1.0:1746140890.309706:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f07b480 00000100:00100000:1.0:1746140890.310322:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573913472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19451us (20262us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140890.310328:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8924 00002000:00100000:1.0:1746140890.310334:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008f079500 x1830960573913472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.310341:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079500 with x1830960573913472 ext(3145728->4194303) 00002000:00010000:1.0:1746140890.310345:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f079500 00000100:00100000:0.0:1746140890.315100:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.315498:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.315538:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.316124:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.316264:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573914496 00000100:00100000:2.0:1746140890.316265:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573914368 00000100:00100000:2.0:1746140890.316273:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573914368 00000100:00100000:1.0:1746140890.316273:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573914496 00000100:00100000:3.0:1746140890.316318:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573914752 00000100:00100000:3.0:1746140890.316322:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573914752 00002000:00100000:2.0:1746140890.316332:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880129e0df80 x1830960573914368/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140890.316333:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573914880 00000100:00100000:3.0:1746140890.316335:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573914880 00002000:00100000:2.0:1746140890.316342:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0df80 with x1830960573914368 ext(2097152->3145727) 00002000:00010000:2.0:1746140890.316348:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e0df80 00000100:00100000:2.0:1746140890.316368:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8928 00002000:00100000:1.0:1746140890.316374:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f079180 x1830960573914496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140890.316376:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1982:x1830960573914368:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746140890.316381:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079180 with x1830960573914496 ext(3145728->4194303) 00002000:00010000:1.0:1746140890.316384:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f079180 00000100:00100000:1.0:1746140890.316393:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8929 00000100:00100000:1.0:1746140890.316399:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1982:x1830960573914496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.317991:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746140890.318103:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880129e0fb80 x1830960573914880/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.318112:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0fb80 with x1830960573914880 ext(3145728->4194303) 00002000:00010000:3.0:1746140890.318117:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0fb80 00000100:00100000:3.0:1746140890.318139:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573915264 00000100:00100000:3.0:1746140890.318144:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573915264 00002000:00100000:3.0:1746140890.318161:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880129e0f100 x1830960573915264/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.318167:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0f100 with x1830960573915264 ext(4194304->4886527) 00002000:00010000:3.0:1746140890.318170:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0f100 00000100:00100000:3.0:1746140890.318182:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8930 00000100:00100000:3.0:1746140890.318188:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1982:x1830960573914880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.318574:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8931 00000100:00100000:2.0:1746140890.318916:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573915264:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140890.319464:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880129e0f800 x1830960573914752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.319473:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0f800 with x1830960573914752 ext(2097152->3145727) 00002000:00010000:3.0:1746140890.319477:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0f800 00000100:00100000:3.0:1746140890.319507:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8932 00000100:00100000:3.0:1746140890.319513:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1982:x1830960573914752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.326875:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1982:x1830960573914496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10463us (11774us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.326893:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8929 00002000:00100000:2.0:1746140890.326904:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f079180 x1830960573914496/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.326914:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f079180 with x1830960573914496 ext(3145728->4194303) 00002000:00010000:2.0:1746140890.326921:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f079180 00000100:00100000:2.0:1746140890.332241:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573914368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15854us (16730us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.332252:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8928 00002000:00100000:2.0:1746140890.332265:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880129e0df80 x1830960573914368/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.332274:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0df80 with x1830960573914368 ext(2097152->3145727) 00002000:00010000:2.0:1746140890.332280:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e0df80 00000100:00100000:3.0:1746140890.333928:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1982:x1830960573914880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15730us (17793us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.333940:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8930 00002000:00100000:3.0:1746140890.333950:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880129e0fb80 x1830960573914880/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.333959:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0fb80 with x1830960573914880 ext(3145728->4194303) 00002000:00010000:3.0:1746140890.333965:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0fb80 00000100:00100000:3.0:1746140890.337939:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573914752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18416us (22390us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.337950:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8932 00002000:00100000:3.0:1746140890.337960:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880129e0f800 x1830960573914752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.337970:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0f800 with x1830960573914752 ext(2097152->3145727) 00002000:00010000:3.0:1746140890.337975:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0f800 00000100:00100000:2.0:1746140890.338037:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573915264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19445us (20039us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140890.338048:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8931 00002000:00100000:2.0:1746140890.338060:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880129e0f100 x1830960573915264/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.338069:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0f100 with x1830960573915264 ext(4194304->4886527) 00002000:00010000:2.0:1746140890.338074:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0f100 00000100:00100000:0.0:1746140890.343391:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.343801:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573915520 00000100:00100000:3.0:1746140890.343815:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573915520 00000100:00100000:3.0:1746140890.344162:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4783 00000100:00100000:3.0:1746140890.344171:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+8:410:x1830960573915520:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746140890.344173:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.344392:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573915776 00000100:00100000:1.0:1746140890.344402:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573915776 00002000:00100000:1.0:1746140890.344451:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880129e0d880 x1830960573915776/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.344479:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0d880 with x1830960573915776 ext(4194304->4886527) 00002000:00010000:1.0:1746140890.344486:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0d880 00000100:00100000:1.0:1746140890.344514:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8933 00000100:00100000:1.0:1746140890.344524:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573915776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140890.344566:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:410:x1830960573915520:12345-192.168.204.16@tcp:35:cat.0 Request processed in 395us (1187us total) trans 8589945177 rc 0/0 00000100:00100000:3.0:1746140890.344574:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4783 00000100:00100000:1.0:1746140890.349048:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1982:x1830960573915776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4513us (4863us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140890.349061:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8933 00002000:00100000:1.0:1746140890.349073:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880129e0d880 x1830960573915776/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.349082:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e0d880 with x1830960573915776 ext(4194304->4886527) 00002000:00010000:1.0:1746140890.349088:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e0d880 00000100:00100000:0.0:1746140890.356443:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.356839:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573916032 00000100:00100000:3.0:1746140890.356850:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573916032 00000100:00100000:3.0:1746140890.356916:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4784 00000100:00100000:3.0:1746140890.356925:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:407:x1830960573916032:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140890.357163:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:407:x1830960573916032:12345-192.168.204.16@tcp:35:cat.0 Request processed in 239us (732us total) trans 8589945178 rc 0/0 00000100:00100000:3.0:1746140890.357170:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4784 00000100:00100000:1.0:1746140890.375754:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.375799:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573916288 00000100:00100000:1.0:1746140890.375808:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573916288 00000100:00100000:1.0:1746140890.375853:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10854 00000100:00100000:1.0:1746140890.375861:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:413:x1830960573916288:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140890.375881:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.375885:0:14743:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746140890.375910:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e42a400/0x8156357b7fdbb62d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2184 expref: 269 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.375944:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.375948:0:14743:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140890.375959:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbb657 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2192 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.376022:0:14743:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140890.376033:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 8 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.376185:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.376195:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 5/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140890.376233:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.376247:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 8 pid: 27790 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.376260:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576127872:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.376593:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 8 pid: 20524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.376601:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 8 pid: 20524 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.376750:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576128000:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.376791:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a45276c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.378371:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.378444:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573916544 00000100:00100000:0.0:1746140890.378447:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.378453:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573916544 00010000:00010000:3.0:1746140890.378490:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 9 pid: 20524 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.378499:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576127872:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.378509:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576128000:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.378517:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573916416 00000100:00100000:3.0:1746140890.378519:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573916416 00010000:00010000:1.0:1746140890.378530:0:14743:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140890.378531:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 9 pid: 27790 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.378551:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9033 00000100:00100000:3.0:1746140890.378557:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:411:x1830960573916544:12345-192.168.204.16@tcp:103:multiop.0 00010000:00010000:3.0:1746140890.378569:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140890.378569:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9034 00010000:00010000:3.0:1746140890.378575:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 9 pid: 20524 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.378578:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573916416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.378584:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 9 pid: 20524 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.378589:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.378596:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 9 pid: 27790 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.378602:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac000/0x8156357b7fdbb618 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a216f expref: 9 pid: 20524 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.378606:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 9 pid: 27790 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.378625:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e308800/0x8156357b7fdbb650 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a218b expref: 9 pid: 27790 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.378630:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.378634:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140890.378641:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:3.0:1746140890.378648:0:8473:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140890.378657:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.378661:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140890.378670:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.378690:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573916416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 115us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.378697:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9034 00000100:00100000:3.0:1746140890.378710:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:411:x1830960573916544:12345-192.168.204.16@tcp:103:multiop.0 Request processed in 153us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.378716:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9033 00010000:00010000:1.0:1746140890.378724:0:14743:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:1.0:1746140890.378729:0:14743:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00000040:00080000:1.0:1746140890.379413:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3530, 88 off299312 00000004:00080000:1.0:1746140890.379420:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455115063ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379475:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3547, 88 off300984 00000004:00080000:1.0:1746140890.379479:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869455174177ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140890.379501:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3548, 88 off301072 00000004:00080000:1.0:1746140890.379505:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869455199733ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140890.379512:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3531, 88 off299400 00000004:00080000:1.0:1746140890.379514:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455209662ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379520:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3532, 88 off299488 00000004:00080000:1.0:1746140890.379522:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455217339ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379531:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3549, 88 off301160 00000004:00080000:1.0:1746140890.379534:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869455229164ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140890.379603:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3550, 88 off301248 00000004:00080000:1.0:1746140890.379607:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869455302222ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140890.379618:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3551, 88 off301336 00000004:00080000:1.0:1746140890.379621:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869455316327ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140890.379629:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3533, 88 off299576 00000004:00080000:1.0:1746140890.379632:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455326813ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379653:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3552, 88 off301424 00000004:00080000:1.0:1746140890.379656:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869455351135ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140890.379664:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3534, 88 off299664 00000004:00080000:1.0:1746140890.379667:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455362057ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379673:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3553, 88 off301512 00000004:00080000:1.0:1746140890.379675:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869455370379ns, next at 809142599738ns, rc = 0 00000040:00080000:1.0:1746140890.379683:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3535, 88 off299752 00000004:00080000:1.0:1746140890.379685:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455380604ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379693:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3536, 88 off299840 00000004:00080000:1.0:1746140890.379695:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455390552ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379703:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3537, 88 off299928 00000004:00080000:1.0:1746140890.379705:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455400462ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379718:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3538, 88 off300016 00000004:00080000:1.0:1746140890.379720:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869455415457ns, next at 849271537162ns, rc = 0 00000040:00080000:1.0:1746140890.379728:0:14743:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3554, 88 off301600 00000004:00080000:1.0:1746140890.379730:0:14743:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869455425313ns, next at 809142599738ns, rc = 0 00000100:00100000:2.0:1746140890.381534:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.381562:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573916800 00000100:00100000:2.0:1746140890.381569:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573916800 00000100:00100000:2.0:1746140890.381604:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10855 00000100:00100000:2.0:1746140890.381611:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:411:x1830960573916800:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.381631:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.381647:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d600/0x8156357b7fdbb665 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2199 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.381690:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.381700:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140890.381705:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.381719:0:14785:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14743 initiator: MDT0 00010000:00010000:2.0:1746140890.381728:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000001:00080000:1.0:1746140890.396145:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945174 is committed 00000001:00080000:1.0:1746140890.396160:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945179 is committed 00000004:00080000:1.0:1746140890.396163:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2796 committed 00000004:00080000:1.0:1746140890.396243:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2783 committed 00000004:00080000:1.0:1746140890.396255:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2782 committed 00000004:00080000:1.0:1746140890.396257:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2781 committed 00000004:00080000:1.0:1746140890.396259:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2780 committed 00000004:00080000:1.0:1746140890.396261:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2795 committed 00000004:00080000:1.0:1746140890.396262:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2779 committed 00000004:00080000:1.0:1746140890.396264:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2794 committed 00000004:00080000:1.0:1746140890.396265:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2778 committed 00000004:00080000:1.0:1746140890.396267:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2793 committed 00000004:00080000:1.0:1746140890.396269:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2792 committed 00000004:00080000:1.0:1746140890.396283:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2791 committed 00000004:00080000:1.0:1746140890.396285:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2777 committed 00000004:00080000:1.0:1746140890.396287:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2776 committed 00000004:00080000:1.0:1746140890.396289:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2790 committed 00000004:00080000:1.0:1746140890.396290:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2789 committed 00000004:00080000:1.0:1746140890.396292:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2775 committed 00000001:00080000:1.0:1746140890.396298:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945176 is committed 00000001:00080000:1.0:1746140890.396327:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945177 is committed 00000100:00100000:1.0:1746140890.396340:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746140890.396361:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576128256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.396421:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140890.396445:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576128128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.396583:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576128640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.396607:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.396619:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576129152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.396631:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.396642:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746140890.396646:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576128768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.396656:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.396665:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576129280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.396676:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.396684:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576128256 00000100:00100000:0.0:1746140890.396692:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576128256 00000100:00100000:3.0:1746140890.396697:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576128640 00000100:00100000:3.0:1746140890.396702:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576128640 00000100:00100000:0.0:1746140890.396727:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576129152 00000100:00100000:0.0:1746140890.396729:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576129152 00000100:00100000:3.0:1746140890.396731:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576128768 00000100:00100000:3.0:1746140890.396733:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576128768 00000100:00100000:0.0:1746140890.396741:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576129280 00000100:00100000:0.0:1746140890.396743:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576129280 00000100:00100000:3.0:1746140890.396750:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17434 00000100:00100000:3.0:1746140890.396757:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+71:3311:x1830960576128256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.396762:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17435 00000100:00100000:0.0:1746140890.396769:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+71:3310:x1830960576128640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.396828:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17436 00000100:00100000:3.0:1746140890.396833:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+78:3310:x1830960576129152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140890.396985:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746140890.396988:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.396991:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.396992:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.397009:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140890.397022:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+72:3310:x1830960576128640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (413us total) trans 17179874227 rc 0/0 00000100:00100000:0.0:1746140890.397029:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17435 00000100:00100000:3.0:1746140890.397033:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+79:3310:x1830960576129152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (401us total) trans 21474841522 rc 0/0 00000100:00100000:3.0:1746140890.397039:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17436 00000100:00100000:0.0:1746140890.397050:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17437 00000100:00100000:0.0:1746140890.397057:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+71:3310:x1830960576128768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.397058:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17438 00000100:00100000:3.0:1746140890.397062:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+78:3310:x1830960576129280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140890.397127:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140890.397130:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.397132:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.397134:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.397135:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140890.397138:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+72:3310:x1830960576128768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (479us total) trans 17179874228 rc 0/0 00000100:00100000:0.0:1746140890.397144:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17437 00000100:00100000:3.0:1746140890.397152:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+79:3310:x1830960576129280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (475us total) trans 21474841523 rc 0/0 00000100:00100000:3.0:1746140890.397156:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17438 00002000:00010000:0.0:1746140890.397234:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140890.397237:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.397239:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.397241:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.397243:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746140890.397264:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3311:x1830960576128256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 507us (843us total) trans 17179874229 rc 0/0 00000100:00100000:0.0:1746140890.397269:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17434 00000100:00100000:0.0:1746140890.397290:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576129664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.397292:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576128384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.397392:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.397396:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.397407:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576128896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.397428:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140890.397432:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e0000/2, rc 0, transno 17179874228 00000100:00100000:0.0:1746140890.397437:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576128768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.397438:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576129408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.397449:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea8700/2, rc 0, transno 21474841523 00000100:00100000:2.0:1746140890.397451:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.397458:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576129280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.397461:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576129920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.397465:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e3100/2, rc 0, transno 17179874227 00000100:00100000:0.0:1746140890.397468:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576128640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.397472:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140890.397477:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eeaad80/2, rc 0, transno 21474841522 00000100:00100000:0.0:1746140890.397480:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576129152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.397483:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746140890.397488:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576128512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.397489:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746140890.397494:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576129792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.397500:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.397512:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576129024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.397513:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.397526:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.397536:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576129536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.397536:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576128384 00000100:00100000:0.0:1746140890.397539:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576128384 00000100:00100000:2.0:1746140890.397547:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.397555:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576129664 00000100:00100000:0.0:1746140890.397557:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576129664 00000100:00100000:2.0:1746140890.397559:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576130048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.397565:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576128896 00000100:00100000:0.0:1746140890.397567:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576128896 00000100:00100000:2.0:1746140890.397569:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.397574:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576129408 00000100:00100000:0.0:1746140890.397575:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576129408 00000100:00100000:0.0:1746140890.397581:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576129920 00000100:00100000:0.0:1746140890.397582:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576129920 00000100:00100000:2.0:1746140890.397589:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576128512 00000100:00100000:0.0:1746140890.397590:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576129792 00000100:00100000:0.0:1746140890.397592:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576129792 00000100:00100000:2.0:1746140890.397593:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576128512 00000100:00100000:0.0:1746140890.397598:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17439 00000100:00100000:0.0:1746140890.397603:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+74:3312:x1830960576128384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.397605:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576129024 00000100:00100000:2.0:1746140890.397606:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576129024 00000100:00100000:2.0:1746140890.397613:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576129536 00000100:00100000:2.0:1746140890.397614:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576129536 00000100:00100000:2.0:1746140890.397620:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576130048 00000100:00100000:2.0:1746140890.397621:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576130048 00000100:00100000:2.0:1746140890.397629:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17440 00000100:00100000:2.0:1746140890.397634:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3310:x1830960576129664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140890.397669:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140890.397671:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.397672:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:0.0:1746140890.397673:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.397674:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746140890.397693:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576128384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (302us total) trans 17179874230 rc 0/0 00000100:00100000:0.0:1746140890.397697:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17439 00000100:00100000:0.0:1746140890.397705:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17441 00000100:00100000:0.0:1746140890.397708:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3312:x1830960576128896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.397716:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3310:x1830960576129664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (325us total) trans 21474841524 rc 0/0 00000100:00100000:2.0:1746140890.397721:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17440 00000100:00100000:0.0:1746140890.397767:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576128896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (337us total) trans 17179874231 rc 0/0 00000100:00100000:0.0:1746140890.397773:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17441 00000100:00100000:0.0:1746140890.397782:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17442 00000100:00100000:0.0:1746140890.397786:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+84:3312:x1830960576129408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.397823:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17443 00000100:00100000:2.0:1746140890.397827:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3312:x1830960576129920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140890.397871:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:0.0:1746140890.397873:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.397875:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.397877:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.397879:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5521 -> 5521 00000100:00100000:0.0:1746140890.397901:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+86:3312:x1830960576129408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (448us total) trans 21474841525 rc 0/0 00000100:00100000:2.0:1746140890.397906:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3312:x1830960576129920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (432us total) trans 21474841526 rc 0/0 00000100:00100000:0.0:1746140890.397907:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17442 00000100:00100000:2.0:1746140890.397911:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17443 00000100:00100000:0.0:1746140890.397918:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17444 00000100:00100000:2.0:1746140890.397923:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17445 00000100:00100000:0.0:1746140890.397924:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+84:3310:x1830960576129792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.397927:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3312:x1830960576128512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.397991:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:3310:x1830960576129792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (478us total) trans 21474841527 rc 0/0 00000100:00100000:0.0:1746140890.398009:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17444 00000100:00100000:0.0:1746140890.398018:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17446 00000100:00100000:2.0:1746140890.398022:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576128512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (521us total) trans 17179874232 rc 0/0 00000100:00100000:0.0:1746140890.398022:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576129024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.398028:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17445 00000100:00100000:2.0:1746140890.398038:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17447 00000100:00100000:2.0:1746140890.398042:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3312:x1830960576129536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.398083:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3312:x1830960576129024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (556us total) trans 17179874233 rc 0/0 00000100:00100000:0.0:1746140890.398088:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17446 00000100:00100000:0.0:1746140890.398100:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17448 00000100:00100000:0.0:1746140890.398104:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+84:3312:x1830960576130048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.398177:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960576130048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (606us total) trans 21474841528 rc 0/0 00000100:00100000:0.0:1746140890.398184:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17448 00000100:00100000:1.0:1746140890.398210:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.398228:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576128128 00000100:00100000:0.0:1746140890.398231:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576128128 00000100:00100000:0.0:1746140890.398246:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17449 00000004:00080000:1.0:1746140890.398247:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0c380/2, rc 0, transno 17179874229 00000100:00100000:0.0:1746140890.398250:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3311:x1830960576128128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.398252:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576128256:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746140890.398296:0:14743:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 268 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.398320:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.398323:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746140890.398326:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.398335:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 268 pid: 14743 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140890.398336:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140890.398339:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.398340:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00010000:00010000:1.0:1746140890.398341:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00002000:00010000:0.0:1746140890.398342:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.398343:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00010000:00010000:1.0:1746140890.398362:0:14743:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 268 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140890.398369:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3311:x1830960576128128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (158us total) trans 17179874234 rc 0/0 00010000:00010000:1.0:1746140890.398373:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 268 pid: 14743 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.398375:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17449 00000100:00100000:1.0:1746140890.398383:0:14743:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576130176:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.398426:0:14743:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4527cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1746140890.398440:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0c700/2, rc 0, transno 17179874234 00000100:00100000:1.0:1746140890.398443:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576128128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.398643:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3312:x1830960576129536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 600us (1095us total) trans 21474841529 rc 0/0 00000100:00100000:2.0:1746140890.398649:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17447 00000004:00080000:2.0:1746140890.398679:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e0e00/2, rc 0, transno 17179874232 00000100:00100000:2.0:1746140890.398682:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576128512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.398688:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e1c00/2, rc 0, transno 17179874233 00000100:00100000:2.0:1746140890.398691:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576129024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.398696:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea8380/2, rc 0, transno 21474841529 00000100:00100000:2.0:1746140890.398700:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576129536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140890.398707:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea8e00/2, rc 0, transno 21474841528 00000100:00100000:2.0:1746140890.398709:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576130048:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140890.398715:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e0ea00/2, rc 0, transno 17179874230 00000100:00100000:2.0:1746140890.398718:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576128384:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.398723:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e0380/2, rc 0, transno 17179874231 00000100:00100000:2.0:1746140890.398726:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576128896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.398732:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eeaa300/2, rc 0, transno 21474841525 00000100:00100000:2.0:1746140890.398734:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576129408:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140890.398739:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eeab480/2, rc 0, transno 21474841526 00000100:00100000:2.0:1746140890.398742:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576129920:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140890.398756:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eeaaa00/2, rc 0, transno 21474841527 00000100:00100000:2.0:1746140890.398759:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576129792:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140890.398764:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eea9f80/2, rc 0, transno 21474841524 00000100:00100000:2.0:1746140890.398766:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576129664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.398801:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576130304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.398827:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.398866:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576130304 00000100:00100000:3.0:1746140890.398870:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576130304 00000100:00100000:3.0:1746140890.398887:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17450 00000100:00100000:3.0:1746140890.398891:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3310:x1830960576130304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.398972:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3310:x1830960576130304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (145us total) trans 21474841530 rc 0/0 00000100:00100000:3.0:1746140890.398978:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17450 00000004:00080000:0.0:1746140890.398992:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c1880/2, rc 0, transno 21474841530 00000100:00100000:0.0:1746140890.399008:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576130304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.401156:0:14743:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14743:1830960576130176:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.401194:0:14743:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbb657 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 268 pid: 14743 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746140890.401212:0:14743:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 267 pid: 14743 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.401219:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 267 pid: 14743 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.401245:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d200, rc 0) 00000100:00100000:1.0:1746140890.401291:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:413:x1830960573916288:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 25431us (25549us total) trans 8589945179 rc 0/0 00000100:00100000:1.0:1746140890.401298:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10854 00000100:00100000:0.0:1746140890.402719:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.402862:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573916928 00000100:00100000:2.0:1746140890.402869:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573916928 00010000:00010000:2.0:1746140890.402894:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 267 pid: 14743 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.402957:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9035 00000100:00100000:2.0:1746140890.402963:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:1984:x1830960573916928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.402975:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.402979:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 267 pid: 14743 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.402988:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 267 pid: 14743 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.403014:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d200/0x8156357b7fdbb65e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2192 expref: 267 pid: 14743 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.403025:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.403029:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.403037:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.403044:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.403391:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.403430:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:1984:x1830960573916928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 467us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.403436:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9035 00010000:00010000:0.0:1746140890.403831:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.403842:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140890.403866:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.403935:0:14743:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573917056 00000100:00100000:1.0:1746140890.403940:0:14743:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573917056 00000100:00100000:1.0:1746140890.403961:0:14743:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10856 00000100:00100000:1.0:1746140890.403966:0:14743:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:413:x1830960573917056:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140890.403982:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.403993:0:14743:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21a0 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.404041:0:14743:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.404048:0:14743:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 267 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.404059:0:14743:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.404069:0:14743:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 267 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.404077:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.404080:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140890.404082:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 267 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.404088:0:14743:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d000, rc 0) 00000100:00100000:1.0:1746140890.404107:0:14743:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:413:x1830960573917056:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 142us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.404112:0:14743:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10856 00000040:00080000:0.0:1746140890.404473:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3539, 88 off300104 00000004:00080000:0.0:1746140890.404478:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480172999ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404523:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3555, 88 off301688 00000004:00080000:0.0:1746140890.404526:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869480221292ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.404536:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3556, 88 off301776 00000004:00080000:0.0:1746140890.404538:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869480233310ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.404544:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3540, 88 off300192 00000004:00080000:0.0:1746140890.404546:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480241814ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404553:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3541, 88 off300280 00000004:00080000:0.0:1746140890.404555:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480250310ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404561:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3557, 88 off301864 00000004:00080000:0.0:1746140890.404563:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869480258775ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.404569:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3558, 88 off301952 00000004:00080000:0.0:1746140890.404571:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869480266384ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.404576:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3559, 88 off302040 00000004:00080000:0.0:1746140890.404672:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869480366934ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.404688:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3542, 88 off300368 00000004:00080000:0.0:1746140890.404691:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480385999ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404706:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3560, 88 off302128 00000004:00080000:0.0:1746140890.404710:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869480404800ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.404716:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3543, 88 off300456 00000004:00080000:0.0:1746140890.404718:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480413757ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404725:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3561, 88 off302216 00000004:00080000:0.0:1746140890.404727:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869480422734ns, next at 809142599738ns, rc = 0 00000040:00080000:0.0:1746140890.404733:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3544, 88 off300544 00000004:00080000:0.0:1746140890.404736:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480430795ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404743:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3545, 88 off300632 00000004:00080000:0.0:1746140890.404745:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480440484ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404752:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3546, 88 off300720 00000004:00080000:0.0:1746140890.404755:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480449920ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404766:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3547, 88 off300808 00000004:00080000:0.0:1746140890.404768:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869480463837ns, next at 849271537162ns, rc = 0 00000040:00080000:0.0:1746140890.404776:0:14785:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3562, 88 off302304 00000004:00080000:0.0:1746140890.404779:0:14785:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869480473929ns, next at 809142599738ns, rc = 0 00010000:00010000:3.0:1746140890.426673:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.426687:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.426690:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746140890.426695:0:14785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 266 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.426704:0:14785:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 266 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.426711:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 266 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.426747:0:14785:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 266 pid: 14743 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.426759:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576130432:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140890.426839:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000001:00080000:1.0:1746140890.426925:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945180 is committed 00000004:00080000:1.0:1746140890.426934:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2804 committed 00000004:00080000:1.0:1746140890.427127:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2792 committed 00000004:00080000:1.0:1746140890.427133:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2791 committed 00000004:00080000:1.0:1746140890.427135:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2790 committed 00000004:00080000:1.0:1746140890.427136:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2789 committed 00000004:00080000:1.0:1746140890.427138:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2803 committed 00000004:00080000:1.0:1746140890.427140:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2788 committed 00000004:00080000:1.0:1746140890.427142:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2802 committed 00000004:00080000:1.0:1746140890.427143:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2787 committed 00000004:00080000:1.0:1746140890.427144:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2801 committed 00000004:00080000:1.0:1746140890.427146:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2800 committed 00000004:00080000:1.0:1746140890.427147:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2799 committed 00000004:00080000:1.0:1746140890.427149:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2786 committed 00000004:00080000:1.0:1746140890.427150:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2785 committed 00000004:00080000:1.0:1746140890.427152:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2798 committed 00000004:00080000:1.0:1746140890.427154:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2797 committed 00000004:00080000:1.0:1746140890.427155:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2784 committed 00000100:00100000:3.0:1746140890.427431:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576130688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.427436:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576130816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.427467:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.427503:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576131200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.427517:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.427542:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576130688 00000100:00100000:3.0:1746140890.427548:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576130688 00000100:00100000:3.0:1746140890.427574:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576131200 00000100:00100000:3.0:1746140890.427575:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576131200 00000100:00100000:3.0:1746140890.427587:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17451 00000100:00100000:3.0:1746140890.427593:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+78:3312:x1830960576130688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.427621:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576130944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.427647:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.427667:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576131456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.427681:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.427691:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576131968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.427705:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.427715:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576132480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.427728:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.427741:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746140890.427746:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576130560:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746140890.427747:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140890.427750:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.427752:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.427754:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.427756:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746140890.427759:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.427768:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576131072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.427781:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+79:3312:x1830960576130688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (314us total) trans 17179874235 rc 0/0 00000100:00100000:0.0:1746140890.427783:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.427788:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17451 00000100:00100000:0.0:1746140890.427792:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576131584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.427802:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576130944 00000100:00100000:3.0:1746140890.427804:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576130944 00000100:00100000:0.0:1746140890.427806:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140890.427816:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576132096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.427817:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576131456 00000100:00100000:3.0:1746140890.427819:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576131456 00000100:00100000:3.0:1746140890.427827:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576131968 00000100:00100000:3.0:1746140890.427829:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576131968 00000100:00100000:0.0:1746140890.427829:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.427836:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576132480 00000100:00100000:3.0:1746140890.427837:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576132480 00000100:00100000:3.0:1746140890.427843:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576130560 00000100:00100000:3.0:1746140890.427845:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576130560 00000100:00100000:0.0:1746140890.427846:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576131072 00000100:00100000:3.0:1746140890.427851:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576131584 00000100:00100000:0.0:1746140890.427852:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576131072 00000100:00100000:3.0:1746140890.427853:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576131584 00000100:00100000:3.0:1746140890.427858:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576132096 00000100:00100000:3.0:1746140890.427860:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576132096 00000100:00100000:3.0:1746140890.427869:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17452 00000100:00100000:3.0:1746140890.427873:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3312:x1830960576131200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.427879:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17453 00000100:00100000:0.0:1746140890.427886:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+82:3310:x1830960576130944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.427938:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+83:3312:x1830960576131200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (419us total) trans 17179874236 rc 0/0 00000100:00100000:3.0:1746140890.427943:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17452 00000100:00100000:3.0:1746140890.427951:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17454 00000100:00100000:3.0:1746140890.427955:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3310:x1830960576131456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.428018:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17455 00000100:00100000:3.0:1746140890.428022:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+89:3310:x1830960576131968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.428054:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+84:3310:x1830960576130944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (406us total) trans 17179874237 rc 0/0 00000100:00100000:0.0:1746140890.428061:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17453 00000100:00100000:0.0:1746140890.428078:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17456 00000100:00100000:0.0:1746140890.428084:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+89:3310:x1830960576132480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140890.428186:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+90:3310:x1830960576132480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (456us total) trans 21474841531 rc 0/0 00000100:00100000:0.0:1746140890.428192:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17456 00000100:00100000:0.0:1746140890.428201:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17457 00000100:00100000:0.0:1746140890.428206:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+83:3310:x1830960576130560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140890.428277:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140890.428280:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.428282:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:0.0:1746140890.428284:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.428286:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140890.428327:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+84:3310:x1830960576130560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (543us total) trans 17179874239 rc 0/0 00000100:00100000:0.0:1746140890.428332:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17457 00000100:00100000:0.0:1746140890.428342:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17458 00000100:00100000:0.0:1746140890.428347:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+89:3310:x1830960576131584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140890.428413:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140890.428416:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.428417:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.428419:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140890.428422:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140890.428439:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+91:3310:x1830960576131584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (632us total) trans 21474841532 rc 0/0 00000100:00100000:0.0:1746140890.428444:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17458 00000100:00100000:0.0:1746140890.428454:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17459 00000100:00100000:3.0:1746140890.428459:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+90:3310:x1830960576131968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 436us (751us total) trans 21474841533 rc 0/0 00000100:00100000:0.0:1746140890.428459:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+90:3310:x1830960576132096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.428466:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17455 00000100:00100000:3.0:1746140890.428476:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17460 00000100:00100000:3.0:1746140890.428480:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+83:3310:x1830960576131072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140890.428538:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+90:3310:x1830960576132096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (707us total) trans 21474841534 rc 0/0 00000100:00100000:0.0:1746140890.428543:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17459 00000100:00100000:3.0:1746140890.428554:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3310:x1830960576131072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (770us total) trans 17179874240 rc 0/0 00000100:00100000:3.0:1746140890.428562:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17460 00000100:00100000:2.0:1746140890.428569:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.428585:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576130816 00000100:00100000:3.0:1746140890.428587:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576130816 00000100:00100000:2.0:1746140890.428593:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576131328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140890.428599:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17461 00000100:00100000:3.0:1746140890.428603:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3313:x1830960576130816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.428611:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.428625:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576131840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.428637:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140890.428646:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576132352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.428656:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746140890.428659:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746140890.428661:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.428663:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:3.0:1746140890.428665:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00000100:00100000:2.0:1746140890.428665:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00002000:00010000:3.0:1746140890.428667:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746140890.428669:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576131712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.428684:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3313:x1830960576130816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (116us total) trans 17179874241 rc 0/0 00000100:00100000:2.0:1746140890.428684:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.428689:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17461 00000100:00100000:2.0:1746140890.428694:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576132224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.428696:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576131328 00000100:00100000:3.0:1746140890.428697:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576131328 00000100:00100000:1.0:1746140890.428705:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576131840 00000100:00100000:2.0:1746140890.428706:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140890.428708:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576132352 00000100:00100000:1.0:1746140890.428709:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576131840 00000100:00100000:3.0:1746140890.428710:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576132352 00000100:00100000:3.0:1746140890.428716:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576131712 00000100:00100000:3.0:1746140890.428718:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576131712 00000100:00100000:1.0:1746140890.428724:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576132224 00000004:00080000:2.0:1746140890.428726:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c3480/2, rc 0, transno 17179874241 00000100:00100000:1.0:1746140890.428726:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576132224 00000100:00100000:3.0:1746140890.428727:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17462 00000100:00100000:3.0:1746140890.428730:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3313:x1830960576131328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.428731:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576130816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.428736:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17463 00000100:00100000:1.0:1746140890.428741:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+93:3313:x1830960576132352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140890.428749:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17464 00000100:00100000:2.0:1746140890.428755:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+93:3313:x1830960576131840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.428792:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3313:x1830960576131328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (179us total) trans 17179874242 rc 0/0 00000100:00100000:3.0:1746140890.428797:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17462 00000100:00100000:3.0:1746140890.428805:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17465 00000100:00100000:3.0:1746140890.428809:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+94:3313:x1830960576131712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.428841:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+95:3313:x1830960576132352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (183us total) trans 21474841535 rc 0/0 00002000:00010000:2.0:1746140890.428843:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:2.0:1746140890.428846:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00000100:00100000:1.0:1746140890.428846:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17463 00002000:00010000:2.0:1746140890.428848:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.428850:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:2.0:1746140890.428852:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5521 -> 5521 00000100:00100000:1.0:1746140890.428857:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17466 00000100:00100000:1.0:1746140890.428861:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+95:3313:x1830960576132224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746140890.428866:0:4186:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140890.428868:0:4186:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.428870:0:4186:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140890 -> 1746140890 00002000:00010000:3.0:1746140890.428872:0:4186:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00000100:00100000:2.0:1746140890.428872:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+95:3313:x1830960576131840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (233us total) trans 21474841536 rc 0/0 00002000:00010000:3.0:1746140890.428874:0:4186:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746140890.428878:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17464 00000100:00100000:3.0:1746140890.428888:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+94:3313:x1830960576131712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (204us total) trans 21474841537 rc 0/0 00000100:00100000:3.0:1746140890.428893:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17465 00000004:00080000:2.0:1746140890.428901:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e1180/2, rc 0, transno 21474841537 00000100:00100000:2.0:1746140890.428908:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576131712:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140890.428914:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adca80/2, rc 0, transno 21474841536 00000100:00100000:2.0:1746140890.428917:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576131840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140890.428920:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c2d80/2, rc 0, transno 17179874235 00000100:00100000:3.0:1746140890.428923:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576130688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140890.428923:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adc000/2, rc 0, transno 21474841535 00000100:00100000:2.0:1746140890.428926:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576132352:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746140890.428930:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c1f80/2, rc 0, transno 17179874236 00000004:00080000:2.0:1746140890.428932:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f078e00/2, rc 0, transno 17179874242 00000100:00100000:3.0:1746140890.428933:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576131200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140890.428934:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576131328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140890.428940:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+94:3313:x1830960576132224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (232us total) trans 21474841538 rc 0/0 00000004:00080000:2.0:1746140890.428944:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adf100/2, rc 0, transno 21474841538 00000100:00100000:1.0:1746140890.428945:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17466 00000100:00100000:2.0:1746140890.428947:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576132224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.428966:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3310:x1830960576131456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1010us (1285us total) trans 17179874238 rc 0/0 00000100:00100000:3.0:1746140890.428972:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17454 00000100:00100000:1.0:1746140890.428991:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576132608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.429024:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140890.429048:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576132608 00000100:00100000:1.0:1746140890.429051:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576132608 00000100:00100000:1.0:1746140890.429076:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17467 00000100:00100000:1.0:1746140890.429081:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+94:3311:x1830960576132608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140890.429163:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3311:x1830960576132608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (138us total) trans 21474841539 rc 0/0 00000100:00100000:1.0:1746140890.429168:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17467 00000004:00080000:1.0:1746140890.429189:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab6ed80/2, rc 0, transno 21474841539 00000100:00100000:1.0:1746140890.429192:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576132608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.429245:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c3100/2, rc 0, transno 17179874239 00000100:00100000:0.0:1746140890.429249:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576130560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140890.429260:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c0a80/2, rc 0, transno 17179874240 00000100:00100000:0.0:1746140890.429262:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576131072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140890.429270:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55e1500/2, rc 0, transno 21474841532 00000100:00100000:0.0:1746140890.429272:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576131584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.429278:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adc700/2, rc 0, transno 21474841534 00000100:00100000:0.0:1746140890.429280:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576132096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.429286:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c3b80/2, rc 0, transno 17179874237 00000100:00100000:0.0:1746140890.429288:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576130944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140890.429295:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f078000/2, rc 0, transno 17179874238 00000100:00100000:0.0:1746140890.429297:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576131456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140890.429456:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094add180/2, rc 0, transno 21474841533 00000100:00100000:0.0:1746140890.429460:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576131968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140890.429471:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adc380/2, rc 0, transno 21474841531 00000100:00100000:0.0:1746140890.429473:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576132480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140890.429851:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576130432:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140890.429881:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d600/0x8156357b7fdbb665 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 8 pid: 14785 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746140890.429895:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.429917:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c7d400, rc 0) 00000100:00100000:3.0:1746140890.429958:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:411:x1830960573916800:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 48347us (48429us total) trans 8589945180 rc 0/0 00000100:00100000:3.0:1746140890.429968:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10855 00000100:00100000:0.0:1746140890.430743:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.430794:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573917184 00000100:00100000:3.0:1746140890.430799:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573917184 00000100:00100000:3.0:1746140890.430840:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4785 00000100:00100000:3.0:1746140890.430850:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:413:x1830960573917184:12345-192.168.204.16@tcp:49:multiop.0 00000100:00100000:3.0:1746140890.430956:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:413:x1830960573917184:12345-192.168.204.16@tcp:49:multiop.0 Request processed in 106us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.430961:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4785 00000100:00100000:0.0:1746140890.440632:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.440726:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.440817:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573917312 00000100:00100000:2.0:1746140890.440827:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573917312 00000100:00100000:2.0:1746140890.440862:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573917440 00000100:00100000:2.0:1746140890.440864:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573917440 00000100:00100000:2.0:1746140890.440890:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17468 00000100:00100000:2.0:1746140890.440897:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+28:411:x1830960573917312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.440918:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140890.440931:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17469 00010000:00010000:2.0:1746140890.440934:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21a7 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.440939:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:413:x1830960573917440:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140890.440947:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.440958:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21ae expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.440960:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 32 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.440968:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 29 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.440974:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 21 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.440974:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.440975:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.440979:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [335872->1048575] (req 335872->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 29 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.440982:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 41 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.440987:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.440988:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.440991:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 41 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.441021:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 41 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.441021:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 29 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.441032:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 41 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.441032:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 29 pid: 4784 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.441043:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576132736:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.441043:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576132864:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.441363:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 21 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.441372:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 21 pid: 4782 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.441381:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576132992:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.441674:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00010000:00010000:2.0:1746140890.441726:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 32 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.441734:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 32 pid: 32376 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.441746:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576133120:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.441779:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453840 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.444054:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576132736:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.444054:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576132864:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.444064:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576133120:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.444066:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576132992:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.444087:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 41 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.444087:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [335872->1048575] (req 335872->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 29 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.444101:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb600, rc 0) 00010000:00010000:2.0:1746140890.444101:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79400, rc 0) 00000100:00100000:3.0:1746140890.444181:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:413:x1830960573917440:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3242us (3454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.444189:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17469 00000100:00100000:2.0:1746140890.444496:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:411:x1830960573917312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3596us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.444501:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17468 00000100:00100000:0.0:1746140890.444595:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.444626:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.444641:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.444663:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.444681:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573917568 00000100:00100000:1.0:1746140890.444687:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573917568 00010000:00010000:1.0:1746140890.444710:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 29 pid: 4784 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.444719:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573917824 00000100:00100000:2.0:1746140890.444724:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573917824 00000100:00100000:1.0:1746140890.444728:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573917696 00000100:00100000:1.0:1746140890.444730:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573917696 00010000:00010000:2.0:1746140890.444735:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 41 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.444736:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573917952 00010000:00010000:1.0:1746140890.444738:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 22 pid: 4782 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.444740:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573917952 00000100:00100000:2.0:1746140890.444753:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9036 00010000:00010000:0.0:1746140890.444754:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 33 pid: 32376 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.444759:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573917568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.444769:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.444789:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 29 pid: 4784 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.444799:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 29 pid: 4784 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.444818:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e79a00/0x8156357b7fdbb5c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a213e expref: 29 pid: 4784 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.444827:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.444845:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573917568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.444850:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9036 00000100:00100000:2.0:1746140890.444861:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9037 00000100:00100000:2.0:1746140890.444865:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573917824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.444873:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.444884:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 41 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.444891:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 41 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.444901:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e79600/0x8156357b7fdbb626 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a217d expref: 41 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.444909:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.444923:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573917824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.444927:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9037 00000100:00100000:2.0:1746140890.444936:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9038 00000100:00100000:2.0:1746140890.444940:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573917696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.444946:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.444952:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 22 pid: 4782 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.444958:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 22 pid: 4782 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.444968:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb5cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2145 expref: 22 pid: 4782 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.444975:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.444976:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.444981:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.444987:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.445021:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.445031:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576133248:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.445036:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9039 00000100:00100000:1.0:1746140890.445042:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573917952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.445050:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.445058:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 33 pid: 32376 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.445063:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453840 going to sleep for 11 seconds 00010000:00010000:1.0:1746140890.445066:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 33 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.445076:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb593 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a210d expref: 33 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.445086:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.445088:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.445091:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.445098:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.445114:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.445121:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576133376:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.445188:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.446798:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576133248:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140890.446813:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.446849:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576133376:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140890.446852:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573917696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1910us (2209us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140890.446857:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.446860:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9038 00000100:00100000:1.0:1746140890.446870:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960573917952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1829us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.446876:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9039 00000100:00100000:0.0:1746140890.447396:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.447470:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573918208 00000100:00100000:1.0:1746140890.447475:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573918208 00002000:00100000:1.0:1746140890.447504:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1683456->1687551) req@ffff88009f783100 x1830960573918208/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.447512:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f783100 with x1830960573918208 ext(1683456->1687551) 00002000:00010000:1.0:1746140890.447516:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f783100 00000100:00100000:1.0:1746140890.447643:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8934 00000100:00100000:1.0:1746140890.447649:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573918208:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140890.447787:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1985:x1830960573918208:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 137us (391us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140890.447792:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8934 00002000:00100000:1.0:1746140890.447797:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1683456->1687551) req@ffff88009f783100 x1830960573918208/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.447809:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f783100 with x1830960573918208 ext(1683456->1687551) 00002000:00010000:1.0:1746140890.447812:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f783100 00000100:00100000:0.0:1746140890.448605:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.448647:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573918464 00000100:00100000:1.0:1746140890.448651:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573918464 00002000:00100000:1.0:1746140890.448668:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (335872->339967) req@ffff88009f780000 x1830960573918464/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.448675:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f780000 with x1830960573918464 ext(335872->339967) 00002000:00010000:1.0:1746140890.448678:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f780000 00000100:00100000:1.0:1746140890.448701:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8935 00000100:00100000:1.0:1746140890.448706:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573918464:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140890.448801:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573918464:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 95us (199us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140890.448807:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8935 00002000:00100000:1.0:1746140890.448812:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (335872->339967) req@ffff88009f780000 x1830960573918464/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.448818:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f780000 with x1830960573918464 ext(335872->339967) 00002000:00010000:1.0:1746140890.448820:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f780000 00000100:00100000:0.0:1746140890.452461:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.452572:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573918592 00000100:00100000:2.0:1746140890.452581:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573918592 00000100:00100000:2.0:1746140890.452631:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17470 00000100:00100000:2.0:1746140890.452638:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:413:x1830960573918592:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.452655:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.452671:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21b5 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.452695:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 41 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.452702:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 20 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.452707:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.452709:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.452711:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->1581055] (req 1048576->1581055) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 41 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.452737:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 20 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.452746:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 20 pid: 4782 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.452755:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576133504:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.452836:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 41 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.452844:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 41 pid: 4186 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.452852:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576133632:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.452870:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.454018:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.454052:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576133504:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.454063:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576133632:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.454064:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140890.454094:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1048576->1581055] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 41 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.454109:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79000, rc 0) 00000100:00100000:3.0:1746140890.454118:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573918848 00000100:00100000:3.0:1746140890.454125:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573918848 00000100:00100000:1.0:1746140890.454137:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573918720 00000100:00100000:1.0:1746140890.454143:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573918720 00010000:00010000:3.0:1746140890.454149:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 42 pid: 4186 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.454166:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 21 pid: 4782 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.454174:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9040 00000100:00100000:3.0:1746140890.454181:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573918848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.454190:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140890.454192:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9041 00000100:00100000:1.0:1746140890.454199:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573918720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.454210:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 42 pid: 4186 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.454210:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.454220:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 42 pid: 4186 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.454235:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 21 pid: 4782 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.454246:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 21 pid: 4782 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.454260:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:413:x1830960573918592:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1622us (1806us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140890.454264:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb5e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a214c expref: 21 pid: 4782 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.454268:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17470 00010000:00010000:1.0:1746140890.454283:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.454328:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1985:x1830960573918720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 130us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.454334:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9041 00010000:00010000:3.0:1746140890.454383:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c25c00/0x8156357b7fdbb5a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2122 expref: 41 pid: 4186 timeout: 969 lvb_type: 1 00010000:00010000:3.0:1746140890.454400:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.454402:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.454407:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 40 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.454415:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 40 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.454439:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 40 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.454449:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576133760:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140890.454511:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.455493:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.455547:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573918976 00000100:00100000:2.0:1746140890.455551:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573918976 00000100:00100000:2.0:1746140890.455653:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17471 00000100:00100000:2.0:1746140890.455660:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:411:x1830960573918976:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746140890.455674:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576133760:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140890.455674:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.455687:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140890.455688:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21bc expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.455713:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 40 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.455720:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746140890.455721:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1983:x1830960573918848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1540us (1710us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140890.455722:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140890.455726:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->1208319] (req 1048576->1208319) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 21 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.455727:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9040 00010000:00010000:2.0:1746140890.455752:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.455763:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 39 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.455774:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576133888:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.455871:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453840 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.457484:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576133888:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.457506:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->1208319] (req 1048576->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 21 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.457519:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f773600, rc 0) 00000100:00100000:2.0:1746140890.457561:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:411:x1830960573918976:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1901us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.457568:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17471 00000100:00100000:0.0:1746140890.458231:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.458334:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573919104 00000100:00100000:1.0:1746140890.458341:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573919104 00002000:00100000:1.0:1746140890.458374:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1683456->2097151) req@ffff88009f783800 x1830960573919104/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.458384:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f783800 with x1830960573919104 ext(1683456->2097151) 00010000:00010000:1.0:1746140890.458390:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 40 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.458401:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 40 pid: 12255 timeout: 969 lvb_type: 0 00002000:00010000:1.0:1746140890.458407:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f783800 00000100:00100000:1.0:1746140890.458431:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1857 00000100:00100000:1.0:1746140890.458437:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573919104:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140890.460587:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.460700:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573919360 00000100:00100000:3.0:1746140890.460707:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573919360 00002000:00100000:3.0:1746140890.460736:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1576960->1581055) req@ffff88009abb9c00 x1830960573919360/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.460745:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb9c00 with x1830960573919360 ext(1576960->1581055) 00002000:00010000:3.0:1746140890.460749:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abb9c00 00000100:00100000:3.0:1746140890.460777:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8936 00000100:00100000:3.0:1746140890.460783:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573919360:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.460932:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573919360:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 148us (350us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.460939:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8936 00002000:00100000:3.0:1746140890.460944:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1576960->1581055) req@ffff88009abb9c00 x1830960573919360/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.460951:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb9c00 with x1830960573919360 ext(1576960->1581055) 00002000:00010000:3.0:1746140890.460954:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abb9c00 00000100:00100000:0.0:1746140890.464493:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.465125:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1984:x1830960573919104:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6686us (6895us total) trans 17179874243 rc 0/0 00000100:00100000:1.0:1746140890.465138:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1857 00000100:00100000:2.0:1746140890.465140:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573919616 00000100:00100000:2.0:1746140890.465148:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573919616 00002000:00100000:1.0:1746140890.465149:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1683456->2097151) req@ffff88009f783800 x1830960573919104/t17179874243(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.465159:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f783800 with x1830960573919104 ext(1683456->2097151) 00010000:00010000:1.0:1746140890.465167:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 42 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.465180:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 42 pid: 12255 timeout: 969 lvb_type: 0 00002000:00010000:1.0:1746140890.465187:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f783800 00000100:00100000:2.0:1746140890.465468:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4786 00000100:00100000:2.0:1746140890.465476:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:413:x1830960573919616:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140890.465763:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:413:x1830960573919616:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 287us (1278us total) trans 8589945181 rc 0/0 00000100:00100000:2.0:1746140890.465770:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4786 00000100:00100000:0.0:1746140890.466714:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.466815:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573919744 00000100:00100000:3.0:1746140890.466820:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573919744 00010000:00010000:3.0:1746140890.466843:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 42 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.466868:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9042 00000100:00100000:3.0:1746140890.466874:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573919744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.466882:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746140890.466898:0:7111:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140890 -> 1746140891 00002000:00010000:3.0:1746140890.466900:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140890 -> 1746140891 00010000:00010000:3.0:1746140890.466904:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 42 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.466915:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 42 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.466935:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb600/0x8156357b7fdbb681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ae expref: 42 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.466961:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.466962:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.466969:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 20 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.466978:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 20 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.467021:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 20 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.467037:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576134016:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140890.467205:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.468562:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576134016:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140890.468579:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.468637:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573919744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1762us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.468645:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9042 00000100:00100000:0.0:1746140890.469519:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.469584:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573920000 00000100:00100000:1.0:1746140890.469590:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573920000 00002000:00100000:1.0:1746140890.469627:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1204224->1208319) req@ffff88009abb8380 x1830960573920000/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.469635:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8380 with x1830960573920000 ext(1204224->1208319) 00002000:00010000:1.0:1746140890.469640:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abb8380 00000100:00100000:1.0:1746140890.469672:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8937 00000100:00100000:1.0:1746140890.469678:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573920000:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140890.469839:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573920000:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 161us (325us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140890.469847:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8937 00002000:00100000:1.0:1746140890.469852:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1204224->1208319) req@ffff88009abb8380 x1830960573920000/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.469858:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb8380 with x1830960573920000 ext(1204224->1208319) 00002000:00010000:1.0:1746140890.469861:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abb8380 00000100:00100000:0.0:1746140890.471723:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.471899:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573920256 00000100:00100000:2.0:1746140890.471907:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573920256 00000100:00100000:2.0:1746140890.471952:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4787 00000100:00100000:2.0:1746140890.471958:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:411:x1830960573920256:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140890.472147:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:411:x1830960573920256:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 188us (433us total) trans 8589945182 rc 0/0 00000100:00100000:2.0:1746140890.472153:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4787 00000100:00100000:0.0:1746140890.564194:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.564339:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573920512 00000100:00100000:3.0:1746140890.564348:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573920512 00000100:00100000:3.0:1746140890.564403:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10857 00000100:00100000:3.0:1746140890.564411:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:422:x1830960573920512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.564433:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.564450:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21c3 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.564557:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564570:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564579:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564590:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564595:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564600:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564700:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564708:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564713:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140890.564722:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140890.564801:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564806:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564811:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564816:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.564820:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564825:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564835:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140890.564838:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.564841:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.564846:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb69d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.567151:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.567172:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.567178:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.567182:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.567186:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.567191:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.567205:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a47f2f00) 00010000:00010000:3.0:1746140890.567208:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.567211:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.567216:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb6a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.567282:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.567295:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.567302:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.567317:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140890.567320:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fae00, rc 0) 00000100:00100000:3.0:1746140890.567389:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:422:x1830960573920512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2977us (3206us total) trans 8589945183 rc 0/0 00000100:00100000:3.0:1746140890.567397:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10857 00000100:00100000:0.0:1746140890.571839:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.572108:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573920640 00000100:00100000:2.0:1746140890.572119:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573920640 00000100:00100000:2.0:1746140890.572796:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17472 00000100:00100000:2.0:1746140890.572805:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573920640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140890.572825:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.572841:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21ca expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.572891:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576134144:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140890.572980:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.577709:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.577856:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573920896 00000100:00100000:2.0:1746140890.577867:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573920896 00002000:00010000:3.0:1746140890.577886:0:8458:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime: 1746140890 -> 1746140891 00002000:00010000:3.0:1746140890.577891:0:8458:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime: 1746140890 -> 1746140891 00000100:00100000:2.0:1746140890.577909:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10858 00000100:00100000:3.0:1746140890.577914:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576134144:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140890.577916:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:425:x1830960573920896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140890.577937:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.577948:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ca expref: 22 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.577953:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5200/0x8156357b7fdbb6c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21d1 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.577961:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ca expref: 22 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.577976:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb4a00, rc 0) 00000100:00100000:3.0:1746140890.578033:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1985:x1830960573920640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5229us (6204us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140890.578044:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17472 00010000:00010000:2.0:1746140890.578050:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578062:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578071:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578081:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578086:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578091:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578169:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578180:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578185:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140890.578192:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140890.578254:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578260:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578265:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578270:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fcb5400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140890.578273:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578279:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578287:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140890.578290:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140890.578293:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578298:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5400/0x8156357b7fdbb6c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578948:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578961:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578966:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578971:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fcb5600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140890.578974:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578978:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.578986:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130d2f100) 00010000:00010000:2.0:1746140890.578988:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140890.578990:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.579011:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5600/0x8156357b7fdbb6ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.579048:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5200/0x8156357b7fdbb6c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.579058:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 270 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.579064:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.579066:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140890.579068:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb5800, rc 0) 00000100:00100000:2.0:1746140890.580636:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:425:x1830960573920896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2714us (2932us total) trans 8589945184 rc 0/0 00000100:00100000:2.0:1746140890.580645:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10858 00000100:00100000:0.0:1746140890.582333:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.582366:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.582389:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573921280 00000100:00100000:1.0:1746140890.582400:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573921280 00000100:00100000:2.0:1746140890.582425:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573921408 00000100:00100000:2.0:1746140890.582432:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573921408 00002000:00100000:1.0:1746140890.582444:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1208320->2097151) req@ffff88009abbb100 x1830960573921280/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.582454:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb100 with x1830960573921280 ext(1208320->2097151) 00002000:00010000:1.0:1746140890.582460:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abbb100 00002000:00100000:2.0:1746140890.582461:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->335871) req@ffff88009abbb480 x1830960573921408/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.582471:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb480 with x1830960573921408 ext(0->335871) 00002000:00010000:2.0:1746140890.582476:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abbb480 00000100:00100000:1.0:1746140890.582524:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8938 00000100:00100000:1.0:1746140890.582531:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573921280:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.582556:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8939 00000100:00100000:2.0:1746140890.582562:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573921408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.583199:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.583237:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.583243:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573921664 00000100:00100000:3.0:1746140890.583248:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573921664 00000100:00100000:0.0:1746140890.583271:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.583274:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17473 00000100:00100000:3.0:1746140890.583280:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1983:x1830960573921664:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140890.583280:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573921792 00000100:00100000:2.0:1746140890.583283:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573921792 00010000:00010000:3.0:1746140890.583290:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140890.583325:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10859 00010000:00010000:3.0:1746140890.583327:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb6e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21d8 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.583330:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:427:x1830960573921792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.583343:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.583358:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5e00/0x8156357b7fdbb6ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21df expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.583373:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576134272:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140890.583428:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00000100:00100000:3.0:1746140890.583436:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746140890.583441:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.583448:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.583458:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.583482:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.583492:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 271 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.583502:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576134400:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.583538:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.583545:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 9 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.583551:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573921920 00000100:00100000:2.0:1746140890.583552:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576134528:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.583555:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573921920 00000100:00100000:2.0:1746140890.583567:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.583581:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17474 00000100:00100000:3.0:1746140890.583586:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1982:x1830960573921920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.583592:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.583601:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb6f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21e6 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.583624:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576134656:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140890.583655:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.587701:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.587734:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.587755:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573922048 00000100:00100000:0.0:1746140890.587762:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573922048 00010000:00010000:0.0:1746140890.587793:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 272 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.587816:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573922176 00000100:00100000:0.0:1746140890.587819:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573922176 00010000:00010000:0.0:1746140890.587827:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 10 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.587844:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9043 00000100:00100000:1.0:1746140890.587860:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1984:x1830960573922048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140890.587860:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9044 00000100:00100000:0.0:1746140890.587866:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573922176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140890.587876:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.587877:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140890.587880:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 10 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.587886:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 272 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:0.0:1746140890.587889:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 10 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.587900:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 272 pid: 14785 timeout: 969 lvb_type: 0 00010000:00010000:0.0:1746140890.587942:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140890.587946:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.587962:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.587967:0:8473:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.587974:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.587979:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140890.587982:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140890.588008:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960573922176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.588009:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573921408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5446us (5641us total) trans 0 rc 335872/335872 00000100:00100000:0.0:1746140890.588014:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9044 00000100:00100000:2.0:1746140890.588016:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8939 00002000:00100000:2.0:1746140890.588023:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->335871) req@ffff88009abbb480 x1830960573921408/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 335872/335872 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140890.588029:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1984:x1830960573922048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 175us (335us total) trans 0 rc 0/0 00002000:00100000:2.0:1746140890.588031:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb480 with x1830960573921408 ext(0->335871) 00002000:00010000:2.0:1746140890.588034:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abbb480 00000100:00100000:1.0:1746140890.588036:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9043 00010000:00010000:2.0:1746140890.588072:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5800/0x8156357b7fdbb6d5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d1 expref: 271 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.588084:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576134400:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.588094:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb6ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21c3 expref: 9 pid: 14785 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.588101:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576134528:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.588118:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.588125:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.588129:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00002000:00010000:3.0:1746140890.588193:0:8458:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime: 1746140890 -> 1746140891 00002000:00010000:3.0:1746140890.588196:0:8458:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime: 1746140890 -> 1746140891 00002000:00010000:3.0:1746140890.588198:0:8458:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime: 1746140890 -> 1746140891 00002000:00010000:1.0:1746140890.588203:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime: 1746140889 -> 1746140891 00000100:00100000:3.0:1746140890.588211:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576134272:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140890.588218:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576134656:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140890.588226:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb6e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d8 expref: 33 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.588236:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb6e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21d8 expref: 33 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.588240:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb6f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21e6 expref: 42 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.588251:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb6f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21e6 expref: 42 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.588258:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbc00, rc 0) 00000004:00200000:2.0:1746140890.588261:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140890.588266:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa600, rc 0) 00000100:00100000:3.0:1746140890.588286:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1983:x1830960573921664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5005us (5087us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140890.588287:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1982:x1830960573921920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4700us (5016us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140890.588292:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17473 00000100:00100000:1.0:1746140890.588296:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17474 00010000:00010000:2.0:1746140890.588531:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb5e00/0x8156357b7fdbb6ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 272 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.588542:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.588548:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.588550:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140890.588552:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb4a00, rc 0) 00000100:00100000:2.0:1746140890.588583:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:427:x1830960573921792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5251us (5347us total) trans 8589945185 rc 0/0 00000100:00100000:2.0:1746140890.588591:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10859 00000100:00100000:1.0:1746140890.590782:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1983:x1830960573921280:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8245us (8471us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746140890.590792:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8938 00002000:00100000:1.0:1746140890.590803:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1208320->2097151) req@ffff88009abbb100 x1830960573921280/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.590812:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbb100 with x1830960573921280 ext(1208320->2097151) 00002000:00010000:1.0:1746140890.590817:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abbb100 00000100:00100000:2.0:1746140890.591044:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.591198:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573922304 00000100:00100000:0.0:1746140890.591205:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573922304 00000100:00100000:0.0:1746140890.591275:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17475 00000100:00100000:0.0:1746140890.591286:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:425:x1830960573922304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140890.591347:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.591361:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21ed expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.591387:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.591398:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140890.591400:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140890.591403:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.591429:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 27 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.591443:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 27 pid: 8458 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.591453:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576134784:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.591516:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.593045:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.593091:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573922560 00000100:00100000:2.0:1746140890.593097:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573922560 00000100:00100000:2.0:1746140890.593128:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10860 00000100:00100000:2.0:1746140890.593134:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5188850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+9:429:x1830960573922560:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.593153:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.593166:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dee00/0x8156357b7fdbb70d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21f4 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.593252:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593263:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593273:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593284:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593290:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593295:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593417:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593425:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593430:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140890.593437:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140890.593505:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593512:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593517:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593523:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b8df000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140890.593526:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593532:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593541:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140890.593544:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140890.593547:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593557:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df000/0x8156357b7fdbb714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593567:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593571:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593579:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593583:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b8df200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140890.593585:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593589:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593595:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130d2ff00) 00010000:00010000:2.0:1746140890.593597:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140890.593599:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593602:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb71b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140890.593631:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dee00/0x8156357b7fdbb70d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.593637:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.593641:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.593642:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140890.593644:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8df400, rc 0) 00000100:00100000:2.0:1746140890.593676:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5188850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:429:x1830960573922560:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 542us (634us total) trans 8589945186 rc 0/0 00000100:00100000:2.0:1746140890.593682:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10860 00000100:00100000:2.0:1746140890.594792:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576134784:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.594814:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.594826:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5f3e00, rc 0) 00000100:00100000:2.0:1746140890.594855:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:425:x1830960573922304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3572us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.594863:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17475 00000100:00100000:0.0:1746140890.595385:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.595439:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573922688 00000100:00100000:1.0:1746140890.595446:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573922688 00002000:00100000:1.0:1746140890.595476:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (335872->1048575) req@ffff88009f2c0380 x1830960573922688/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.595489:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0380 with x1830960573922688 ext(335872->1048575) 00010000:00010000:1.0:1746140890.595495:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 28 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.595506:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 28 pid: 8458 timeout: 969 lvb_type: 0 00002000:00010000:1.0:1746140890.595511:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c0380 00000100:00100000:1.0:1746140890.595538:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1858 00000100:00100000:1.0:1746140890.595544:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573922688:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140890.600892:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.601084:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573922816 00000100:00100000:2.0:1746140890.601092:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573922816 00000100:00100000:2.0:1746140890.601135:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17476 00000100:00100000:2.0:1746140890.601141:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+21:422:x1830960573922816:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140890.601150:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573922688:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5604us (5765us total) trans 21474841540 rc 0/0 00010000:00010000:2.0:1746140890.601156:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140890.601159:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1858 00002000:00100000:1.0:1746140890.601167:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a0:0x0] (335872->1048575) req@ffff88009f2c0380 x1830960573922688/t21474841540(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746140890.601170:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a21fb expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746140890.601175:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0380 with x1830960573922688 ext(335872->1048575) 00010000:00010000:1.0:1746140890.601182:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 30 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.601193:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 30 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.601194:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 40 pid: 8458 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140890.601199:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c0380 00010000:00010000:2.0:1746140890.601201:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140890.601202:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140890.601206:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.601233:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 40 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.601246:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 40 pid: 8458 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.601256:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576134912:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.601636:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.602616:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576134912:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.602641:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.602654:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8df600, rc 0) 00000100:00100000:2.0:1746140890.602686:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:422:x1830960573922816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1544us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.602696:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17476 00000100:00100000:0.0:1746140890.603501:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.603597:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573922944 00000100:00100000:1.0:1746140890.603603:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573922944 00002000:00100000:1.0:1746140890.603634:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1581055) req@ffff88009f2c3100 x1830960573922944/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.603642:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c3100 with x1830960573922944 ext(1048576->1581055) 00010000:00010000:1.0:1746140890.603648:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 41 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.603666:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 41 pid: 8458 timeout: 969 lvb_type: 0 00002000:00010000:1.0:1746140890.603673:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c3100 00000100:00100000:1.0:1746140890.603697:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1859 00000100:00100000:1.0:1746140890.603703:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573922944:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140890.603969:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.603988:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573923072 00000100:00100000:1.0:1746140890.604003:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573923072 00010000:00010000:1.0:1746140890.604537:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 30 pid: 8458 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.604567:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9045 00000100:00100000:1.0:1746140890.604572:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573923072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.604581:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.604597:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 30 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.604606:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 30 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.604654:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e79400/0x8156357b7fdbb67a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a7 expref: 30 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.604670:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.604672:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.604679:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.604687:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.604715:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.604725:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576135040:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.604933:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059900 going to sleep for 11 seconds 00000100:00100000:1.0:1746140890.608110:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576135040:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140890.608129:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.608171:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573923072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3597us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.608181:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9045 00000100:00100000:2.0:1746140890.608484:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.608619:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573923328 00000100:00100000:0.0:1746140890.608626:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573923328 00002000:00100000:0.0:1746140890.608661:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88012d081c00 x1830960573923328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140890.608669:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d081c00 with x1830960573923328 ext(0->1048575) 00002000:00010000:0.0:1746140890.608673:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d081c00 00000100:00100000:0.0:1746140890.608701:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8940 00000100:00100000:0.0:1746140890.608707:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573923328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140890.610536:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.610612:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573923456 00000100:00100000:0.0:1746140890.610618:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573923456 00000100:00100000:0.0:1746140890.610670:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17477 00000100:00100000:0.0:1746140890.610676:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:427:x1830960573923456:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140890.610690:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.610707:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2202 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.610732:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.610740:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.610746:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.610748:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140890.610751:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2408448->2813951] (req 2408448->2813951) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.610780:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.610790:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 28 pid: 8460 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.610800:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576135168:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.610874:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.610883:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 36 pid: 12255 timeout: 969 lvb_type: 1 00000100:00100000:0.0:1746140890.610890:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576135296:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.610908:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.614048:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576135168:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.614061:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576135296:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140890.614087:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2408448->2813951] (req 2408448->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.614103:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5f2800, rc 0) 00000100:00100000:0.0:1746140890.614144:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:427:x1830960573923456:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3467us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.614152:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17477 00000100:00100000:2.0:1746140890.614277:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573923328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5568us (5792us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.614347:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8940 00002000:00100000:2.0:1746140890.614357:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88012d081c00 x1830960573923328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.614366:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d081c00 with x1830960573923328 ext(0->1048575) 00002000:00010000:2.0:1746140890.614371:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d081c00 00000100:00100000:0.0:1746140890.614623:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.614656:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.614767:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573923584 00000100:00100000:2.0:1746140890.614767:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573923712 00000100:00100000:3.0:1746140890.614774:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573923584 00000100:00100000:2.0:1746140890.614774:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573923712 00010000:00010000:2.0:1746140890.614797:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 29 pid: 8460 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.614814:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9046 00000100:00100000:2.0:1746140890.614818:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573923712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.614827:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.614842:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 29 pid: 8460 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.614849:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 29 pid: 8460 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.614868:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbb5e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a215a expref: 29 pid: 8460 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.614881:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.614902:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573923712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.614907:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9046 00010000:00010000:3.0:1746140890.615030:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 34 pid: 12255 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.615052:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9047 00000100:00100000:3.0:1746140890.615057:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573923584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.615065:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.615073:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 34 pid: 12255 timeout: 969 lvb_type: 1 00010000:00010000:3.0:1746140890.615082:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 34 pid: 12255 timeout: 969 lvb_type: 1 00010000:00010000:3.0:1746140890.615093:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3a6c00/0x8156357b7fdbb5bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2130 expref: 34 pid: 12255 timeout: 969 lvb_type: 1 00010000:00010000:3.0:1746140890.615169:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.615172:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.615179:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.615187:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.615212:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.615222:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576135424:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140890.615272:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140890.615282:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573922944:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11571us (11774us total) trans 17179874244 rc 0/0 00000100:00100000:1.0:1746140890.615292:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1859 00002000:00100000:1.0:1746140890.615301:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1581055) req@ffff88009f2c3100 x1830960573922944/t17179874244(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.615338:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c3100 with x1830960573922944 ext(1048576->1581055) 00010000:00010000:1.0:1746140890.615345:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 43 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.615357:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 43 pid: 8458 timeout: 969 lvb_type: 0 00002000:00010000:1.0:1746140890.615363:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c3100 00000100:00100000:0.0:1746140890.616825:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.616870:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576135424:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140890.616883:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.616900:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573923840 00000100:00100000:2.0:1746140890.616904:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573923840 00000100:00100000:3.0:1746140890.616911:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573923584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1853us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.616919:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9047 00010000:00010000:2.0:1746140890.616926:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 43 pid: 8458 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.616958:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9048 00000100:00100000:3.0:1746140890.616964:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573923840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.616973:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.616989:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 43 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.617015:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 43 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.617097:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e79000/0x8156357b7fdbb688 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1581055) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21b5 expref: 43 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.617110:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.617111:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.617116:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 21 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.617124:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 21 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.617146:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 21 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.617161:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576135552:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140890.617802:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.617889:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.617962:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573924096 00000100:00100000:1.0:1746140890.617987:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573924096 00002000:00100000:1.0:1746140890.618024:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2408448->2412543) req@ffff88012d083800 x1830960573924096/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.618033:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d083800 with x1830960573924096 ext(2408448->2412543) 00002000:00010000:1.0:1746140890.618036:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d083800 00000100:00100000:1.0:1746140890.618233:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8941 00000100:00100000:1.0:1746140890.618240:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573924096:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140890.618404:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573924096:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 164us (519us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140890.618410:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8941 00002000:00100000:1.0:1746140890.618415:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2408448->2412543) req@ffff88012d083800 x1830960573924096/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.618421:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d083800 with x1830960573924096 ext(2408448->2412543) 00002000:00010000:1.0:1746140890.618424:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d083800 00000100:00100000:2.0:1746140890.624129:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.624179:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.624292:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576135552:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140890.624339:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573924224 00010000:00010000:3.0:1746140890.624340:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140890.624345:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573924224 00000100:00100000:3.0:1746140890.624381:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573923840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7416us (7560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140890.624383:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17478 00000100:00100000:3.0:1746140890.624389:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9048 00000100:00100000:0.0:1746140890.624389:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:425:x1830960573924224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140890.624404:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.624420:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2209 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.624471:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573924480 00000100:00100000:1.0:1746140890.624474:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573924480 00010000:00010000:0.0:1746140890.624494:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746140890.624499:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012d080e00 x1830960573924480/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746140890.624502:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140890.624504:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00002000:00100000:1.0:1746140890.624508:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080e00 with x1830960573924480 ext(1048576->2097151) 00010000:00010000:0.0:1746140890.624508:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 43 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140890.624512:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d080e00 00000100:00100000:1.0:1746140890.624531:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8942 00000100:00100000:1.0:1746140890.624536:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1982:x1830960573924480:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746140890.624537:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 22 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.624549:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 22 pid: 8458 timeout: 969 lvb_type: 0 00000100:00100000:0.0:1746140890.624559:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576135680:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140890.624602:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.624654:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.624800:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573924736 00000100:00100000:3.0:1746140890.624804:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573924736 00002000:00100000:3.0:1746140890.624819:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f2c1180 x1830960573924736/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.624826:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1180 with x1830960573924736 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.624829:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1180 00000100:00100000:3.0:1746140890.624851:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8943 00000100:00100000:3.0:1746140890.624856:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573924736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.626017:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.626025:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576135680:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.626042:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 43 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.626053:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5f2c00, rc 0) 00000100:00100000:1.0:1746140890.626083:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:425:x1830960573924224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1693us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.626088:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17478 00000100:00100000:1.0:1746140890.626106:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573924864 00000100:00100000:1.0:1746140890.626109:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573924864 00002000:00100000:1.0:1746140890.626124:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1208319) req@ffff88009f2c3800 x1830960573924864/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.626130:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c3800 with x1830960573924864 ext(1048576->1208319) 00010000:00010000:1.0:1746140890.626135:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 24 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.626145:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 24 pid: 8458 timeout: 969 lvb_type: 0 00002000:00010000:1.0:1746140890.626151:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c3800 00000100:00100000:1.0:1746140890.626168:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1860 00000100:00100000:1.0:1746140890.626174:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573924864:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140890.626891:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.627002:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573925120 00000100:00100000:3.0:1746140890.627006:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573925120 00002000:00100000:3.0:1746140890.627024:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2809856->2813951) req@ffff88009f2c1500 x1830960573925120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.627030:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1500 with x1830960573925120 ext(2809856->2813951) 00002000:00010000:3.0:1746140890.627033:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1500 00000100:00100000:3.0:1746140890.627055:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8944 00000100:00100000:3.0:1746140890.627058:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573925120:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.627150:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960573925120:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 90us (259us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.627155:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8944 00002000:00100000:3.0:1746140890.627160:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2809856->2813951) req@ffff88009f2c1500 x1830960573925120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.627166:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1500 with x1830960573925120 ext(2809856->2813951) 00002000:00010000:3.0:1746140890.627169:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1500 00000100:00100000:1.0:1746140890.630673:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1982:x1830960573924480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6127us (6484us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140890.630686:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8942 00002000:00100000:1.0:1746140890.630698:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012d080e00 x1830960573924480/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.630708:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080e00 with x1830960573924480 ext(1048576->2097151) 00002000:00010000:1.0:1746140890.630714:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d080e00 00000100:00100000:0.0:1746140890.631224:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573924864:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5043us (5201us total) trans 17179874245 rc 0/0 00000100:00100000:0.0:1746140890.631235:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1860 00002000:00100000:0.0:1746140890.631245:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1208319) req@ffff88009f2c3800 x1830960573924864/t17179874245(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140890.631247:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1982:x1830960573924736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6388us (6590us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.631254:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8943 00002000:00100000:0.0:1746140890.631254:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c3800 with x1830960573924864 ext(1048576->1208319) 00002000:00100000:3.0:1746140890.631260:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f2c1180 x1830960573924736/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746140890.631264:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 24 pid: 8458 timeout: 969 lvb_type: 0 00002000:00100000:3.0:1746140890.631268:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1180 with x1830960573924736 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.631277:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1180 00010000:00010000:0.0:1746140890.631279:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 24 pid: 8458 timeout: 969 lvb_type: 0 00002000:00010000:0.0:1746140890.631292:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c3800 00000100:00100000:0.0:1746140890.637759:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.637811:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.637859:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573925248 00000100:00100000:3.0:1746140890.637873:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573925248 00010000:00010000:3.0:1746140890.637917:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 24 pid: 8458 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.637964:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9049 00000100:00100000:3.0:1746140890.637972:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573925248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.637987:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140890.638024:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 24 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.638042:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 24 pid: 8458 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.638062:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f773600/0x8156357b7fdbb68f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21bc expref: 24 pid: 8458 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.638088:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573925376 00010000:00010000:3.0:1746140890.638093:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.638095:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140890.638096:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573925376 00010000:00010000:3.0:1746140890.638102:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 42 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.638111:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 42 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.638136:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17479 00010000:00010000:3.0:1746140890.638143:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 42 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.638144:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:422:x1830960573925376:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140890.638155:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576135808:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140890.638161:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.638177:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2210 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.638207:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.638214:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140890.638215:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140890.638218:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.638240:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00010000:00010000:1.0:1746140890.638246:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.638257:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 32 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.638267:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576135936:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.638373:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.639621:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576135808:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140890.639637:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.639667:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576135936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.639670:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573925248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1699us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.639682:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9049 00010000:00010000:1.0:1746140890.639686:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.639700:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19de00, rc 0) 00000100:00100000:1.0:1746140890.639718:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+29:422:x1830960573925376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1576us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.639723:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17479 00000100:00100000:0.0:1746140890.640815:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.640858:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.640924:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573925760 00000100:00100000:2.0:1746140890.640924:0:8465:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573925504 00000100:00100000:3.0:1746140890.640932:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573925760 00000100:00100000:2.0:1746140890.640932:0:8465:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573925504 00002000:00100000:3.0:1746140890.640964:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f2c2d80 x1830960573925760/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.640964:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2408448->2813951) req@ffff88009f2c0000 x1830960573925504/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.640972:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2d80 with x1830960573925760 ext(1048576->2097151) 00002000:00100000:2.0:1746140890.640972:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0000 with x1830960573925504 ext(2408448->2813951) 00002000:00010000:3.0:1746140890.640976:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c2d80 00010000:00010000:2.0:1746140890.640979:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 33 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.641004:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 33 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.641010:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8945 00002000:00010000:2.0:1746140890.641010:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c0000 00000100:00100000:3.0:1746140890.641015:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573925760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140890.641026:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1861 00000100:00100000:2.0:1746140890.641031:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1985:x1830960573925504:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140890.647292:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573925760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6266us (6473us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.647316:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8945 00002000:00100000:3.0:1746140890.647328:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f2c2d80 x1830960573925760/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.647337:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c2d80 with x1830960573925760 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.647343:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c2d80 00000100:00100000:2.0:1746140890.647638:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573925504:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6605us (6777us total) trans 21474841541 rc 0/0 00000100:00100000:2.0:1746140890.647647:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1861 00002000:00100000:2.0:1746140890.647654:0:8465:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3a3:0x0] (2408448->2813951) req@ffff88009f2c0000 x1830960573925504/t21474841541(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.647662:0:8465:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0000 with x1830960573925504 ext(2408448->2813951) 00010000:00010000:2.0:1746140890.647670:0:8465:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.647685:0:8465:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00002000:00010000:2.0:1746140890.647697:0:8465:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c0000 00000100:00100000:0.0:1746140890.649816:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.649883:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573925888 00000100:00100000:3.0:1746140890.649891:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573925888 00010000:00010000:3.0:1746140890.649921:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.649959:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9050 00000100:00100000:3.0:1746140890.649966:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573925888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140890.649979:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746140890.650003:0:7110:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140890 -> 1746140891 00002000:00010000:3.0:1746140890.650006:0:7110:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140890 -> 1746140891 00010000:00010000:3.0:1746140890.650012:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.650023:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.650044:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f2800/0x8156357b7fdbb737 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->2813951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2202 expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:3.0:1746140890.650074:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.650076:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.650083:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.650090:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.650118:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.650130:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576136064:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140890.650209:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.653413:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.653460:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573926016 00000100:00100000:1.0:1746140890.653468:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573926016 00000100:00100000:3.0:1746140890.653475:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576136064:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140890.653494:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.653522:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17480 00000100:00100000:1.0:1746140890.653530:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:425:x1830960573926016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.653547:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140890.653551:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573925888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3585us (3740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.653560:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9050 00010000:00010000:1.0:1746140890.653563:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2217 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.653589:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.653591:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.653767:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 44 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.653786:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 44 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.653797:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19da00, rc 0) 00000100:00100000:1.0:1746140890.653836:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:425:x1830960573926016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 307us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.653842:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17480 00000100:00100000:0.0:1746140890.657486:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.657517:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.657544:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.657561:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.657581:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.657605:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573926272 00000100:00100000:0.0:1746140890.657613:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573926272 00000100:00100000:2.0:1746140890.657632:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573926528 00000100:00100000:1.0:1746140890.657632:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573926784 00000100:00100000:3.0:1746140890.657633:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573927040 00000100:00100000:3.0:1746140890.657638:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573927040 00000100:00100000:2.0:1746140890.657643:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573926528 00000100:00100000:1.0:1746140890.657643:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573926784 00002000:00100000:0.0:1746140890.657653:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f2c1f80 x1830960573926272/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.657658:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f171180 x1830960573927040/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140890.657663:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1f80 with x1830960573926272 ext(2097152->3145727) 00002000:00100000:3.0:1746140890.657666:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171180 with x1830960573927040 ext(3145728->4194303) 00002000:00010000:0.0:1746140890.657667:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1f80 00002000:00010000:3.0:1746140890.657669:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f171180 00002000:00100000:2.0:1746140890.657680:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f2c3480 x1830960573926528/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.657680:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f2c0a80 x1830960573926784/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746140890.657688:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573927296 00002000:00100000:2.0:1746140890.657689:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c3480 with x1830960573926528 ext(3145728->4194303) 00002000:00100000:1.0:1746140890.657689:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0a80 with x1830960573926784 ext(2097152->3145727) 00000100:00100000:0.0:1746140890.657690:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573927296 00002000:00010000:2.0:1746140890.657693:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c3480 00002000:00010000:1.0:1746140890.657693:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c0a80 00000100:00100000:3.0:1746140890.657695:0:21689:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8946 00002000:00100000:0.0:1746140890.657701:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f173b80 x1830960573927296/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746140890.657702:0:21689:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573927040:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:0.0:1746140890.657707:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173b80 with x1830960573927296 ext(1048576->2097151) 00002000:00010000:0.0:1746140890.657710:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f173b80 00000100:00100000:2.0:1746140890.657726:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8947 00000100:00100000:0.0:1746140890.657731:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8948 00000100:00100000:2.0:1746140890.657733:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1983:x1830960573926272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140890.657737:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8949 00000100:00100000:0.0:1746140890.657738:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960573926784:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140890.657741:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1983:x1830960573926528:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.658910:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8950 00000100:00100000:2.0:1746140890.658919:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573927296:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140890.659007:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.659091:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573927552 00000100:00100000:3.0:1746140890.659096:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573927552 00002000:00100000:3.0:1746140890.659116:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f172680 x1830960573927552/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.659124:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f172680 with x1830960573927552 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.659127:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f172680 00000100:00100000:3.0:1746140890.659143:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8951 00000100:00100000:3.0:1746140890.659148:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573927552:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140890.670299:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1983:x1830960573926272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12559us (12814us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.670342:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8947 00002000:00100000:2.0:1746140890.670353:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f2c1f80 x1830960573926272/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.670362:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c1f80 with x1830960573926272 ext(2097152->3145727) 00002000:00010000:2.0:1746140890.670367:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c1f80 00000100:00100000:1.0:1746140890.670477:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1983:x1830960573926784:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12732us (12924us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140890.670488:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8948 00002000:00100000:1.0:1746140890.670498:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f2c0a80 x1830960573926784/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.670508:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c0a80 with x1830960573926784 ext(2097152->3145727) 00002000:00010000:1.0:1746140890.670513:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c0a80 00000100:00100000:3.0:1746140890.674014:0:21689:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1983:x1830960573927040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16300us (16439us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.674028:0:21689:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8946 00002000:00100000:3.0:1746140890.674041:0:21689:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f171180 x1830960573927040/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.674051:0:21689:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171180 with x1830960573927040 ext(3145728->4194303) 00002000:00010000:3.0:1746140890.674056:0:21689:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f171180 00000100:00100000:1.0:1746140890.676458:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1983:x1830960573926528:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18708us (18931us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140890.676469:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8949 00002000:00100000:1.0:1746140890.676479:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f2c3480 x1830960573926528/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.676488:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c3480 with x1830960573926528 ext(3145728->4194303) 00002000:00010000:1.0:1746140890.676493:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c3480 00000100:00100000:2.0:1746140890.677559:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573927296:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 18636us (19970us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.677567:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8950 00002000:00100000:2.0:1746140890.677573:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009f173b80 x1830960573927296/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.677582:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173b80 with x1830960573927296 ext(1048576->2097151) 00002000:00010000:2.0:1746140890.677585:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f173b80 00000100:00100000:0.0:1746140890.682120:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.682250:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573927680 00000100:00100000:1.0:1746140890.682260:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573927680 00000100:00100000:1.0:1746140890.682323:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17481 00000100:00100000:1.0:1746140890.682330:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:429:x1830960573927680:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140890.682347:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.682364:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a221e expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.682394:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 24 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.682403:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 43 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.682409:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.682411:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.682415:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1843200->2097151] (req 1843200->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 24 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.682445:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 43 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.682457:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 43 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.682469:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576136192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.682552:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 24 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.682561:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 24 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.682569:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576136320:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.682586:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.683378:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.683417:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.683437:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573927808 00000100:00100000:2.0:1746140890.683451:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573927808 00000100:00100000:1.0:1746140890.683479:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573927936 00000100:00100000:1.0:1746140890.683483:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573927936 00000100:00100000:2.0:1746140890.683572:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17482 00000100:00100000:2.0:1746140890.683580:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573927808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140890.683596:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.683611:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2225 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.683630:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.683632:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.683640:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 30 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.683654:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 30 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.683664:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecc5000, rc 0) 00000100:00100000:1.0:1746140890.683831:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17483 00000100:00100000:1.0:1746140890.683837:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573927936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.683845:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.683854:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a222c expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.683871:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.683872:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.683878:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.683891:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 26 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.683899:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d600, rc 0) 00000100:00100000:3.0:1746140890.684833:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573927552:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 25681us (25824us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.684833:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1982:x1830960573927808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1249us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.684840:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17482 00000100:00100000:3.0:1746140890.684846:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8951 00002000:00100000:3.0:1746140890.684856:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f172680 x1830960573927552/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.684865:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f172680 with x1830960573927552 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.684870:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f172680 00000100:00100000:1.0:1746140890.684939:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573927936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1101us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.684944:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17483 00000100:00100000:1.0:1746140890.687176:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576136192:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140890.687190:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12255:1830960576136320:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140890.687217:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1843200->2097151] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.687233:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19d800, rc 0) 00000100:00100000:1.0:1746140890.687278:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+25:429:x1830960573927680:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4948us (5238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.687286:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17481 00000100:00100000:0.0:1746140890.688527:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.688558:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.688597:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.688703:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573928064 00000100:00100000:1.0:1746140890.688711:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573928064 00000100:00100000:2.0:1746140890.688725:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573928448 00000100:00100000:2.0:1746140890.688730:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573928448 00010000:00010000:1.0:1746140890.688742:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 44 pid: 12255 timeout: 969 lvb_type: 0 00002000:00100000:2.0:1746140890.688761:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f171c00 x1830960573928448/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.688778:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171c00 with x1830960573928448 ext(4194304->4886527) 00000100:00100000:1.0:1746140890.688779:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573928192 00002000:00010000:2.0:1746140890.688782:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f171c00 00000100:00100000:1.0:1746140890.688782:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573928192 00010000:00010000:1.0:1746140890.688792:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 25 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.688802:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9051 00000100:00100000:1.0:1746140890.688807:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9052 00000100:00100000:2.0:1746140890.688809:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573928064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140890.688812:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573928192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.688821:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.688823:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.688842:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 44 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.688842:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 25 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.688853:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 44 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.689032:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 25 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.689060:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f19da00/0x8156357b7fdbb74c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2217 expref: 44 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.689065:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b8df600/0x8156357b7fdbb730 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21fb expref: 25 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.689126:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.689129:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.689136:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 24 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.689144:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 24 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.689152:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140890.689182:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 24 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.689185:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573928064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 375us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.689191:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9051 00000100:00100000:1.0:1746140890.689193:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576136448:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140890.689214:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8952 00000100:00100000:2.0:1746140890.689220:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1983:x1830960573928448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140890.689243:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746140890.689747:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140890.690374:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.691118:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573928576 00000100:00100000:2.0:1746140890.691125:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573928576 00000100:00100000:2.0:1746140890.691157:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17484 00000100:00100000:2.0:1746140890.691163:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:425:x1830960573928576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140890.691178:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.691193:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2233 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.691214:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.691216:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.691222:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.691234:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.691242:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecc5400, rc 0) 00000100:00100000:2.0:1746140890.691267:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:425:x1830960573928576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.691271:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17484 00000100:00100000:1.0:1746140890.691419:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576136448:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140890.691432:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.691466:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573928192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2653us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.691473:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9052 00000100:00100000:0.0:1746140890.692434:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.692503:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573928832 00000100:00100000:1.0:1746140890.692507:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573928832 00002000:00100000:1.0:1746140890.692532:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1843200->1847295) req@ffff88009f170380 x1830960573928832/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.692541:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170380 with x1830960573928832 ext(1843200->1847295) 00002000:00010000:1.0:1746140890.692545:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f170380 00000100:00100000:1.0:1746140890.692570:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8953 00000100:00100000:1.0:1746140890.692575:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573928832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140890.692684:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573928832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 109us (252us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140890.692690:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8953 00002000:00100000:1.0:1746140890.692695:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1843200->1847295) req@ffff88009f170380 x1830960573928832/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.692702:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f170380 with x1830960573928832 ext(1843200->1847295) 00002000:00010000:1.0:1746140890.692704:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f170380 00000100:00100000:2.0:1746140890.696370:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1983:x1830960573928448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7141us (7764us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140890.696382:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8952 00002000:00100000:2.0:1746140890.696393:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009f171c00 x1830960573928448/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.696402:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171c00 with x1830960573928448 ext(4194304->4886527) 00002000:00010000:2.0:1746140890.696407:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f171c00 00000100:00100000:0.0:1746140890.699744:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.699845:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573928960 00000100:00100000:2.0:1746140890.699854:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573928960 00000100:00100000:2.0:1746140890.699914:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17485 00000100:00100000:2.0:1746140890.699922:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:429:x1830960573928960:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140890.699942:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.699958:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a223a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.699984:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 34 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.700009:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 31 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.700016:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.700017:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.700021:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1560575] (req 1048576->1560575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.700048:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 31 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.700058:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 31 pid: 8459 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.700069:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576136576:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140890.700277:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 34 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.700286:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 34 pid: 32376 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.700299:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576136704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140890.700620:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.701924:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.701951:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.702018:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573929344 00000100:00100000:2.0:1746140890.702023:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573929344 00000100:00100000:0.0:1746140890.702023:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140890.702055:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f173800 x1830960573929344/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.702064:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173800 with x1830960573929344 ext(2097152->3145727) 00002000:00010000:2.0:1746140890.702068:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f173800 00000100:00100000:2.0:1746140890.702117:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573929472 00000100:00100000:3.0:1746140890.702119:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573929728 00000100:00100000:2.0:1746140890.702120:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573929472 00000100:00100000:3.0:1746140890.702122:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573929728 00002000:00100000:2.0:1746140890.702130:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f171f80 x1830960573929472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.702136:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171f80 with x1830960573929472 ext(3145728->4194303) 00002000:00010000:2.0:1746140890.702138:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f171f80 00002000:00100000:3.0:1746140890.702140:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009edc9180 x1830960573929728/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.702147:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9180 with x1830960573929728 ext(2097152->3145727) 00002000:00010000:3.0:1746140890.702150:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9180 00000100:00100000:0.0:1746140890.702185:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.702205:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8954 00000100:00100000:2.0:1746140890.702210:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573929344:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140890.702258:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8955 00000100:00100000:3.0:1746140890.702263:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573929472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.702865:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.702882:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573930112 00000100:00100000:0.0:1746140890.702885:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573930112 00002000:00100000:0.0:1746140890.702901:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009edc9880 x1830960573930112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140890.702909:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830960573930112 ext(3145728->4194303) 00002000:00010000:0.0:1746140890.702912:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9880 00000100:00100000:0.0:1746140890.702922:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8956 00000100:00100000:0.0:1746140890.702927:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573929728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.703343:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8957 00000100:00100000:2.0:1746140890.703349:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573930112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140890.703414:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573929856 00000100:00100000:1.0:1746140890.703419:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573929856 00000100:00100000:1.0:1746140890.703444:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17486 00000100:00100000:1.0:1746140890.703449:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1982:x1830960573929856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.703458:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.703474:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5569e00/0x8156357b7fdbb776 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2241 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.703493:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.703503:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5569e00/0x8156357b7fdbb776 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2241 expref: 33 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.703512:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5569e00/0x8156357b7fdbb776 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2241 expref: 33 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.703526:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5569e00, rc 0) 00000100:00100000:1.0:1746140890.703558:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1982:x1830960573929856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 108us (1371us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140890.703564:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17486 00000100:00100000:1.0:1746140890.704443:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.704461:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573930240 00000100:00100000:1.0:1746140890.704465:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573930240 00010000:00010000:1.0:1746140890.704480:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 32 pid: 8459 timeout: 969 lvb_type: 1 00000100:00100000:1.0:1746140890.704497:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9053 00000100:00100000:1.0:1746140890.704501:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1982:x1830960573930240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.704513:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.704527:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 32 pid: 8459 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.704536:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 32 pid: 8459 timeout: 969 lvb_type: 1 00010000:00010000:1.0:1746140890.704553:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.704567:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1982:x1830960573930240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.704572:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9053 00010000:00010000:3.0:1746140890.705045:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f823c00/0x8156357b7fdbb5d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2153 expref: 31 pid: 8459 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.705062:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576136576:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.706156:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576136704:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.706179:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->1560575] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.706191:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecc5600, rc 0) 00000100:00100000:3.0:1746140890.706232:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:429:x1830960573928960:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6311us (6497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.706240:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17485 00000100:00100000:0.0:1746140890.713245:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.713440:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573930368 00000100:00100000:2.0:1746140890.713450:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573930368 00010000:00010000:2.0:1746140890.713483:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 39 pid: 32376 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.713519:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9054 00000100:00100000:2.0:1746140890.713527:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573930368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.713539:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.713565:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 39 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.713576:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 39 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.713596:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb5af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2129 expref: 39 pid: 32376 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.713623:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.713625:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.713631:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.713638:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.713671:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.713684:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576136832:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140890.713768:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453600 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.714020:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573929344:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11807us (12097us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.714028:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8954 00002000:00100000:3.0:1746140890.714038:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f173800 x1830960573929344/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.714047:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f173800 with x1830960573929344 ext(2097152->3145727) 00002000:00010000:3.0:1746140890.714050:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f173800 00000100:00100000:3.0:1746140890.714256:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573929472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11992us (12303us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.714261:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8955 00002000:00100000:3.0:1746140890.714265:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f171f80 x1830960573929472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.714271:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f171f80 with x1830960573929472 ext(3145728->4194303) 00002000:00010000:3.0:1746140890.714273:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f171f80 00000100:00100000:0.0:1746140890.718331:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.718398:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573930624 00000100:00100000:3.0:1746140890.718407:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573930624 00000100:00100000:3.0:1746140890.718445:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4788 00000100:00100000:3.0:1746140890.718452:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:422:x1830960573930624:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140890.718703:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573930112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15351us (15835us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.718713:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8957 00002000:00100000:2.0:1746140890.718721:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009edc9880 x1830960573930112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.718730:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9880 with x1830960573930112 ext(3145728->4194303) 00002000:00010000:2.0:1746140890.718735:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9880 00000100:00100000:2.0:1746140890.718781:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576136832:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140890.718798:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.718827:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573930368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5302us (5590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.718835:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9054 00000100:00100000:3.0:1746140890.719052:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:422:x1830960573930624:12345-192.168.204.16@tcp:35:cat.0 Request processed in 599us (750us total) trans 8589945187 rc 0/0 00000100:00100000:3.0:1746140890.719058:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4788 00000100:00100000:2.0:1746140890.720550:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573929728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17619us (18523us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.720559:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8956 00002000:00100000:2.0:1746140890.720567:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009edc9180 x1830960573929728/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.720575:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc9180 with x1830960573929728 ext(2097152->3145727) 00002000:00010000:2.0:1746140890.720579:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009edc9180 00000100:00100000:0.0:1746140890.725138:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.725231:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573930880 00000100:00100000:2.0:1746140890.725240:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573930880 00002000:00100000:2.0:1746140890.725284:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1556480->1560575) req@ffff88009edc8000 x1830960573930880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.725294:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8000 with x1830960573930880 ext(1556480->1560575) 00002000:00010000:2.0:1746140890.725299:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8000 00000100:00100000:2.0:1746140890.725354:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8958 00000100:00100000:2.0:1746140890.725362:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573930880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.725531:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573930880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 170us (400us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140890.725538:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8958 00002000:00100000:2.0:1746140890.725543:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1556480->1560575) req@ffff88009edc8000 x1830960573930880/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.725549:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8000 with x1830960573930880 ext(1556480->1560575) 00002000:00010000:2.0:1746140890.725552:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8000 00000100:00100000:0.0:1746140890.728174:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.728215:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.728255:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.728341:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573931136 00000100:00100000:1.0:1746140890.728341:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573931264 00000100:00100000:3.0:1746140890.728348:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573931136 00000100:00100000:1.0:1746140890.728348:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573931264 00000100:00100000:1.0:1746140890.728376:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573931392 00000100:00100000:1.0:1746140890.728378:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573931392 00000100:00100000:3.0:1746140890.728382:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4789 00000100:00100000:3.0:1746140890.728388:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:429:x1830960573931136:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140890.728392:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17487 00000100:00100000:1.0:1746140890.728397:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573931264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.728408:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.728424:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8d800/0x8156357b7fdbb77d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2248 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.728431:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17488 00000100:00100000:2.0:1746140890.728439:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573931392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140890.728448:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140890.728463:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576136960:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140890.728468:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecc4a00/0x8156357b7fdbb784 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a224f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.728509:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576137088:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140890.728520:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.728533:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.728560:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:429:x1830960573931136:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 172us (393us total) trans 8589945188 rc 0/0 00000100:00100000:3.0:1746140890.728566:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4789 00002000:00010000:1.0:1746140890.729821:0:24958:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140890 -> 1746140891 00000100:00100000:1.0:1746140890.729838:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576136960:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140890.729857:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8d800/0x8156357b7fdbb77d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2248 expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.729868:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8d800/0x8156357b7fdbb77d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2248 expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140890.729898:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8d800, rc 0) 00000100:00100000:1.0:1746140890.729925:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573931264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1527us (1709us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140890.729931:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17487 00002000:00010000:2.0:1746140890.730030:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140890 -> 1746140891 00002000:00010000:2.0:1746140890.730033:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140890 -> 1746140891 00002000:00010000:2.0:1746140890.730034:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140890 -> 1746140891 00000100:00100000:2.0:1746140890.730047:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576137088:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140890.730063:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecc4a00/0x8156357b7fdbb784 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a224f expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.730078:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc4a00/0x8156357b7fdbb784 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a224f expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.730088:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecc4a00, rc 0) 00000100:00100000:2.0:1746140890.730107:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573931392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1670us (1852us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140890.730113:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17488 00000100:00100000:0.0:1746140890.734218:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.734371:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573931648 00000100:00100000:2.0:1746140890.734385:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573931648 00002000:00100000:2.0:1746140890.734692:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009edc8e00 x1830960573931648/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.734702:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8e00 with x1830960573931648 ext(4194304->4886527) 00002000:00010000:2.0:1746140890.734707:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8e00 00000100:00100000:2.0:1746140890.734739:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8959 00000100:00100000:2.0:1746140890.734747:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573931648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140890.739621:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573931648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4867us (5406us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140890.739633:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8959 00002000:00100000:2.0:1746140890.739642:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009edc8e00 x1830960573931648/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.739651:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009edc8e00 with x1830960573931648 ext(4194304->4886527) 00002000:00010000:2.0:1746140890.739656:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009edc8e00 00000100:00100000:0.0:1746140890.745370:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.745421:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.745520:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573931776 00000100:00100000:1.0:1746140890.745528:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573931776 00000100:00100000:2.0:1746140890.745556:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573931904 00000100:00100000:2.0:1746140890.745561:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573931904 00000100:00100000:1.0:1746140890.745564:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17489 00000100:00100000:1.0:1746140890.745571:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573931776:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140890.745581:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17490 00000100:00100000:2.0:1746140890.745586:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573931904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.745586:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.745593:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.745600:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8d600/0x8156357b7fdbb78b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2256 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.745602:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecc4400/0x8156357b7fdbb792 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a225d expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.745638:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576137344:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140890.745638:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576137216:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140890.745721:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.745723:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.746819:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.746896:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576137344:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140890.746915:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecc4400/0x8156357b7fdbb792 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a225d expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140890.746924:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573932160 00010000:00010000:2.0:1746140890.746926:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc4400/0x8156357b7fdbb792 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a225d expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140890.746929:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573932160 00010000:00010000:2.0:1746140890.746948:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecc4400, rc 0) 00000100:00100000:3.0:1746140890.746956:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10861 00000100:00100000:3.0:1746140890.746961:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:434:x1830960573932160:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:2.0:1746140890.746969:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573931904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1383us (1549us total) trans 0 rc 301/301 00010000:00010000:3.0:1746140890.746974:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140890.746975:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17490 00010000:00010000:3.0:1746140890.746985:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb799 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2264 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.747083:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747094:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140890.747103:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576137216:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140890.747105:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.747115:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8d600/0x8156357b7fdbb78b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2256 expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.747116:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747121:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.747123:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8d600/0x8156357b7fdbb78b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2256 expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.747126:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140890.747146:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8d600, rc 0) 00000100:00100000:1.0:1746140890.747168:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573931776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1599us (1807us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140890.747173:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17489 00010000:00010000:3.0:1746140890.747218:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747231:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747237:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140890.747244:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140890.747352:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747358:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747364:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747369:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.747372:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747379:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747389:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140890.747391:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.747394:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747399:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747425:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747430:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747434:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747438:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.747441:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747445:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747451:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a47f2100) 00010000:00010000:3.0:1746140890.747453:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.747460:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747464:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb7a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.747496:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 274 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.747505:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 273 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.747510:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.747513:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140890.747515:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fac00, rc 0) 00000100:00100000:3.0:1746140890.747537:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:434:x1830960573932160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 575us (718us total) trans 8589945189 rc 0/0 00000100:00100000:3.0:1746140890.747542:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10861 00000100:00100000:0.0:1746140890.748628:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.748735:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573932544 00000100:00100000:3.0:1746140890.748740:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573932544 00000100:00100000:3.0:1746140890.748781:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4790 00000100:00100000:3.0:1746140890.748787:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:434:x1830960573932544:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140890.749464:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:434:x1830960573932544:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 675us (838us total) trans 8589945190 rc 0/0 00000100:00100000:3.0:1746140890.749471:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4790 00000100:00100000:0.0:1746140890.750392:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.750422:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573932288 00000100:00100000:0.0:1746140890.750425:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.750428:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573932288 00000100:00100000:1.0:1746140890.750448:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573932672 00000100:00100000:1.0:1746140890.750449:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573932672 00000100:00100000:0.0:1746140890.750460:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17491 00000100:00100000:1.0:1746140890.750465:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17492 00000100:00100000:0.0:1746140890.750467:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573932288:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140890.750470:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573932672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.750479:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.750479:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.750493:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8d200/0x8156357b7fdbb7c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2272 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.750493:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b600/0x8156357b7fdbb7bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a226b expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.750531:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576137600:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140890.750531:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576137472:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140890.750733:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.750772:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.753119:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576137472:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140890.753145:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b600/0x8156357b7fdbb7bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a226b expref: 44 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.753156:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b600/0x8156357b7fdbb7bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a226b expref: 44 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140890.753189:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe0b600, rc 0) 00000100:00100000:0.0:1746140890.753223:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573932288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2756us (2833us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140890.753229:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17491 00000100:00100000:3.0:1746140890.753393:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576137600:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140890.753408:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a8d200/0x8156357b7fdbb7c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2272 expref: 35 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.753419:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8d200/0x8156357b7fdbb7c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2272 expref: 35 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.753427:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8d200, rc 0) 00000100:00100000:3.0:1746140890.753444:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1985:x1830960573932672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2973us (3018us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140890.753449:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17492 00000100:00100000:0.0:1746140890.757229:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.757285:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573932800 00000100:00100000:3.0:1746140890.757293:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573932800 00000100:00100000:3.0:1746140890.757368:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17493 00000100:00100000:3.0:1746140890.757376:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:434:x1830960573932800:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140890.757393:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.757408:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2279 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.757434:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.757442:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 29 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.757449:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.757451:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.757454:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [61440->245759] (req 61440->245759) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 35 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.757480:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 29 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.757492:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 29 pid: 8458 timeout: 969 lvb_type: 1 00000100:00100000:3.0:1746140890.757504:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576137728:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.757939:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.757947:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.757956:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576137856:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.757984:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.758120:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.758218:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573933056 00000100:00100000:3.0:1746140890.758223:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573933056 00000100:00100000:3.0:1746140890.758243:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4791 00000100:00100000:3.0:1746140890.758248:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+274:425:x1830960573933056:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140890.758611:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:425:x1830960573933056:12345-192.168.204.16@tcp:35:cat.0 Request processed in 173us (303us total) trans 8589945191 rc 0/0 00000100:00100000:3.0:1746140890.758618:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4791 00000100:00100000:3.0:1746140890.759334:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576137728:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.759342:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576137856:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.759358:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [61440->245759] (req 61440->245759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 35 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.759371:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbe00, rc 0) 00000100:00100000:3.0:1746140890.759403:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:434:x1830960573932800:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2028us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.759409:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17493 00000100:00100000:0.0:1746140890.759591:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.759636:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573933184 00000100:00100000:2.0:1746140890.759641:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573933184 00010000:00010000:2.0:1746140890.759658:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 30 pid: 8458 timeout: 969 lvb_type: 1 00000100:00100000:2.0:1746140890.759687:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9055 00000100:00100000:2.0:1746140890.759693:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573933184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.759701:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.759716:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 30 pid: 8458 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.759729:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 30 pid: 8458 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.759745:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5000/0x8156357b7fdbb75a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2225 expref: 30 pid: 8458 timeout: 969 lvb_type: 1 00010000:00010000:2.0:1746140890.759757:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.759781:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573933184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.759787:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9055 00000100:00100000:0.0:1746140890.760602:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.760662:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573933312 00000100:00100000:2.0:1746140890.760665:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573933312 00010000:00010000:2.0:1746140890.760678:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:2.0:1746140890.760700:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9056 00000100:00100000:2.0:1746140890.760704:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573933312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.760709:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.760716:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.760722:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.760732:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbb706 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21ed expref: 35 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.760738:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.760739:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140890.760744:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.760749:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.760765:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.760772:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576137984:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140890.760828:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.761831:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576137984:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140890.761845:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.761873:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573933312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1167us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.761880:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9056 00000100:00100000:0.0:1746140890.762013:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.762098:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573933568 00000100:00100000:3.0:1746140890.762103:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573933568 00002000:00100000:3.0:1746140890.762132:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (61440->65535) req@ffff88009fc34e00 x1830960573933568/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.762141:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34e00 with x1830960573933568 ext(61440->65535) 00002000:00010000:3.0:1746140890.762146:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34e00 00000100:00100000:3.0:1746140890.762159:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8960 00000100:00100000:3.0:1746140890.762165:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573933568:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.762297:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1983:x1830960573933568:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 132us (284us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.762321:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8960 00002000:00100000:3.0:1746140890.762327:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (61440->65535) req@ffff88009fc34e00 x1830960573933568/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.762334:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34e00 with x1830960573933568 ext(61440->65535) 00002000:00010000:3.0:1746140890.762337:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34e00 00000100:00100000:0.0:1746140890.765062:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.765230:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573933824 00000100:00100000:2.0:1746140890.765239:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573933824 00002000:00100000:2.0:1746140890.765275:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (241664->245759) req@ffff88009fc37800 x1830960573933824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.765290:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37800 with x1830960573933824 ext(241664->245759) 00002000:00010000:2.0:1746140890.765295:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc37800 00000100:00100000:2.0:1746140890.765351:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8961 00000100:00100000:2.0:1746140890.765359:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1982:x1830960573933824:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140890.765583:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1982:x1830960573933824:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 223us (527us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140890.765590:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8961 00002000:00100000:2.0:1746140890.765595:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (241664->245759) req@ffff88009fc37800 x1830960573933824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.765602:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37800 with x1830960573933824 ext(241664->245759) 00002000:00010000:2.0:1746140890.765606:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc37800 00000100:00100000:0.0:1746140890.837208:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.837395:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573934080 00000100:00100000:3.0:1746140890.837405:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573934080 00000100:00100000:3.0:1746140890.837458:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10862 00000100:00100000:3.0:1746140890.837464:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:439:x1830960573934080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.837485:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.837502:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb7d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2280 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.837611:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837622:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837631:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837641:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837647:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837652:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837742:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb7e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837748:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837753:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140890.837762:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140890.837830:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837836:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837841:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837845:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fae00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.837848:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837853:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837861:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140890.837864:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.837867:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.837872:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbb7d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.838524:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.838532:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.838551:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.838556:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fbc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.838558:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.838568:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.838577:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a47f2d00) 00010000:00010000:3.0:1746140890.838579:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.838581:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.838586:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb7df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.838631:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb7d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2280 expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.838646:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2280 expref: 15 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.838652:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.838654:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140890.838656:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb000, rc 0) 00000100:00100000:3.0:1746140890.838706:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:439:x1830960573934080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1242us (1508us total) trans 8589945192 rc 0/0 00000100:00100000:3.0:1746140890.838713:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10862 00000100:00100000:0.0:1746140890.843516:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.843735:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.843800:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573934336 00000100:00100000:3.0:1746140890.843810:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573934336 00000100:00100000:2.0:1746140890.843823:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573934208 00000100:00100000:2.0:1746140890.843834:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573934208 00000100:00100000:3.0:1746140890.843861:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17494 00000100:00100000:3.0:1746140890.843868:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573934336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.843884:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.843899:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb7f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2287 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.843949:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138112:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140890.844042:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:2.0:1746140890.845069:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 789 00000100:00100000:2.0:1746140890.845080:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960573934208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140890.845096:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140890.845120:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb7e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2280 expref: 15 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140890.845146:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140890.845151:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140890.845195:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573934208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140890.845201:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 789 00000100:00100000:3.0:1746140890.845268:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138112:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140890.845289:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb7f4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2287 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.845300:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb7f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2287 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.845341:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb800, rc 0) 00000100:00100000:3.0:1746140890.845363:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573934336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1496us (1629us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140890.845369:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17494 00000100:00100000:0.0:1746140890.851429:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.851522:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573934464 00000100:00100000:3.0:1746140890.851532:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573934464 00000100:00100000:3.0:1746140890.851588:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17495 00000100:00100000:3.0:1746140890.851596:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:439:x1830960573934464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.851614:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.851631:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a228e expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.851662:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.851669:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.851671:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.851674:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 30 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.851703:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 33 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.851715:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 33 pid: 24958 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.851732:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138240:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.851815:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.855766:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.855890:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138240:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.855919:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 30 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.855936:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb600, rc 0) 00000100:00100000:2.0:1746140890.856174:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573934592 00000100:00100000:2.0:1746140890.856180:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573934592 00002000:00100000:2.0:1746140890.856218:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (61440->245759) req@ffff88009fc37100 x1830960573934592/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.856227:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37100 with x1830960573934592 ext(61440->245759) 00010000:00010000:2.0:1746140890.856234:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 34 pid: 24958 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.856246:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 34 pid: 24958 timeout: 969 lvb_type: 0 00002000:00010000:2.0:1746140890.856251:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc37100 00000100:00100000:2.0:1746140890.856271:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1862 00000100:00100000:2.0:1746140890.856278:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960573934592:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140890.856518:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:439:x1830960573934464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4922us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.856524:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17495 00000100:00100000:2.0:1746140890.861999:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573934592:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5702us (6224us total) trans 21474841542 rc 0/0 00000100:00100000:2.0:1746140890.862013:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1862 00002000:00100000:2.0:1746140890.862025:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (61440->245759) req@ffff88009fc37100 x1830960573934592/t21474841542(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.862035:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37100 with x1830960573934592 ext(61440->245759) 00010000:00010000:2.0:1746140890.862045:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 36 pid: 24958 timeout: 969 lvb_type: 0 00010000:00010000:2.0:1746140890.862061:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 36 pid: 24958 timeout: 969 lvb_type: 0 00002000:00010000:2.0:1746140890.862073:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc37100 00000100:00100000:0.0:1746140890.863847:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.863935:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573934720 00000100:00100000:1.0:1746140890.863944:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573934720 00010000:00010000:1.0:1746140890.863979:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 36 pid: 24958 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.864096:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9057 00000100:00100000:1.0:1746140890.864103:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573934720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.864116:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.864136:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 36 pid: 24958 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.864153:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 36 pid: 24958 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.864172:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb7ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->245759) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2279 expref: 36 pid: 24958 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.864200:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.864202:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.864208:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 29 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.864216:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 29 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.864242:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 29 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.864253:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576138368:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.864818:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059900 going to sleep for 11 seconds 00000100:00100000:1.0:1746140890.866171:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576138368:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140890.866188:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.866229:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573934720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2125us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.866239:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9057 00000100:00100000:0.0:1746140890.873687:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.873799:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.873904:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573934976 00000100:00100000:2.0:1746140890.873913:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573934976 00002000:00100000:2.0:1746140890.873954:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc34a80 x1830960573934976/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.873964:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34a80 with x1830960573934976 ext(0->1048575) 00002000:00010000:2.0:1746140890.873969:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34a80 00000100:00100000:2.0:1746140890.873997:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573935232 00000100:00100000:2.0:1746140890.874000:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573935232 00002000:00100000:2.0:1746140890.874014:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc37b80 x1830960573935232/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.874021:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37b80 with x1830960573935232 ext(1048576->2097151) 00002000:00010000:2.0:1746140890.874024:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc37b80 00000100:00100000:2.0:1746140890.874036:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8962 00000100:00100000:2.0:1746140890.874041:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573934976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140890.874685:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8963 00000100:00100000:3.0:1746140890.874700:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573935232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140890.875570:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.875590:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573935488 00000100:00100000:0.0:1746140890.875594:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573935488 00002000:00100000:0.0:1746140890.875617:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1843199) req@ffff88009fc37480 x1830960573935488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140890.876164:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37480 with x1830960573935488 ext(1048576->1843199) 00002000:00010000:0.0:1746140890.876171:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc37480 00000100:00100000:0.0:1746140890.876201:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8964 00000100:00100000:0.0:1746140890.876210:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573935488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140890.877158:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.877255:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573935744 00000100:00100000:3.0:1746140890.877264:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573935744 00002000:00100000:3.0:1746140890.877297:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1560576->2097151) req@ffff880093131f80 x1830960573935744/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.877331:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131f80 with x1830960573935744 ext(1560576->2097151) 00002000:00010000:3.0:1746140890.877336:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093131f80 00000100:00100000:3.0:1746140890.877360:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8965 00000100:00100000:3.0:1746140890.877364:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1985:x1830960573935744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140890.886685:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.886785:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573936000 00000100:00100000:3.0:1746140890.886798:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573936000 00000100:00100000:3.0:1746140890.886852:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10863 00000100:00100000:3.0:1746140890.887036:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:441:x1830960573936000:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140890.887060:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.887076:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2295 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.887354:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887369:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887381:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887398:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887404:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887410:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887525:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb817 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887536:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb817 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887543:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb817 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140890.887553:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140890.887643:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887650:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887656:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887661:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.887664:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887670:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887681:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140890.887683:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.887687:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887691:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb809 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887740:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887746:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887750:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887754:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140890.887756:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887761:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887769:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a47f2100) 00010000:00010000:3.0:1746140890.887771:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140890.887773:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887777:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb810 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140890.887827:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2295 expref: 278 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.887969:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1985:x1830960573934976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13924us (14489us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140890.887979:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8962 00002000:00100000:2.0:1746140890.888004:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc34a80 x1830960573934976/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.888014:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34a80 with x1830960573934976 ext(0->1048575) 00002000:00010000:2.0:1746140890.888019:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34a80 00010000:00010000:3.0:1746140890.889052:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb817 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2295 expref: 277 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.889060:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140890.889062:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140890.889065:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb000, rc 0) 00000100:00100000:3.0:1746140890.889126:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:441:x1830960573936000:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2266us (2451us total) trans 8589945193 rc 0/0 00000100:00100000:3.0:1746140890.889134:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10863 00000100:00100000:1.0:1746140890.891376:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573935488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15160us (15800us total) trans 0 rc 794624/794624 00000100:00100000:1.0:1746140890.891386:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8964 00002000:00100000:1.0:1746140890.891396:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1843199) req@ffff88009fc37480 x1830960573935488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 794624/794624 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140890.891405:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37480 with x1830960573935488 ext(1048576->1843199) 00002000:00010000:1.0:1746140890.891410:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc37480 00000100:00100000:3.0:1746140890.891485:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1984:x1830960573935232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16789us (17684us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.891492:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8963 00002000:00100000:3.0:1746140890.891498:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc37b80 x1830960573935232/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.891509:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37b80 with x1830960573935232 ext(1048576->2097151) 00002000:00010000:3.0:1746140890.891513:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc37b80 00000100:00100000:3.0:1746140890.892320:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573935744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14936us (15146us total) trans 0 rc 536576/536576 00000100:00100000:3.0:1746140890.892328:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8965 00002000:00100000:3.0:1746140890.892334:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1560576->2097151) req@ffff880093131f80 x1830960573935744/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 536576/536576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.892341:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131f80 with x1830960573935744 ext(1560576->2097151) 00002000:00010000:3.0:1746140890.892344:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093131f80 00000100:00100000:0.0:1746140890.894916:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.894967:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.895149:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573936256 00000100:00100000:3.0:1746140890.895162:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573936256 00000100:00100000:3.0:1746140890.895225:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4792 00000100:00100000:3.0:1746140890.895232:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:441:x1830960573936256:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140890.895242:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573936384 00000100:00100000:1.0:1746140890.895250:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573936384 00000100:00100000:1.0:1746140890.895299:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 790 00000100:00100000:1.0:1746140890.895323:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1985:x1830960573936384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.895336:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.895357:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb817 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2295 expref: 278 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.895376:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.895381:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.895654:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1985:x1830960573936384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 348us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.895661:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 790 00000100:00100000:3.0:1746140890.895807:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:441:x1830960573936256:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 573us (897us total) trans 8589945194 rc 0/0 00000100:00100000:3.0:1746140890.895815:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4792 00000100:00100000:0.0:1746140890.901001:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.901087:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573936512 00000100:00100000:3.0:1746140890.901099:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573936512 00000100:00100000:3.0:1746140890.901523:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17496 00000100:00100000:3.0:1746140890.901532:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:441:x1830960573936512:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140890.901550:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.901567:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a229c expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.901602:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.901610:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.901616:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.901619:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.901622:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2834432->2953215] (req 2834432->2953215) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.901656:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.901668:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 36 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.901680:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138496:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.902874:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.902890:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 29 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:3.0:1746140890.902900:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138624:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.902952:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.905025:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138496:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.905037:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138624:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.905063:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2834432->2953215] (req 2834432->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 36 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.905082:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa200, rc 0) 00000100:00100000:3.0:1746140890.905125:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:441:x1830960573936512:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3594us (4150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.905133:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17496 00000100:00100000:0.0:1746140890.905732:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.905806:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573936640 00000100:00100000:1.0:1746140890.905813:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573936640 00010000:00010000:1.0:1746140890.905961:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 36 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.906003:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9058 00000100:00100000:1.0:1746140890.906010:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573936640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.906022:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.906044:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 36 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.906054:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 36 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.906232:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5400/0x8156357b7fdbb768 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2233 expref: 36 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.906262:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.906539:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1984:x1830960573936640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 528us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.906546:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9058 00000100:00100000:0.0:1746140890.907230:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.907297:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573936896 00000100:00100000:3.0:1746140890.907301:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573936896 00000100:00100000:3.0:1746140890.907354:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4793 00000100:00100000:3.0:1746140890.907359:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:439:x1830960573936896:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140890.907526:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+15:439:x1830960573936896:12345-192.168.204.16@tcp:35:cat.0 Request processed in 166us (295us total) trans 8589945195 rc 0/0 00000100:00100000:3.0:1746140890.907536:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4793 00000100:00100000:0.0:1746140890.908287:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.908523:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573937024 00000100:00100000:1.0:1746140890.908528:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573937024 00010000:00010000:1.0:1746140890.908547:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 30 pid: 12255 timeout: 969 lvb_type: 0 00000100:00100000:1.0:1746140890.908583:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9059 00000100:00100000:1.0:1746140890.908589:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573937024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.908599:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.908618:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 30 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.908633:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 30 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.908651:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f19de00/0x8156357b7fdbb745 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2210 expref: 30 pid: 12255 timeout: 969 lvb_type: 0 00010000:00010000:1.0:1746140890.908661:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.908663:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.908670:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.908678:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.908707:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.908719:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576138752:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.908789:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.910387:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.910442:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573937280 00000100:00100000:3.0:1746140890.910450:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573937280 00000100:00100000:1.0:1746140890.910536:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576138752:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140890.910557:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.910607:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573937024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2017us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.910617:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9059 00002000:00100000:3.0:1746140890.910700:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2834432->2838527) req@ffff88009fc34000 x1830960573937280/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.910709:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34000 with x1830960573937280 ext(2834432->2838527) 00002000:00010000:3.0:1746140890.910713:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34000 00000100:00100000:3.0:1746140890.910741:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8966 00000100:00100000:3.0:1746140890.910747:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573937280:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.910906:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573937280:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 158us (524us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.910912:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8966 00002000:00100000:3.0:1746140890.910917:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2834432->2838527) req@ffff88009fc34000 x1830960573937280/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.910925:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34000 with x1830960573937280 ext(2834432->2838527) 00002000:00010000:3.0:1746140890.910928:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34000 00000100:00100000:0.0:1746140890.914114:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.914217:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573937536 00000100:00100000:2.0:1746140890.914230:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573937536 00002000:00100000:2.0:1746140890.914277:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2949120->2953215) req@ffff88009fc35180 x1830960573937536/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.914287:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35180 with x1830960573937536 ext(2949120->2953215) 00002000:00010000:2.0:1746140890.914292:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc35180 00000100:00100000:2.0:1746140890.914367:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8967 00000100:00100000:2.0:1746140890.914375:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573937536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140890.914547:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1983:x1830960573937536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 172us (439us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140890.914554:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8967 00002000:00100000:2.0:1746140890.914560:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2949120->2953215) req@ffff88009fc35180 x1830960573937536/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.914567:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc35180 with x1830960573937536 ext(2949120->2953215) 00002000:00010000:2.0:1746140890.914570:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc35180 00000100:00100000:3.0:1746140890.943469:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.943583:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573937792 00000100:00100000:0.0:1746140890.943592:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573937792 00000100:00100000:0.0:1746140890.943644:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10864 00000100:00100000:0.0:1746140890.943651:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:445:x1830960573937792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140890.943671:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.943687:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a800/0x8156357b7fdbb82c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22a3 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.943785:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.943797:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.943809:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.943820:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.943829:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.943835:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.943929:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbb841 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.943937:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbb841 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.943942:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbb841 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:0.0:1746140890.943950:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140890.944037:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944044:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944049:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944054:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe0a400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140890.944057:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944063:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944074:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140890.944077:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140890.944081:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944085:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbb833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944112:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944117:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944122:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944126:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe0ba00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140890.944128:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944132:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944137:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800936f8c00) 00010000:00010000:0.0:1746140890.944139:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140890.944141:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944145:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ba00/0x8156357b7fdbb83a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:0.0:1746140890.944177:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a800/0x8156357b7fdbb82c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22a3 expref: 18 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.944190:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbb841 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22a3 expref: 17 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140890.944196:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140890.944197:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746140890.944200:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe0a600, rc 0) 00000100:00100000:0.0:1746140890.944248:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:445:x1830960573937792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 597us (790us total) trans 8589945196 rc 0/0 00000100:00100000:0.0:1746140890.944254:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10864 00000100:00100000:0.0:1746140890.945513:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.945816:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573937920 00000100:00100000:1.0:1746140890.945823:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573937920 00000100:00100000:1.0:1746140890.945875:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 791 00000100:00100000:1.0:1746140890.945882:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960573937920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.945893:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.945907:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbb841 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22a3 expref: 17 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.946174:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.946179:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.946223:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960573937920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 341us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.946229:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 791 00000100:00100000:0.0:1746140890.959927:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.960040:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573938048 00000100:00100000:3.0:1746140890.960050:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573938048 00000100:00100000:3.0:1746140890.960102:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17497 00000100:00100000:3.0:1746140890.960109:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:445:x1830960573938048:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140890.960126:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.960144:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22aa expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.960175:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.960182:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.960183:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.960186:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2215936->2588671] (req 2215936->2588671) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 30 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.960213:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 34 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.960234:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 34 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140890.960246:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138880:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.960367:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.961422:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576138880:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.961445:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2215936->2588671] (req 2215936->2588671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 30 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.961461:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa000, rc 0) 00000100:00100000:3.0:1746140890.961518:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:445:x1830960573938048:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1408us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.961525:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17497 00000100:00100000:0.0:1746140890.962165:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.962259:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573938176 00000100:00100000:2.0:1746140890.962266:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573938176 00002000:00100000:2.0:1746140890.962302:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2834432->2953215) req@ffff88009fc08700 x1830960573938176/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.962341:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08700 with x1830960573938176 ext(2834432->2953215) 00010000:00010000:2.0:1746140890.962349:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 35 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140890.962362:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 35 pid: 24958 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140890.962374:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc08700 00000100:00100000:2.0:1746140890.962398:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1863 00000100:00100000:2.0:1746140890.962405:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+35:1985:x1830960573938176:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140890.964392:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573938176:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1981us (2224us total) trans 21474841543 rc 0/0 00000100:00100000:2.0:1746140890.964401:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1863 00002000:00100000:2.0:1746140890.964409:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2834432->2953215) req@ffff88009fc08700 x1830960573938176/t21474841543(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140890.964417:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08700 with x1830960573938176 ext(2834432->2953215) 00010000:00010000:2.0:1746140890.964425:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140890.964438:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140890.964444:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc08700 00000100:00100000:0.0:1746140890.966649:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.966773:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573938304 00000100:00100000:1.0:1746140890.966785:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573938304 00010000:00010000:1.0:1746140890.966820:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140890.966864:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9060 00000100:00100000:1.0:1746140890.966871:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573938304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.966885:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.966903:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140890.966913:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140890.966936:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb825 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2953215) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a229c expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140890.966969:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.966971:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140890.966978:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 29 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.966996:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 29 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.967026:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 29 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140890.967037:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576139008:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140890.967187:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140890.968679:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576139008:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140890.968698:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.968733:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573938304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1863us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.968742:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9060 00000100:00100000:0.0:1746140890.969359:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.969466:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573938560 00000100:00100000:3.0:1746140890.969472:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573938560 00002000:00100000:3.0:1746140890.969505:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2215936->2220031) req@ffff88009fc0b480 x1830960573938560/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.969514:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0b480 with x1830960573938560 ext(2215936->2220031) 00002000:00010000:3.0:1746140890.969518:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc0b480 00000100:00100000:3.0:1746140890.969532:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8968 00000100:00100000:3.0:1746140890.969538:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573938560:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.969681:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573938560:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 142us (322us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.969690:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8968 00002000:00100000:3.0:1746140890.969695:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2215936->2220031) req@ffff88009fc0b480 x1830960573938560/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.969700:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0b480 with x1830960573938560 ext(2215936->2220031) 00002000:00010000:3.0:1746140890.969703:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc0b480 00000100:00100000:0.0:1746140890.972840:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.972904:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573938816 00000100:00100000:3.0:1746140890.972912:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573938816 00002000:00100000:3.0:1746140890.973004:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2584576->2588671) req@ffff88009fc08a80 x1830960573938816/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.973012:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08a80 with x1830960573938816 ext(2584576->2588671) 00002000:00010000:3.0:1746140890.973017:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc08a80 00000100:00100000:3.0:1746140890.973046:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8969 00000100:00100000:3.0:1746140890.973053:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573938816:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140890.973332:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573938816:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 249us (472us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140890.973342:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8969 00002000:00100000:3.0:1746140890.973350:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2584576->2588671) req@ffff88009fc08a80 x1830960573938816/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.973360:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08a80 with x1830960573938816 ext(2584576->2588671) 00002000:00010000:3.0:1746140890.973364:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc08a80 00000100:00100000:0.0:1746140890.974166:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.974221:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573939072 00000100:00100000:2.0:1746140890.974228:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573939072 00000100:00100000:0.0:1746140890.974642:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140890.974747:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10865 00000100:00100000:1.0:1746140890.974755:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:449:x1830960573939072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140890.975035:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140890.975053:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d200/0x8156357b7fdbb856 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22b1 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.975217:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975228:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975236:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975246:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975250:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975254:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975348:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb86b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975355:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb86b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975359:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb86b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:1.0:1746140890.975365:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140890.975424:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975429:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975434:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975441:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8c800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140890.975444:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975449:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975457:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140890.975459:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140890.975462:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975466:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb85d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975486:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975490:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975494:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975497:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8d600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140890.975499:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975502:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975507:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630ad00) 00010000:00010000:1.0:1746140890.975508:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140890.975510:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975514:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d600/0x8156357b7fdbb864 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140890.975541:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d200/0x8156357b7fdbb856 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b1 expref: 280 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.975550:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb86b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b1 expref: 279 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.975556:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.975558:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746140890.975560:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8d400, rc 0) 00000100:00100000:1.0:1746140890.975608:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:449:x1830960573939072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 854us (1443us total) trans 8589945197 rc 0/0 00000100:00100000:1.0:1746140890.975614:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10865 00000100:00100000:1.0:1746140890.975638:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573939328 00000100:00100000:1.0:1746140890.975641:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573939328 00000100:00100000:1.0:1746140890.975677:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4794 00000100:00100000:1.0:1746140890.975686:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+16:445:x1830960573939328:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140890.976896:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+17:445:x1830960573939328:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1207us (2252us total) trans 8589945198 rc 0/0 00000100:00100000:1.0:1746140890.976902:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4794 00000100:00100000:0.0:1746140890.977600:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.978050:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.978089:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.978105:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573939584 00000100:00100000:0.0:1746140890.978110:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573939584 00000100:00100000:1.0:1746140890.978198:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573939456 00000100:00100000:1.0:1746140890.978201:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573939456 00000100:00100000:1.0:1746140890.978229:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 792 00000100:00100000:1.0:1746140890.978234:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:1985:x1830960573939456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140890.978246:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140890.978266:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb86b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b1 expref: 279 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140890.978281:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140890.978285:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140890.978338:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1985:x1830960573939456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 102us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140890.978343:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 792 00000100:00100000:0.0:1746140890.978469:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573939712 00000100:00100000:0.0:1746140890.978472:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573939712 00000100:00100000:3.0:1746140890.978558:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17498 00000100:00100000:3.0:1746140890.978566:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1983:x1830960573939584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.978579:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.978590:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22b8 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.978605:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.978607:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140890.978613:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 37 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.978624:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 37 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.978631:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50faa00, rc 0) 00000100:00100000:3.0:1746140890.978649:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573939584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.978654:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17498 00000100:00100000:3.0:1746140890.978665:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17499 00000100:00100000:3.0:1746140890.978669:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1983:x1830960573939712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.978673:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.978680:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb880 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22bf expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140890.978708:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576139136:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140890.978748:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140890.979260:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140890.979292:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140890.979329:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573939968 00000100:00100000:2.0:1746140890.979333:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573939968 00000100:00100000:2.0:1746140890.979352:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17500 00000100:00100000:2.0:1746140890.979357:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573939968:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140890.979358:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573939840 00000100:00100000:0.0:1746140890.979360:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573939840 00010000:00010000:2.0:1746140890.979363:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140890.979370:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4c00/0x8156357b7fdbb887 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22cd expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140890.979375:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17501 00000100:00100000:0.0:1746140890.979379:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1982:x1830960573939840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140890.979384:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140890.979389:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbb88e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22c6 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140890.979392:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576139264:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140890.979406:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576139392:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140890.979437:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453180 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.979469:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.980479:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576139392:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140890.980500:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbb88e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22c6 expref: 40 pid: 8458 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746140890.980502:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140890 -> 1746140891 00010000:00010000:3.0:1746140890.980511:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbb88e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22c6 expref: 40 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140890.980513:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576139264:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140890.980529:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4c00/0x8156357b7fdbb887 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22cd expref: 39 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.980533:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe0a600, rc 0) 00010000:00010000:2.0:1746140890.980537:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4c00/0x8156357b7fdbb887 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22cd expref: 39 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140890.980548:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb4c00, rc 0) 00000100:00100000:3.0:1746140890.980569:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1982:x1830960573939840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1189us (1276us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140890.980573:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17501 00000100:00100000:3.0:1746140890.980592:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576139136:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140890.980604:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb880 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22bf expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.980613:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa400/0x8156357b7fdbb880 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22bf expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140890.980621:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa400, rc 0) 00000100:00100000:2.0:1746140890.980948:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1982:x1830960573939968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1589us (1687us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140890.980949:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1983:x1830960573939712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2278us (2858us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140890.980953:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17500 00000100:00100000:3.0:1746140890.980956:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17499 00000100:00100000:0.0:1746140890.984195:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.984357:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573940224 00000100:00100000:3.0:1746140890.984368:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573940224 00002000:00100000:3.0:1746140890.984413:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc09180 x1830960573940224/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.984422:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc09180 with x1830960573940224 ext(0->1048575) 00002000:00010000:3.0:1746140890.984428:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc09180 00000100:00100000:3.0:1746140890.984463:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8970 00000100:00100000:3.0:1746140890.984469:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573940224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140890.989220:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1983:x1830960573940224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4742us (5027us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140890.989231:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8970 00002000:00100000:3.0:1746140890.989242:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc09180 x1830960573940224/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:306/0 lens 488/440 e 0 to 0 dl 1746140901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.989251:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc09180 with x1830960573940224 ext(0->1048575) 00002000:00010000:3.0:1746140890.989257:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc09180 00000100:00100000:0.0:1746140890.995913:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.996029:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573940352 00000100:00100000:3.0:1746140890.996039:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573940352 00000100:00100000:3.0:1746140890.996093:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17502 00000100:00100000:3.0:1746140890.996102:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:449:x1830960573940352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140890.996119:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140890.996135:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22d4 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.996160:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 23 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.996168:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.996170:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140890.996174:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.996206:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 23 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.996218:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 23 pid: 12255 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140890.996230:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576139520:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140890.996935:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140890.998609:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576139520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140890.998635:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140890.998651:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa600, rc 0) 00000100:00100000:3.0:1746140890.998702:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:449:x1830960573940352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2600us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140890.998710:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17502 00000100:00100000:0.0:1746140890.999173:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140890.999266:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573940480 00000100:00100000:3.0:1746140890.999273:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573940480 00002000:00100000:3.0:1746140890.999334:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1843200->2097151) req@ffff8800a513f480 x1830960573940480/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/0 e 0 to 0 dl 1746140901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140890.999343:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513f480 with x1830960573940480 ext(1843200->2097151) 00010000:00010000:3.0:1746140890.999352:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 24 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140890.999370:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 24 pid: 12255 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140890.999376:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a513f480 00000100:00100000:3.0:1746140890.999438:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1864 00000100:00100000:3.0:1746140890.999446:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573940480:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140891.003932:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573940480:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4478us (4756us total) trans 17179874246 rc 0/0 00000100:00100000:3.0:1746140891.003945:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1864 00002000:00100000:3.0:1746140891.003956:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1843200->2097151) req@ffff8800a513f480 x1830960573940480/t17179874246(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:306/0 lens 488/448 e 0 to 0 dl 1746140901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.003965:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513f480 with x1830960573940480 ext(1843200->2097151) 00010000:00010000:3.0:1746140891.003974:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 26 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.003996:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 26 pid: 12255 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.004003:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a513f480 00000100:00100000:0.0:1746140891.007611:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.007728:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573940608 00000100:00100000:1.0:1746140891.007738:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573940608 00010000:00010000:1.0:1746140891.007800:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 26 pid: 12255 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.007839:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9061 00000100:00100000:1.0:1746140891.007847:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573940608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.007863:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.007886:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 26 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.007899:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 26 pid: 12255 timeout: 970 lvb_type: 0 00000100:00080000:2.0:1746140891.007912:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746140891.007922:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f19d800/0x8156357b7fdbb753 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a221e expref: 26 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.008092:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.008094:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.008101:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.008110:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.008141:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.008153:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576139648:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140891.008238:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.009862:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576139648:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140891.009881:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.010039:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573940608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2191us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.010048:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9061 00000100:00100000:0.0:1746140891.012406:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.012491:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573940864 00000100:00100000:3.0:1746140891.012500:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573940864 00002000:00100000:3.0:1746140891.012557:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800a513c000 x1830960573940864/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.012567:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513c000 with x1830960573940864 ext(1048576->2097151) 00000100:00080000:2.0:1746140891.012569:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1746140891.012572:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513c000 00000100:00100000:3.0:1746140891.012598:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8971 00000100:00100000:3.0:1746140891.012605:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573940864:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.018829:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573940864:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6217us (6426us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.018839:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8971 00002000:00100000:3.0:1746140891.018850:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8800a513c000 x1830960573940864/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.018859:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513c000 with x1830960573940864 ext(1048576->2097151) 00002000:00010000:3.0:1746140891.018864:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a513c000 00000100:00100000:0.0:1746140891.022792:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.022883:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573940992 00000100:00100000:3.0:1746140891.022894:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573940992 00000100:00100000:3.0:1746140891.022975:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17503 00000100:00100000:3.0:1746140891.022993:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:449:x1830960573940992:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.023009:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1746140891.023010:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746140891.023025:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22db expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.023051:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.023057:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140891.023059:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140891.023062:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.023093:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.023103:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 29 pid: 12255 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.023113:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576139776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.023197:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.024683:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576139776:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.024702:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.024714:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa200, rc 0) 00000100:00100000:3.0:1746140891.024753:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:449:x1830960573940992:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1771us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.024761:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17503 00000100:00100000:0.0:1746140891.026247:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.026543:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573941120 00000100:00100000:3.0:1746140891.026550:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573941120 00002000:00100000:3.0:1746140891.026586:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1560575) req@ffff8800a513ea00 x1830960573941120/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.026593:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ea00 with x1830960573941120 ext(1048576->1560575) 00010000:00010000:3.0:1746140891.026602:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 30 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.026618:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 30 pid: 12255 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.026625:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a513ea00 00000100:00100000:0.0:1746140891.026721:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1865 00000100:00100000:0.0:1746140891.026729:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573941120:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140891.032651:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573941120:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5915us (6401us total) trans 21474841544 rc 0/0 00000100:00100000:2.0:1746140891.032662:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1865 00002000:00100000:2.0:1746140891.032674:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1560575) req@ffff8800a513ea00 x1830960573941120/t21474841544(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.032683:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ea00 with x1830960573941120 ext(1048576->1560575) 00010000:00010000:2.0:1746140891.032692:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 32 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.032708:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 32 pid: 12255 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.032715:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a513ea00 00000100:00100000:0.0:1746140891.035096:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.035186:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573941248 00000100:00100000:1.0:1746140891.035194:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573941248 00010000:00010000:1.0:1746140891.035222:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 32 pid: 12255 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.035246:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9062 00000100:00100000:1.0:1746140891.035252:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573941248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.035267:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.035284:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 32 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.035294:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 32 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.035338:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecc5600/0x8156357b7fdbb76f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a223a expref: 32 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.035369:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.035371:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.035377:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 37 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.035385:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 37 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.035411:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 37 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.035422:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576139904:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140891.035479:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.038364:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576139904:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140891.038383:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.038413:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573941248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3161us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.038423:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9062 00000100:00100000:0.0:1746140891.038641:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.038849:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573941504 00000100:00100000:2.0:1746140891.038855:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573941504 00002000:00100000:2.0:1746140891.038891:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a513ed80 x1830960573941504/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.038899:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ed80 with x1830960573941504 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.038903:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513ed80 00000100:00100000:2.0:1746140891.038926:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8972 00000100:00100000:2.0:1746140891.038932:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573941504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.044397:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573941504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5453us (5745us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.044408:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8972 00002000:00100000:2.0:1746140891.044418:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a513ed80 x1830960573941504/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.044427:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ed80 with x1830960573941504 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.044433:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513ed80 00000100:00100000:0.0:1746140891.050190:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.050278:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573941632 00000100:00100000:3.0:1746140891.050289:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573941632 00000100:00100000:3.0:1746140891.050372:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17504 00000100:00100000:3.0:1746140891.050379:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:449:x1830960573941632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.050397:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.050411:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22e2 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.050436:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 30 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.050444:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140891.050446:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140891.050449:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 39 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.050475:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 30 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.050485:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 30 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.050501:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576140032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.050618:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.051739:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576140032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.051756:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 39 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.051769:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbe00, rc 0) 00000100:00100000:3.0:1746140891.051792:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:449:x1830960573941632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1414us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.051799:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17504 00000100:00100000:0.0:1746140891.052600:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.052699:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573941760 00000100:00100000:2.0:1746140891.052709:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573941760 00002000:00100000:2.0:1746140891.052753:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2215936->2588671) req@ffff8800a513d880 x1830960573941760/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.052768:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d880 with x1830960573941760 ext(2215936->2588671) 00010000:00010000:2.0:1746140891.052776:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 31 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.052798:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 31 pid: 24958 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.052805:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a513d880 00000100:00100000:2.0:1746140891.052836:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1866 00000100:00100000:2.0:1746140891.052843:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573941760:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140891.056115:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1984:x1830960573941760:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3265us (3509us total) trans 21474841545 rc 0/0 00000100:00100000:2.0:1746140891.056126:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1866 00002000:00100000:2.0:1746140891.056137:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2215936->2588671) req@ffff8800a513d880 x1830960573941760/t21474841545(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.056145:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d880 with x1830960573941760 ext(2215936->2588671) 00010000:00010000:2.0:1746140891.056155:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 33 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.056168:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 33 pid: 24958 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.056174:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a513d880 00000100:00100000:0.0:1746140891.058173:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.058284:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573941888 00000100:00100000:1.0:1746140891.058292:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573941888 00010000:00010000:1.0:1746140891.058351:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 33 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.058378:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9063 00000100:00100000:1.0:1746140891.058385:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1984:x1830960573941888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.058397:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.058414:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 33 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.058425:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 33 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.058445:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb84f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->2588671) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22aa expref: 33 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.058466:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.058467:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.058473:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.058479:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.058503:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.058512:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576140160:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140891.058566:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.059715:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576140160:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140891.059728:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.059754:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573941888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1370us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.059762:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9063 00000100:00100000:0.0:1746140891.064644:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.064709:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573942144 00000100:00100000:2.0:1746140891.064717:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573942144 00000100:00100000:0.0:1746140891.064746:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140891.064756:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8800a513ca80 x1830960573942144/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.064764:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ca80 with x1830960573942144 ext(2097152->3145727) 00002000:00010000:2.0:1746140891.064770:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513ca80 00000100:00100000:3.0:1746140891.064901:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573942400 00000100:00100000:3.0:1746140891.064905:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573942400 00000100:00100000:2.0:1746140891.064905:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8973 00000100:00100000:2.0:1746140891.064912:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573942144:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140891.064921:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a513f100 x1830960573942400/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.064927:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513f100 with x1830960573942400 ext(3145728->4194303) 00002000:00010000:3.0:1746140891.064933:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513f100 00000100:00100000:3.0:1746140891.064951:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8974 00000100:00100000:3.0:1746140891.064956:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1984:x1830960573942400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.071528:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.071611:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573942528 00000100:00100000:1.0:1746140891.071625:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573942528 00000100:00100000:1.0:1746140891.071690:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10866 00000100:00100000:1.0:1746140891.071698:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+6:452:x1830960573942528:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140891.071719:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.071743:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d000/0x8156357b7fdbb8aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22e9 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.071788:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573942400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6830us (7039us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.071796:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8974 00010000:00010000:1.0:1746140891.071797:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00002000:00100000:3.0:1746140891.071804:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8800a513f100 x1830960573942400/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746140891.071809:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00002000:00100000:3.0:1746140891.071817:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513f100 with x1830960573942400 ext(3145728->4194303) 00010000:00010000:1.0:1746140891.071819:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00002000:00010000:3.0:1746140891.071821:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513f100 00010000:00010000:1.0:1746140891.071830:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.071835:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.071840:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.071916:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.071922:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 277 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.071929:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.071956:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 277 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.071966:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 277 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.071976:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576140288:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.072026:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573942144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7113us (7389us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.072032:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8973 00002000:00100000:2.0:1746140891.072038:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8800a513ca80 x1830960573942144/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.072044:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513ca80 with x1830960573942144 ext(2097152->3145727) 00002000:00010000:2.0:1746140891.072047:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513ca80 00000100:00100000:1.0:1746140891.072050:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.073265:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576140288:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.073288:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140891.074508:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.074595:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573942784 00000100:00100000:1.0:1746140891.074602:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573942784 00000100:00100000:1.0:1746140891.074653:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4795 00000100:00100000:1.0:1746140891.074660:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:27093:x1830960573942784:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746140891.074896:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:27093:x1830960573942784:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 235us (391us total) trans 8589945199 rc 0/0 00000100:00100000:1.0:1746140891.074903:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4795 00000100:00100000:0.0:1746140891.077723:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.077779:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.077860:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573942912 00000100:00100000:1.0:1746140891.077868:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573942912 00010000:00010000:1.0:1746140891.077899:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 279 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.077922:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9064 00000100:00100000:1.0:1746140891.077928:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:1984:x1830960573942912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.077940:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.077945:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 279 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.077955:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 279 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.077975:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb6f1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21df expref: 279 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.078007:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573943168 00000100:00100000:2.0:1746140891.078011:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573943168 00010000:00010000:1.0:1746140891.078012:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.078017:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078026:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078033:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00002000:00100000:2.0:1746140891.078040:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012bf12680 x1830960573943168/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746140891.078052:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746140891.078054:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf12680 with x1830960573943168 ext(4194304->4886527) 00002000:00010000:2.0:1746140891.078058:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf12680 00010000:00010000:1.0:1746140891.078069:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140891.078073:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8975 00010000:00010000:1.0:1746140891.078074:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140891.078078:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1983:x1830960573943168:12345-192.168.204.16@tcp:3:cat.0 00000004:00200000:1.0:1746140891.078110:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140891.078114:0:14741:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140891.078129:0:14741:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078137:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078197:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078203:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078208:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078212:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8da00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140891.078215:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078220:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078226:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140891.078228:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140891.078231:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078235:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb8b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078245:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078249:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078253:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078256:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8de00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140891.078258:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078261:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078266:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a630ad00) 00010000:00010000:1.0:1746140891.078267:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140891.078269:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078273:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8de00/0x8156357b7fdbb8b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.078324:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d000/0x8156357b7fdbb8aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.078339:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 7 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.078344:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.078346:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140891.078348:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8cc00, rc 0) 00000100:00100000:1.0:1746140891.078382:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:452:x1830960573942528:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 6685us (6865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.078387:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10866 00000100:00100000:1.0:1746140891.078414:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1984:x1830960573942912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 487us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.078419:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9064 00000100:00100000:0.0:1746140891.080702:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.080729:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.080749:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.080769:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.080781:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.080797:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573943296 00000100:00100000:0.0:1746140891.080804:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573943296 00000100:00100000:2.0:1746140891.080808:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573943552 00000100:00100000:2.0:1746140891.080815:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573943552 00000100:00100000:0.0:1746140891.080841:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573943808 00000100:00100000:0.0:1746140891.080842:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573943808 00000100:00100000:2.0:1746140891.080849:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573943424 00000100:00100000:2.0:1746140891.080851:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573943424 00000100:00100000:1.0:1746140891.080851:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573943680 00000100:00100000:1.0:1746140891.080856:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573943680 00000100:00100000:0.0:1746140891.080857:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17505 00000100:00100000:0.0:1746140891.080863:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573943296:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746140891.080880:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17506 00000100:00100000:2.0:1746140891.080887:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573943552:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:1.0:1746140891.080892:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17507 00000100:00100000:1.0:1746140891.080898:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573943808:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:3.0:1746140891.080899:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17508 00010000:00010000:2.0:1746140891.080900:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140891.080906:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573943424:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140891.080910:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.080913:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.080916:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22fe expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.080924:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22f7 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.080924:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a230c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.080936:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.080938:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.080941:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.080941:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.080943:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.080943:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.080947:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 11 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.080949:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.080950:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.080961:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 11 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.080962:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.080963:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.080971:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbc00, rc 0) 00010000:00010000:2.0:1746140891.080971:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edec600, rc 0) 00010000:00010000:1.0:1746140891.080971:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8d400, rc 0) 00000100:00100000:2.0:1746140891.081023:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573943552:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 135us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.081029:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17506 00000100:00100000:3.0:1746140891.081030:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573943424:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 124us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.081032:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573943808:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 133us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.081035:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17508 00000100:00100000:1.0:1746140891.081039:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17507 00000100:00100000:2.0:1746140891.081046:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17509 00000100:00100000:2.0:1746140891.081053:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573943680:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140891.081060:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.081069:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2305 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.081080:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.081082:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.081086:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 11 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.081094:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.081095:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 11 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.081102:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb4a00, rc 0) 00010000:00010000:0.0:1746140891.081103:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a22f0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.081106:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140891.081113:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.081114:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.081119:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140891.081121:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573943680:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 69us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.081124:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573943936 00000100:00100000:2.0:1746140891.081127:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17509 00000100:00100000:1.0:1746140891.081127:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573943936 00010000:00010000:0.0:1746140891.081129:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.081136:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bdc00, rc 0) 00000100:00100000:2.0:1746140891.081163:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17510 00000100:00100000:2.0:1746140891.081169:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573943936:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140891.081175:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.081183:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2313 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.081193:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.081194:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.081198:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 11 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.081207:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 11 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.081214:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb5800, rc 0) 00000100:00100000:2.0:1746140891.081231:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573943936:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.081240:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17510 00000100:00080000:2.0:1746140891.081257:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746140891.081261:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140891.081334:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573943296:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 288us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.081344:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17505 00000100:00100000:2.0:1746140891.082390:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1983:x1830960573943168:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4309us (4607us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140891.082398:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8975 00002000:00100000:2.0:1746140891.082406:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012bf12680 x1830960573943168/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.082414:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf12680 with x1830960573943168 ext(4194304->4886527) 00002000:00010000:2.0:1746140891.082418:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf12680 00000100:00100000:0.0:1746140891.083374:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.083421:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573944192 00000100:00100000:1.0:1746140891.083428:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573944192 00000100:00100000:1.0:1746140891.083468:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10867 00000100:00100000:1.0:1746140891.083474:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:452:x1830960573944192:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140891.083486:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.083501:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb8f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a231a expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.083583:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.083596:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.083605:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.083630:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.083641:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 8 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.083651:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576140416:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.083719:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.086706:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.086730:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573944320 00000100:00100000:1.0:1746140891.086868:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573944320 00000100:00100000:2.0:1746140891.086885:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576140416:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.086900:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 9 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.086904:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140891.086927:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.086932:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9065 00000100:00100000:1.0:1746140891.086939:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573944320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.086951:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.086955:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 9 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.086957:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573944576 00000100:00100000:2.0:1746140891.086961:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573944576 00010000:00010000:1.0:1746140891.086964:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 9 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.086998:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb8bf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e9 expref: 9 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.087021:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.087026:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.087033:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.087038:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.087063:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.087090:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4796 00000100:00100000:1.0:1746140891.087095:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573944320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 156us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.087096:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:449:x1830960573944576:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140891.087102:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9065 00010000:00010000:3.0:1746140891.087178:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.087185:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140891.087197:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140891.087264:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbb8f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a231a expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.087275:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:449:x1830960573944576:12345-192.168.204.16@tcp:35:cat.0 Request processed in 178us (356us total) trans 8589945200 rc 0/0 00000100:00100000:2.0:1746140891.087281:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4796 00010000:00010000:3.0:1746140891.087282:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a231a expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.087288:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.087290:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746140891.087292:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8ce00, rc 0) 00000100:00100000:3.0:1746140891.087333:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:452:x1830960573944192:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3859us (3960us total) trans 8589945201 rc 0/0 00000100:00100000:3.0:1746140891.087339:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10867 00000100:00100000:0.0:1746140891.088625:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.088708:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573944832 00000100:00100000:3.0:1746140891.088716:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573944832 00000100:00100000:3.0:1746140891.088763:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10868 00000100:00100000:3.0:1746140891.088769:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:452:x1830960573944832:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140891.088791:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.088795:0:14741:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746140891.088817:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ce00/0x8156357b7fdbb8f7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a231a expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.088839:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.088843:0:14741:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140891.088852:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb905 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2321 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.088929:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.088945:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.088953:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140891.088963:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140891.089063:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbb905 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.089072:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.089077:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.089078:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140891.089080:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa800, rc 0) 00000100:00100000:3.0:1746140891.089129:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:452:x1830960573944832:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 359us (505us total) trans 8589945202 rc 0/0 00000100:00100000:3.0:1746140891.089134:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10868 00000100:00100000:0.0:1746140891.089922:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.089998:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573944960 00000100:00100000:3.0:1746140891.090003:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573944960 00000100:00100000:3.0:1746140891.090036:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10869 00000100:00100000:3.0:1746140891.090042:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:452:x1830960573944960:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140891.090050:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.090057:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb91a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2328 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.090083:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb91a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2328 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.090092:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb91a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2328 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.090104:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.090107:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140891.090108:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb800, rc 0) 00000100:00100000:3.0:1746140891.090138:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:452:x1830960573944960:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.090143:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10869 00000100:00100000:2.0:1746140891.091430:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.091431:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.091511:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573945088 00000100:00100000:1.0:1746140891.091516:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573945088 00000100:00100000:3.0:1746140891.091551:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573945984 00000100:00100000:1.0:1746140891.091554:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17511 00000100:00100000:3.0:1746140891.091555:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573945984 00000100:00100000:1.0:1746140891.091559:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+11:1983:x1830960573945088:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746140891.091577:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10870 00000100:00100000:3.0:1746140891.091581:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:454:x1830960573945984:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140891.091592:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.091593:0:32376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.091601:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb928 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a232f expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.091607:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.091625:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573945344 00000100:00100000:2.0:1746140891.091629:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573945344 00000100:00100000:0.0:1746140891.091631:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.091648:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573945600 00000100:00100000:2.0:1746140891.091651:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573945600 00000100:00100000:0.0:1746140891.091652:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140891.091691:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.091700:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.091708:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.091722:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.091731:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.091736:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140891.091740:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 31 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.091749:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.091755:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 38 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.091760:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.091762:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.091764:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.091801:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 38 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.091814:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 38 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.091829:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140891.091829:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093133800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576140544:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.091838:0:14785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.091844:0:14785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140891.091844:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573945216 00000100:00100000:2.0:1746140891.091846:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573945216 00000100:00100000:0.0:1746140891.091860:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.091862:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17512 00000100:00100000:2.0:1746140891.091868:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1983:x1830960573945344:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140891.091872:0:14785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.091881:0:14785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 9 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.091891:0:14785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576140672:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.091891:0:8458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.091891:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.091905:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.091910:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573945472 00010000:00010000:2.0:1746140891.091912:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 12 pid: 8458 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140891.091913:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573945472 00010000:00010000:1.0:1746140891.091917:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 13 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.091919:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.091920:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.091923:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.091926:0:14785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00010000:00010000:1.0:1746140891.091926:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 13 pid: 32376 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.091927:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573945728 00000100:00100000:0.0:1746140891.091929:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573945728 00000100:00100000:1.0:1746140891.091935:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576140800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.091939:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.091945:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 13 pid: 8458 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.091951:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17513 00000100:00100000:2.0:1746140891.091952:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576140928:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.091956:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17514 00000100:00100000:0.0:1746140891.091956:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+13:1983:x1830960573945600:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746140891.091965:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+13:1983:x1830960573945216:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746140891.091965:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 31 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.091974:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 31 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.091974:0:20960:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.091993:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 43 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.091995:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576141056:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140891.091995:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.091996:0:4782:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.092001:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.092006:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.092007:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 43 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.092008:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 43 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.092008:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.092010:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.092015:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 13 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140891.092015:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576141184:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.092017:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310593c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140891.092022:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.092028:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.092028:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.092029:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.092031:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.092035:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 13 pid: 12255 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.092040:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453180 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.092044:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576141312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.092046:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17515 00010000:00010000:3.0:1746140891.092049:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 24 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140891.092056:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+13:1983:x1830960573945472:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:2.0:1746140891.092057:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17516 00010000:00010000:3.0:1746140891.092058:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 24 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.092063:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+13:1983:x1830960573945728:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746140891.092066:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576141440:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140891.092077:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.092078:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.092085:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.092085:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 38 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.092087:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 43 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.092091:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 13 pid: 20960 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140891.092093:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576141568:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.092094:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.092095:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.092099:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 13 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.092101:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 24 pid: 8459 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140891.092106:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576141696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.092106:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746140891.092106:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119840 going to sleep for 11 seconds 00010000:00010000:1.0:1746140891.092107:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.092108:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.092109:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.092112:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.092113:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.092115:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.092125:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 24 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.092126:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 43 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.092131:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.092133:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 24 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.092134:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 43 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.092139:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 13 pid: 8458 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.092141:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576141952:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.092141:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576141824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.092147:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142080:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.092154:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fac00 going to sleep for 11 seconds 00010000:00010000:2.0:1746140891.092164:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.092171:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.092172:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 13 pid: 8458 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.092179:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576142208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.092179:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.092186:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142336:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.092204:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 43 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140891.092205:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746140891.092212:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 43 pid: 8460 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.092219:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576142464:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.092236:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.093062:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093133800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576140544:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.093095:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576140800:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.093147:0:14785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14785:1830960576140672:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.093163:0:14785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140891.093819:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576140928:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.093940:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:32376:1830960576141056:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.093960:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.094043:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.094075:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.094135:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573946112 00000100:00100000:1.0:1746140891.094141:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573946112 00000100:00100000:0.0:1746140891.094146:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576141312:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.094165:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 10 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:0.0:1746140891.094169:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b1b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576141568:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.094176:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573946240 00000100:00100000:2.0:1746140891.094179:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573946240 00010000:00010000:0.0:1746140891.094180:0:20960:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.094186:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9066 00000100:00100000:1.0:1746140891.094192:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573946112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.094194:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 14 pid: 32376 timeout: 970 lvb_type: 1 00010000:00010000:1.0:1746140891.094202:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.094207:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 10 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.094215:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 10 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.094221:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9067 00000100:00100000:2.0:1746140891.094227:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1985:x1830960573946240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.094234:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.094238:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbb90c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2321 expref: 10 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.094254:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576141696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.094254:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 14 pid: 32376 timeout: 970 lvb_type: 1 00010000:00010000:1.0:1746140891.094254:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.094259:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.094261:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 14 pid: 32376 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.094266:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576141184:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.094267:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.094273:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbb8e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f0 expref: 14 pid: 32376 timeout: 970 lvb_type: 1 00010000:00010000:1.0:1746140891.094273:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094281:0:8458:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.094285:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140891.094291:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140891.094293:0:14785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094297:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140891.094329:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:2.0:1746140891.094391:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573946240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 163us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.094391:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573946112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 198us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.094397:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9067 00000100:00100000:1.0:1746140891.094400:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9066 00010000:00010000:3.0:1746140891.094584:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094591:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094598:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094604:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.094608:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094614:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140891.094621:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576141824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.094623:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.094629:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:2.0:1746140891.094630:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576142208:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.094633:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094637:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbb93d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00000100:00100000:2.0:1746140891.094642:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576141952:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.094651:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140891.094653:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142080:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.094656:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00000100:00100000:1.0:1746140891.094660:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142336:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.094662:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094666:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.094668:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094673:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:1.0:1746140891.094677:0:32377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.094683:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140891.094685:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.094687:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094691:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbb92f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094699:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094703:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094707:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094711:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.094713:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094718:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094724:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a47f2100) 00010000:00010000:3.0:1746140891.094726:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.094728:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094733:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbb936 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.094777:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb928 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a232f expref: 19 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.094785:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbb928 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a232f expref: 19 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.094793:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb200, rc 0) 00000100:00100000:3.0:1746140891.094833:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:454:x1830960573945984:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3250us (3404us total) trans 8589945203 rc 301/301 00000100:00100000:3.0:1746140891.094839:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10870 00000100:00100000:0.0:1746140891.098135:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.098168:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.098214:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.098217:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573946496 00000100:00100000:2.0:1746140891.098230:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573946496 00000100:00100000:0.0:1746140891.098234:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573946752 00000100:00100000:0.0:1746140891.098238:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573946752 00010000:00010000:2.0:1746140891.098264:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 39 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.098269:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 13 pid: 12255 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.098334:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573947008 00000100:00100000:2.0:1746140891.098337:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573947008 00010000:00010000:2.0:1746140891.098353:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.098395:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9068 00000100:00100000:0.0:1746140891.098404:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573946496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746140891.098415:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9069 00010000:00010000:0.0:1746140891.098416:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140891.098423:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573946752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.098430:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.098440:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 39 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.098441:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 13 pid: 12255 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.098451:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 13 pid: 12255 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.098451:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9070 00000100:00100000:2.0:1746140891.098457:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1984:x1830960573947008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.098463:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.098471:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb8d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a230c expref: 13 pid: 12255 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.098473:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.098481:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.098486:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.098492:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbb8cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22f7 expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.098499:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.098525:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573947008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.098530:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573946752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.098530:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9070 00000100:00100000:3.0:1746140891.098535:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9069 00010000:00010000:0.0:1746140891.098539:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 39 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.098552:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbb879 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22b8 expref: 39 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.098566:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140891.098574:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.098579:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573947264 00000100:00100000:2.0:1746140891.098582:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573947264 00010000:00010000:2.0:1746140891.098592:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 13 pid: 8458 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.098592:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573946496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 191us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.098598:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9068 00000100:00100000:2.0:1746140891.098611:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9071 00000100:00100000:2.0:1746140891.098615:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573947264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.098621:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.098630:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 13 pid: 8458 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.098636:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 13 pid: 8458 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.098645:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fcb5800/0x8156357b7fdbb8e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2313 expref: 13 pid: 8458 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.098651:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.098654:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.098663:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573947264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.098667:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9071 00000100:00100000:2.0:1746140891.098675:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573947520 00000100:00100000:2.0:1746140891.098676:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573947520 00000100:00100000:0.0:1746140891.098682:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.098684:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 12 pid: 8458 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.098692:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573946368 00000100:00100000:0.0:1746140891.098694:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573946368 00000100:00100000:2.0:1746140891.098703:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9072 00010000:00010000:0.0:1746140891.098707:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 12 pid: 8458 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.098708:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573947520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.098714:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.098724:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 12 pid: 8458 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.098731:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 12 pid: 8458 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.098733:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9073 00000100:00100000:3.0:1746140891.098738:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573946368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.098740:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb8db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2305 expref: 12 pid: 8458 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.098744:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.098748:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140891.098753:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 12 pid: 8458 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.098760:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 12 pid: 8458 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.098760:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573947520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.098765:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9072 00010000:00010000:3.0:1746140891.098770:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edec600/0x8156357b7fdbb8c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22fe expref: 12 pid: 8458 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.098778:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.098790:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573946368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.098795:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9073 00000100:00100000:2.0:1746140891.098809:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.098820:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573946624 00000100:00100000:3.0:1746140891.098822:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573946624 00010000:00010000:3.0:1746140891.098833:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 32 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.098851:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9074 00000100:00100000:2.0:1746140891.098851:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.098855:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573946624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.098860:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.098866:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 32 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.098869:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573946880 00000100:00100000:2.0:1746140891.098871:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573946880 00010000:00010000:3.0:1746140891.098874:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 32 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.098880:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 44 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.098885:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbb7fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a228e expref: 32 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.098892:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140891.098893:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9075 00010000:00010000:3.0:1746140891.098894:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140891.098896:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573946880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.098899:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.098901:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.098906:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 44 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.098907:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.098912:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 44 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.098921:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fa600/0x8156357b7fdbb895 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22d4 expref: 44 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:0.0:1746140891.098921:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140891.098924:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.098935:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.098937:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140891.098938:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573946624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (129us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140891.098939:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.098940:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.098943:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9074 00010000:00010000:2.0:1746140891.098945:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.098952:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573947136 00000100:00100000:3.0:1746140891.098954:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573947136 00010000:00010000:1.0:1746140891.098954:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.098957:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140891.098961:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 44 pid: 12255 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.098967:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573946880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.098971:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9076 00000100:00100000:2.0:1746140891.098974:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9075 00000100:00100000:3.0:1746140891.098975:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573947136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.098980:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.098993:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.098999:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 43 pid: 12255 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.099000:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.099011:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 43 pid: 12255 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.099017:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140891.099021:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f2c00/0x8156357b7fdbb73e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2209 expref: 43 pid: 12255 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.099027:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573947392 00010000:00010000:3.0:1746140891.099029:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.099029:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573947392 00010000:00010000:2.0:1746140891.099036:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.099042:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1984:x1830960573947136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.099046:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9076 00010000:00010000:1.0:1746140891.099090:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099096:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8cc00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140891.099100:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099106:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099121:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099126:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8cc00/0x8156357b7fdbb921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099296:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9077 00000100:00100000:2.0:1746140891.099302:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1984:x1830960573947392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.099326:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.099333:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.099345:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.099353:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573945088:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7790us (7918us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140891.099360:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fa200/0x8156357b7fdbb89c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22db expref: 38 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.099362:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17511 00010000:00010000:2.0:1746140891.099367:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.099369:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.099371:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099377:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099390:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140891.099397:0:32377:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099404:0:32377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099405:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573947392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 104us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.099410:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9077 00000100:00100000:0.0:1746140891.099418:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140891.099424:0:32377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099429:0:32377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099430:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573947648 00000100:00100000:2.0:1746140891.099433:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573947648 00010000:00010000:1.0:1746140891.099434:0:32377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099440:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.099442:0:32377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8da00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140891.099444:0:32377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.099448:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140891.099449:0:32377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099456:0:32377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099461:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8da00/0x8156357b7fdbb960 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099467:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573947776 00000100:00100000:2.0:1746140891.099469:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573947776 00000100:00100000:0.0:1746140891.099474:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9078 00010000:00010000:2.0:1746140891.099479:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 25 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.099479:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573947648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.099486:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140891.099488:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573945472:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7434us (7627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.099492:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17515 00010000:00010000:3.0:1746140891.099493:0:8458:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099495:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9079 00010000:00010000:0.0:1746140891.099495:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.099499:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573947776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.099501:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.099502:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.099504:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.099510:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 25 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.099512:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbb8a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a22e2 expref: 37 pid: 24958 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.099516:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099517:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 25 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.099520:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.099521:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.099522:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.099524:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099526:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.099527:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.099528:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099530:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.099530:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.099534:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b8de000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140891.099536:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.099538:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099543:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140891.099544:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.099553:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099554:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1984:x1830960573947776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (111us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140891.099555:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140891.099559:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b8de000/0x8156357b7fdbb944 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099559:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9079 00010000:00010000:1.0:1746140891.099562:0:20960:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099568:0:20960:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099588:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576142464:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.099595:0:20960:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099600:0:20960:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099605:0:20960:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099607:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.099610:0:20960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800924bc400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140891.099613:0:20960:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.099613:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:1984:x1830960573947648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.099615:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573945344:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7747us (8150us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140891.099618:0:20960:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.099619:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9078 00000100:00100000:3.0:1746140891.099621:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17512 00010000:00010000:1.0:1746140891.099625:0:20960:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099631:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d600/0x8156357b7fdbb761 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a222c expref: 24 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:1.0:1746140891.099631:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbb94b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.099638:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576141440:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140891.099652:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.099654:0:4782:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099660:0:4782:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.099661:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573945600:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7705us (8030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.099664:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573947904 00010000:00010000:2.0:1746140891.099665:0:4782:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.099667:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573947904 00000100:00100000:1.0:1746140891.099667:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17513 00010000:00010000:3.0:1746140891.099675:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 42 pid: 8460 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.099677:0:4782:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099682:0:4782:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.099688:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9080 00010000:00010000:2.0:1746140891.099688:0:4782:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.099692:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1984:x1830960573947904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.099693:0:4782:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecc4800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140891.099695:0:4782:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.099698:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.099704:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 42 pid: 8460 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.099705:0:4782:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.099711:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 42 pid: 8460 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.099714:0:4782:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.099719:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ecc4800/0x8156357b7fdbb952 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.099720:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e79800/0x8156357b7fdbb5b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2137 expref: 42 pid: 8460 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.099729:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.099739:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573947904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.099741:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573945216:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7780us (8089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.099744:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9080 00000100:00100000:2.0:1746140891.099746:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17514 00000100:00100000:0.0:1746140891.101539:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.101645:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573948032 00000100:00100000:3.0:1746140891.101652:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573948032 00010000:00010000:3.0:1746140891.101678:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 24 pid: 8459 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.101714:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9081 00000100:00100000:3.0:1746140891.101720:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573948032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.101733:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.101750:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 24 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.101760:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 24 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.101777:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f823800/0x8156357b7fdbb5d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2161 expref: 24 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.101789:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.101792:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.101795:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.101802:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.101832:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.101878:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573948032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.101884:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9081 00010000:00010000:2.0:1746140891.101953:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.101962:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.101979:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.101996:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.102003:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.102013:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b8dea00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140891.102017:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.102024:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.102033:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.102038:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.102095:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960573945728:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 10032us (10203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.102102:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17516 00000100:00100000:0.0:1746140891.103231:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.103342:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573948288 00000100:00100000:3.0:1746140891.103353:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573948288 00000100:00100000:3.0:1746140891.103400:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10871 00000100:00100000:3.0:1746140891.103407:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:452:x1830960573948288:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:3.0:1746140891.103446:0:14785:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.103469:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbb91a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2328 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.103485:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.103489:0:14785:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.103554:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:452:x1830960573948288:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 147us (327us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746140891.103561:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10871 00000100:00100000:0.0:1746140891.105076:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.105145:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573948544 00000100:00100000:2.0:1746140891.105154:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573948544 00000100:00100000:2.0:1746140891.105383:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4797 00000100:00100000:2.0:1746140891.105392:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:452:x1830960573948544:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140891.105723:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:452:x1830960573948544:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 330us (650us total) trans 8589945204 rc 0/0 00000100:00100000:2.0:1746140891.105730:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4797 00000100:00100000:0.0:1746140891.107635:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.107683:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573948800 00000100:00100000:2.0:1746140891.107689:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573948800 00000100:00100000:2.0:1746140891.107721:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4798 00000100:00100000:2.0:1746140891.107725:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca7a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:452:x1830960573948800:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140891.108125:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca7a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:452:x1830960573948800:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 398us (493us total) trans 8589945205 rc 0/0 00000100:00100000:2.0:1746140891.108132:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4798 00000100:00100000:0.0:1746140891.122837:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.122954:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573949056 00000100:00100000:3.0:1746140891.122967:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573949056 00000100:00100000:3.0:1746140891.123049:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10872 00000100:00100000:3.0:1746140891.123057:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+18:460:x1830960573949056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.123083:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.123101:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3200/0x8156357b7fdbb96e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2336 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.123206:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.123219:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.123833:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.123852:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.123858:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.123863:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.123955:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.123962:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.123967:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140891.123974:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140891.124053:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124063:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124067:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124072:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b3e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.124074:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124079:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124087:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140891.124089:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.124092:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124096:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124121:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124125:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124128:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124132:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b3c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.124134:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124141:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124145:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a0f42700) 00010000:00010000:3.0:1746140891.124147:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.124148:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124152:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3c00/0x8156357b7fdbb97c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.124438:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3200/0x8156357b7fdbb96e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 21 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.124450:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 20 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.124455:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.124457:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140891.124459:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1b3a00, rc 0) 00000100:00100000:3.0:1746140891.125031:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:460:x1830960573949056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1840us (2070us total) trans 8589945206 rc 0/0 00000100:00100000:3.0:1746140891.125040:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10872 00000100:00100000:0.0:1746140891.127768:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.127825:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573949312 00000100:00100000:3.0:1746140891.127835:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573949312 00000100:00100000:3.0:1746140891.127884:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10873 00000100:00100000:3.0:1746140891.127891:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:461:x1830960573949312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140891.127910:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.127928:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b2200/0x8156357b7fdbb991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a233d expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.128031:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128043:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128053:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128065:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128070:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128075:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128163:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128172:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128177:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140891.128184:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140891.128257:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128263:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128269:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128274:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b3800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.128278:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128284:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128293:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140891.128295:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.128298:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128324:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3800/0x8156357b7fdbb998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128336:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128341:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128346:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128350:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b1b3e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.128352:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128356:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128364:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388900) 00010000:00010000:3.0:1746140891.128366:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.128368:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128373:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3e00/0x8156357b7fdbb99f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.128403:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b2200/0x8156357b7fdbb991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 282 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.128414:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 281 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.128419:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.128421:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140891.128423:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb4a00, rc 0) 00000100:00100000:3.0:1746140891.128550:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:461:x1830960573949312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 658us (791us total) trans 8589945207 rc 0/0 00000100:00100000:3.0:1746140891.128556:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10873 00000100:00100000:0.0:1746140891.129049:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.129074:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.129099:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.129127:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.129139:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573949440 00000100:00100000:0.0:1746140891.129140:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.129144:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573949440 00000100:00100000:0.0:1746140891.129164:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.129171:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573949568 00000100:00100000:2.0:1746140891.129173:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573949568 00000100:00100000:0.0:1746140891.129179:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573949696 00000100:00100000:0.0:1746140891.129183:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573949696 00000100:00100000:2.0:1746140891.129185:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573949824 00000100:00100000:2.0:1746140891.129187:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573949824 00000100:00100000:2.0:1746140891.129196:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573949952 00000100:00100000:2.0:1746140891.129197:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573949952 00000100:00100000:0.0:1746140891.129200:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573950080 00000100:00100000:0.0:1746140891.129202:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573950080 00000100:00100000:2.0:1746140891.129210:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17517 00000100:00100000:2.0:1746140891.129216:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1982:x1830960573949440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.129226:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.129237:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2344 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.129237:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17518 00000100:00100000:0.0:1746140891.129242:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573949568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140891.129250:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746140891.129254:0:4785:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x81f 00010000:00010000:0.0:1746140891.129259:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a234b expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.129260:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17519 00010000:00010000:2.0:1746140891.129267:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.129269:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140891.129269:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1982:x1830960573949824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.129276:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.129277:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 34 pid: 4785 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746140891.129278:0:8459:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x81f 00010000:00010000:1.0:1746140891.129286:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2359 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.129287:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.129288:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 34 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.129289:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.129294:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 26 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.129299:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8df200, rc 0) 00010000:00010000:0.0:1746140891.129321:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 26 pid: 8459 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746140891.129322:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x81f 00010000:00010000:0.0:1746140891.129328:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bcc00, rc 0) 00010000:00010000:1.0:1746140891.129333:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.129334:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.129339:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 35 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140891.129340:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1982:x1830960573949440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 125us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.129345:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573949568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 103us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.129346:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17517 00010000:00010000:1.0:1746140891.129349:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 35 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140891.129351:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17518 00010000:00010000:1.0:1746140891.129356:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8d400, rc 0) 00000100:00100000:2.0:1746140891.129358:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17520 00000100:00100000:2.0:1746140891.129362:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960573949696:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140891.129362:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17521 00000100:00100000:0.0:1746140891.129367:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1982:x1830960573949952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.129368:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.129372:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140891.129373:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1982:x1830960573949824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 107us (246us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140891.129376:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2352 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.129379:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17519 00010000:00010000:0.0:1746140891.129379:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2360 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140891.129386:0:4785:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x81d 00002000:00010000:0.0:1746140891.129389:0:8459:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fedb, atime: 0x6813feda, ctime: 0x6813fedb, blocks: 0x1591 00000100:00100000:1.0:1746140891.129390:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17522 00010000:00010000:2.0:1746140891.129393:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.129395:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140891.129395:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573950080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140891.129396:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.129397:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.129398:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 26 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.129400:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.129401:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 34 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.129406:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2367 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.129407:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 26 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.129413:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8dea00, rc 0) 00010000:00010000:0.0:1746140891.129413:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 34 pid: 8459 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746140891.129416:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813feda, atime: 0x6813fed9, ctime: 0x6813feda, blocks: 0x102b 00010000:00010000:0.0:1746140891.129418:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bd000, rc 0) 00010000:00010000:1.0:1746140891.129424:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.129426:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746140891.129428:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1982:x1830960573949696:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (329us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140891.129430:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140891.129434:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17520 00000100:00100000:0.0:1746140891.129434:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1982:x1830960573949952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.129438:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17521 00010000:00010000:1.0:1746140891.129443:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 26 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.129449:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8da00, rc 0) 00000100:00100000:1.0:1746140891.129464:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1982:x1830960573950080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 69us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.129469:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17522 00000100:00100000:0.0:1746140891.144406:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.144591:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573950336 00000100:00100000:2.0:1746140891.144603:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573950336 00002000:00100000:2.0:1746140891.144646:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801355bf100 x1830960573950336/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.144654:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bf100 with x1830960573950336 ext(0->1048575) 00002000:00010000:2.0:1746140891.144658:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bf100 00000100:00100000:2.0:1746140891.144687:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8976 00000100:00100000:2.0:1746140891.144694:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1984:x1830960573950336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.146355:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.146396:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.146442:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.146458:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573950592 00000100:00100000:2.0:1746140891.146464:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573950848 00000100:00100000:1.0:1746140891.146465:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573950592 00000100:00100000:2.0:1746140891.146467:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573950848 00002000:00100000:2.0:1746140891.146495:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012d080700 x1830960573950848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.146496:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88012d081180 x1830960573950592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.146503:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080700 with x1830960573950848 ext(1048576->2097151) 00002000:00100000:1.0:1746140891.146503:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d081180 with x1830960573950592 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.146507:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d080700 00002000:00010000:1.0:1746140891.146507:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d081180 00000100:00100000:1.0:1746140891.146521:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573951104 00000100:00100000:1.0:1746140891.146523:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573951104 00002000:00100000:1.0:1746140891.146534:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012d080000 x1830960573951104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.146539:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080000 with x1830960573951104 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.146542:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d080000 00000100:00100000:2.0:1746140891.146730:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8977 00000100:00100000:1.0:1746140891.146737:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8978 00000100:00100000:2.0:1746140891.146738:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573950592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.146742:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573950848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.146753:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8979 00000100:00100000:1.0:1746140891.146756:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1985:x1830960573951104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.155172:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573950336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10470us (10765us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.155173:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1985:x1830960573951104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8406us (8721us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.155183:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8976 00000100:00100000:1.0:1746140891.155188:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8979 00002000:00100000:2.0:1746140891.155195:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801355bf100 x1830960573950336/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.155195:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88012d080000 x1830960573951104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.155203:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bf100 with x1830960573950336 ext(0->1048575) 00002000:00100000:1.0:1746140891.155203:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080000 with x1830960573951104 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.155208:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bf100 00002000:00010000:1.0:1746140891.155208:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d080000 00000100:00100000:2.0:1746140891.158632:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573950592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11886us (12274us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.158642:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8977 00002000:00100000:2.0:1746140891.158652:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88012d081180 x1830960573950592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.158660:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d081180 with x1830960573950592 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.158664:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d081180 00000100:00100000:1.0:1746140891.160762:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573950848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14011us (14357us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.160772:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8978 00002000:00100000:1.0:1746140891.160788:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012d080700 x1830960573950848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.160798:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d080700 with x1830960573950848 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.160802:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d080700 00000100:00100000:0.0:1746140891.178341:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.178387:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573951232 00000100:00100000:1.0:1746140891.178396:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573951232 00000100:00100000:1.0:1746140891.178443:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17523 00000100:00100000:1.0:1746140891.178450:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+36:461:x1830960573951232:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140891.178468:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.178483:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a236e expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.178510:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 33 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.178521:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.178523:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.178525:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [12288->589823] (req 12288->589823) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 37 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.178550:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 33 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.178559:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 33 pid: 4785 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.178569:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142592:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.178649:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059000 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.181044:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.181097:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.181191:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573951616 00000100:00100000:1.0:1746140891.181200:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573951616 00000100:00100000:0.0:1746140891.181207:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746140891.181243:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801355bc700 x1830960573951616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.181251:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bc700 with x1830960573951616 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.181256:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bc700 00000100:00100000:1.0:1746140891.181273:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573951488 00000100:00100000:1.0:1746140891.181275:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573951488 00000100:00100000:3.0:1746140891.181276:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573952000 00000100:00100000:3.0:1746140891.181281:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573952000 00002000:00100000:1.0:1746140891.181283:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8801355bea00 x1830960573951488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.181288:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bea00 with x1830960573951488 ext(2097152->3145727) 00002000:00010000:1.0:1746140891.181291:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bea00 00000100:00100000:1.0:1746140891.181301:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8980 00002000:00100000:3.0:1746140891.181302:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8801355bca80 x1830960573952000/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140891.181327:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1983:x1830960573951616:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746140891.181328:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bca80 with x1830960573952000 ext(2097152->3145727) 00002000:00010000:3.0:1746140891.181331:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355bca80 00000100:00100000:0.0:1746140891.181343:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.181349:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573952256 00000100:00100000:3.0:1746140891.181352:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573952256 00002000:00100000:3.0:1746140891.181365:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8801355bd880 x1830960573952256/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.181371:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bd880 with x1830960573952256 ext(3145728->4194303) 00002000:00010000:3.0:1746140891.181373:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355bd880 00000100:00100000:0.0:1746140891.181384:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8981 00000100:00100000:3.0:1746140891.181390:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8982 00000100:00100000:0.0:1746140891.181393:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1982:x1830960573951488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.181396:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573952000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.182429:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8983 00000100:00100000:3.0:1746140891.182437:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573952256:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.187632:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142592:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.187663:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [12288->589823] (req 12288->589823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 37 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.187682:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8ca00, rc 0) 00000100:00100000:2.0:1746140891.187744:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:461:x1830960573951232:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9292us (9441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.187753:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17523 00000100:00100000:0.0:1746140891.188595:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.188682:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573952384 00000100:00100000:3.0:1746140891.188689:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573952384 00010000:00010000:3.0:1746140891.188716:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 38 pid: 4785 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.188738:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9082 00000100:00100000:3.0:1746140891.188744:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1984:x1830960573952384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.188756:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.188774:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 38 pid: 4785 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.188784:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 38 pid: 4785 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.188804:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b8df200/0x8156357b7fdbb9b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2344 expref: 38 pid: 4785 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.188831:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.188833:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.188838:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 36 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.188846:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 36 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.188873:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 36 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.188883:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576142720:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.188935:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.191042:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576142720:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140891.191060:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140891.191061:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.191097:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573952384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2353us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.191106:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9082 00000100:00100000:2.0:1746140891.191170:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573952640 00000100:00100000:2.0:1746140891.191176:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573952640 00002000:00100000:2.0:1746140891.191208:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (12288->16383) req@ffff8801355bce00 x1830960573952640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.191217:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bce00 with x1830960573952640 ext(12288->16383) 00002000:00010000:2.0:1746140891.191221:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bce00 00000100:00100000:2.0:1746140891.191248:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8984 00000100:00100000:2.0:1746140891.191253:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573952640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140891.191425:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1985:x1830960573952640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 172us (367us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140891.191431:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8984 00002000:00100000:2.0:1746140891.191436:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a0:0x0] (12288->16383) req@ffff8801355bce00 x1830960573952640/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.191442:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bce00 with x1830960573952640 ext(12288->16383) 00002000:00010000:2.0:1746140891.191445:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bce00 00000100:00100000:3.0:1746140891.192552:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573952000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11151us (11342us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.192560:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8982 00002000:00100000:3.0:1746140891.192566:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8801355bca80 x1830960573952000/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.192573:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bca80 with x1830960573952000 ext(2097152->3145727) 00002000:00010000:3.0:1746140891.192578:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355bca80 00000100:00100000:1.0:1746140891.194353:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1983:x1830960573951616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13020us (13313us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.194364:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8980 00002000:00100000:1.0:1746140891.194373:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff8801355bc700 x1830960573951616/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.194380:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bc700 with x1830960573951616 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.194385:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bc700 00000100:00100000:3.0:1746140891.196104:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1983:x1830960573952256:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13662us (14757us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.196114:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8983 00002000:00100000:3.0:1746140891.196122:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff8801355bd880 x1830960573952256/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.196130:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bd880 with x1830960573952256 ext(3145728->4194303) 00002000:00010000:3.0:1746140891.196134:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355bd880 00000100:00100000:2.0:1746140891.198169:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1982:x1830960573951488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16770us (17064us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.198180:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8981 00002000:00100000:2.0:1746140891.198191:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff8801355bea00 x1830960573951488/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.198200:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bea00 with x1830960573951488 ext(2097152->3145727) 00002000:00010000:2.0:1746140891.198206:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bea00 00000100:00100000:0.0:1746140891.202356:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.202455:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573952896 00000100:00100000:2.0:1746140891.202464:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573952896 00002000:00100000:2.0:1746140891.202504:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (585728->589823) req@ffff8801355bc000 x1830960573952896/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.202513:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bc000 with x1830960573952896 ext(585728->589823) 00002000:00010000:2.0:1746140891.202519:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bc000 00000100:00100000:2.0:1746140891.202552:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8985 00000100:00100000:2.0:1746140891.202559:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573952896:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140891.202710:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573952896:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 151us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140891.202716:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8985 00002000:00100000:2.0:1746140891.202723:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (585728->589823) req@ffff8801355bc000 x1830960573952896/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.202730:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bc000 with x1830960573952896 ext(585728->589823) 00002000:00010000:2.0:1746140891.202732:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bc000 00000100:00100000:0.0:1746140891.206112:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.206232:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573953024 00000100:00100000:2.0:1746140891.206239:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573953024 00000100:00100000:2.0:1746140891.206276:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17524 00000100:00100000:2.0:1746140891.206283:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1983:x1830960573953024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.206298:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.206337:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b8de200/0x8156357b7fdbb9e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2375 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.206381:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142848:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140891.206453:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.207358:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.207559:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573953280 00000100:00100000:1.0:1746140891.207564:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573953280 00000100:00100000:1.0:1746140891.209446:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4799 00000100:00100000:1.0:1746140891.209459:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+281:461:x1830960573953280:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140891.209657:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:461:x1830960573953280:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 202us (2300us total) trans 8589945208 rc 0/0 00000100:00100000:1.0:1746140891.209664:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4799 00000100:00100000:3.0:1746140891.210139:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142848:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140891.210167:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b8de200/0x8156357b7fdbb9e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2375 expref: 34 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.210178:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b8de200/0x8156357b7fdbb9e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2375 expref: 34 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.210201:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8de200, rc 0) 00000100:00100000:3.0:1746140891.210231:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1983:x1830960573953024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3948us (4126us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140891.210237:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17524 00000100:00100000:0.0:1746140891.212494:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.212568:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573953536 00000100:00100000:3.0:1746140891.212579:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573953536 00002000:00100000:3.0:1746140891.212623:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8801355bf480 x1830960573953536/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.212631:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bf480 with x1830960573953536 ext(4194304->4886527) 00002000:00010000:3.0:1746140891.212636:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bf480 00000100:00100000:3.0:1746140891.212669:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8986 00000100:00100000:3.0:1746140891.212674:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1982:x1830960573953536:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.219242:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1982:x1830960573953536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6551us (6742us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140891.219255:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8986 00002000:00100000:3.0:1746140891.219269:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff8801355bf480 x1830960573953536/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.219279:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355bf480 with x1830960573953536 ext(4194304->4886527) 00002000:00010000:3.0:1746140891.219285:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355bf480 00000100:00100000:0.0:1746140891.222417:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.222529:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573953664 00000100:00100000:3.0:1746140891.222541:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573953664 00000100:00100000:3.0:1746140891.222604:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17525 00000100:00100000:3.0:1746140891.222611:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1984:x1830960573953664:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.222629:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.222646:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f4200/0x8156357b7fdbb9ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a237c expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.222700:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142976:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140891.222790:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.224252:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576142976:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140891.224279:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936f4200/0x8156357b7fdbb9ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a237c expref: 34 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.224291:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f4200/0x8156357b7fdbb9ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a237c expref: 34 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.224475:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f4200, rc 0) 00000100:00100000:3.0:1746140891.226161:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1984:x1830960573953664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3541us (3743us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140891.226171:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17525 00000100:00100000:0.0:1746140891.228415:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.228977:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573953792 00000100:00100000:3.0:1746140891.228999:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573953792 00000100:00100000:3.0:1746140891.229068:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17526 00000100:00100000:3.0:1746140891.229076:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1985:x1830960573953792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.229095:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.229110:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f5e00/0x8156357b7fdbb9f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2383 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.229160:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576143104:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140891.229260:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.230964:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576143104:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140891.231000:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936f5e00/0x8156357b7fdbb9f3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2383 expref: 34 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.231012:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f5e00/0x8156357b7fdbb9f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2383 expref: 34 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.231020:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f5e00, rc 0) 00000100:00100000:3.0:1746140891.231417:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+33:1985:x1830960573953792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2339us (3010us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140891.231428:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17526 00000100:00100000:0.0:1746140891.234409:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.234521:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573954048 00000100:00100000:2.0:1746140891.234530:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573954048 00000100:00100000:2.0:1746140891.234587:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4800 00000100:00100000:2.0:1746140891.234595:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:460:x1830960573954048:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140891.234808:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:460:x1830960573954048:12345-192.168.204.16@tcp:35:cat.0 Request processed in 213us (406us total) trans 8589945209 rc 0/0 00000100:00100000:2.0:1746140891.234815:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4800 00000100:00100000:0.0:1746140891.242475:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.242543:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573954176 00000100:00100000:3.0:1746140891.242552:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573954176 00000100:00100000:3.0:1746140891.242607:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17527 00000100:00100000:3.0:1746140891.242614:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+33:454:x1830960573954176:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140891.242633:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.242648:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a238a expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.242676:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 36 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.242684:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140891.242686:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140891.242689:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [884736->1048575] (req 884736->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 34 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.242717:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 36 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.242728:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 36 pid: 32377 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.242739:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576143232:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.242949:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.245937:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576143232:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.245968:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [884736->1048575] (req 884736->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 34 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.246016:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f5c00, rc 0) 00000100:00100000:3.0:1746140891.246070:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+34:454:x1830960573954176:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3456us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.246078:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17527 00000100:00100000:0.0:1746140891.246657:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.246837:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573954304 00000100:00100000:3.0:1746140891.246845:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573954304 00002000:00100000:3.0:1746140891.246879:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (12288->589823) req@ffff88009b890380 x1830960573954304/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.246887:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890380 with x1830960573954304 ext(12288->589823) 00010000:00010000:3.0:1746140891.247628:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 37 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.247644:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 37 pid: 32377 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.247652:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b890380 00000100:00100000:3.0:1746140891.247679:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1867 00000100:00100000:3.0:1746140891.247687:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+37:1984:x1830960573954304:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140891.255335:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1984:x1830960573954304:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7642us (8672us total) trans 21474841546 rc 0/0 00000100:00100000:3.0:1746140891.255346:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1867 00002000:00100000:3.0:1746140891.255356:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (12288->589823) req@ffff88009b890380 x1830960573954304/t21474841546(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.255365:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890380 with x1830960573954304 ext(12288->589823) 00010000:00010000:3.0:1746140891.255374:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 39 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.255388:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 39 pid: 32377 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.255395:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b890380 00000100:00100000:0.0:1746140891.258369:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.258424:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573954432 00000100:00100000:3.0:1746140891.258432:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573954432 00010000:00010000:3.0:1746140891.258460:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 39 pid: 32377 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.258493:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9083 00000100:00100000:3.0:1746140891.258499:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+39:1985:x1830960573954432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.258510:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.258528:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 39 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.258538:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 39 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.258557:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbb9de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->589823) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a236e expref: 39 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.258581:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.258583:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.258590:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 33 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.258597:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 33 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.258624:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 33 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.258687:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576143360:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.259088:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.261041:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.261070:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576143360:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.261086:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.261112:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573954688 00000100:00100000:2.0:1746140891.261118:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573954688 00000100:00100000:3.0:1746140891.261125:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+38:1985:x1830960573954432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2625us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.261134:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9083 00002000:00100000:2.0:1746140891.261169:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (884736->888831) req@ffff88009b891500 x1830960573954688/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.261179:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891500 with x1830960573954688 ext(884736->888831) 00002000:00010000:2.0:1746140891.261184:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891500 00000100:00100000:2.0:1746140891.261217:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8987 00000100:00100000:2.0:1746140891.261223:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1985:x1830960573954688:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140891.261523:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1985:x1830960573954688:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 299us (487us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140891.261529:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8987 00002000:00100000:2.0:1746140891.261535:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (884736->888831) req@ffff88009b891500 x1830960573954688/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.261542:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891500 with x1830960573954688 ext(884736->888831) 00002000:00010000:2.0:1746140891.261545:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891500 00000100:00100000:0.0:1746140891.265592:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.265684:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573954816 00000100:00100000:3.0:1746140891.265693:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573954816 00000100:00100000:3.0:1746140891.265734:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17528 00000100:00100000:3.0:1746140891.265740:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+26:454:x1830960573954816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140891.265757:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.265774:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2391 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.265801:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 27 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.265812:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.265814:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.265817:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->1822719] (req 1048576->1822719) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.265844:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 27 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.265853:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 27 pid: 8459 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.265861:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576143488:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.265935:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.267434:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576143488:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.267459:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->1822719] (req 1048576->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 27 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.267472:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb000, rc 0) 00000100:00100000:3.0:1746140891.267510:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+27:454:x1830960573954816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1769us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.267518:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17528 00000100:00100000:0.0:1746140891.270704:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.270837:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573954944 00000100:00100000:3.0:1746140891.270847:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573954944 00010000:00010000:3.0:1746140891.270882:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 27 pid: 8459 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.270925:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9084 00000100:00100000:3.0:1746140891.270933:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573954944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.270946:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.270970:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 27 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.271139:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 27 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.271165:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924bcc00/0x8156357b7fdbb9bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a234b expref: 27 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.271192:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.271194:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.271201:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 26 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.271208:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 26 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.271242:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 26 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.271257:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576143616:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.271437:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.272665:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576143616:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.272682:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.272707:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573954944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1776us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.272715:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9084 00000100:00100000:0.0:1746140891.277753:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.277826:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573955200 00000100:00100000:2.0:1746140891.277835:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573955200 00002000:00100000:2.0:1746140891.277882:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1818624->1822719) req@ffff88009b893100 x1830960573955200/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.277891:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893100 with x1830960573955200 ext(1818624->1822719) 00002000:00010000:2.0:1746140891.277895:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b893100 00000100:00100000:2.0:1746140891.277925:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8988 00000100:00100000:2.0:1746140891.277933:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573955200:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140891.278114:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1984:x1830960573955200:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 182us (367us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140891.278121:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8988 00002000:00100000:2.0:1746140891.278127:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1818624->1822719) req@ffff88009b893100 x1830960573955200/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.278140:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b893100 with x1830960573955200 ext(1818624->1822719) 00002000:00010000:2.0:1746140891.278143:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b893100 00000100:00100000:0.0:1746140891.280497:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.280561:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573955456 00000100:00100000:2.0:1746140891.280571:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573955456 00000100:00100000:2.0:1746140891.280623:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4801 00000100:00100000:2.0:1746140891.280631:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:454:x1830960573955456:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140891.280841:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+22:454:x1830960573955456:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 210us (350us total) trans 8589945210 rc 0/0 00000100:00100000:2.0:1746140891.280848:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4801 00000100:00100000:0.0:1746140891.300275:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.300365:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573955712 00000100:00100000:3.0:1746140891.300376:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573955712 00000100:00100000:3.0:1746140891.300434:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10874 00000100:00100000:3.0:1746140891.300441:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:467:x1830960573955712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.300465:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.300483:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbba08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2398 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.300578:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.300591:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140891.300601:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140891.300610:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140891.300712:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbba08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 285 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.300740:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 284 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.300748:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.300751:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746140891.300754:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f4000, rc 0) 00000100:00100000:3.0:1746140891.300804:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:467:x1830960573955712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 364us (538us total) trans 8589945211 rc 0/0 00000100:00100000:3.0:1746140891.300810:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10874 00000100:00100000:0.0:1746140891.302519:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.302552:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.302582:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.302584:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573955840 00000100:00100000:3.0:1746140891.302591:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573955840 00000100:00100000:0.0:1746140891.302597:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.302626:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573956096 00000100:00100000:3.0:1746140891.302627:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573956096 00000100:00100000:0.0:1746140891.302627:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.302639:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573956352 00000100:00100000:3.0:1746140891.302640:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573956352 00000100:00100000:3.0:1746140891.302648:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573955968 00000100:00100000:3.0:1746140891.302649:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573955968 00000100:00100000:0.0:1746140891.302650:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.302658:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573956224 00000100:00100000:3.0:1746140891.302660:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573956224 00000100:00100000:0.0:1746140891.302664:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573956480 00000100:00100000:0.0:1746140891.302667:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573956480 00000100:00100000:3.0:1746140891.302672:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17529 00000100:00100000:3.0:1746140891.302678:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573955840:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140891.302686:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17530 00010000:00010000:3.0:1746140891.302691:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140891.302691:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573956096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140891.302699:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.302705:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800934b6600/0x8156357b7fdbba1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a239f expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.302708:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23ad expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.302724:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.302726:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.302734:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140891.302748:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576143744:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140891.302748:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 44 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.302759:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f0c00, rc 0) 00000100:00100000:3.0:1746140891.302812:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.302830:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17531 00000100:00100000:3.0:1746140891.302835:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1982:x1830960573956352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.302841:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.302847:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23bb expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.302861:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.302863:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.302868:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 42 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.303036:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 42 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.303044:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe0b000, rc 0) 00000100:00100000:2.0:1746140891.303108:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17532 00000100:00100000:2.0:1746140891.303115:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573955968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.303122:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.303128:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23a6 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.303152:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576143872:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140891.303204:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17533 00000100:00100000:1.0:1746140891.303213:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1982:x1830960573956224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.303218:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.303225:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23b4 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.303233:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.303234:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.303238:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 43 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.303247:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 43 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.303253:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009071a400, rc 0) 00000100:00100000:0.0:1746140891.303582:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573956096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 889us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.303586:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573956352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 749us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.303588:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17530 00000100:00100000:3.0:1746140891.303592:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17531 00000100:00100000:0.0:1746140891.303604:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17534 00000100:00100000:0.0:1746140891.303609:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573956480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140891.303615:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.303622:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23c2 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.303631:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.303632:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.303636:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 45 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.303645:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 45 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140891.304100:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746140891.304151:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f0e00, rc 0) 00000100:00100000:0.0:1746140891.304172:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573956480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 562us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.304178:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17534 00000100:00100000:1.0:1746140891.304241:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1982:x1830960573956224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1027us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.304246:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17533 00000100:00100000:3.0:1746140891.305908:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576143744:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140891.305935:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800934b6600/0x8156357b7fdbba1d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a239f expref: 41 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.305946:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800934b6600/0x8156357b7fdbba1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a239f expref: 41 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.305958:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800934b6600, rc 0) 00000100:00100000:2.0:1746140891.306074:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576143872:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140891.306089:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba32 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23a6 expref: 44 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.306098:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23a6 expref: 44 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.306112:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8dfc00, rc 0) 00000100:00100000:3.0:1746140891.306247:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:1982:x1830960573955840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3567us (3732us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140891.306255:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17529 00000100:00100000:2.0:1746140891.306330:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573955968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3215us (3732us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140891.306335:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17532 00000100:00100000:0.0:1746140891.308256:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.308349:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573956608 00000100:00100000:2.0:1746140891.308358:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573956608 00000100:00100000:2.0:1746140891.308471:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17535 00000100:00100000:2.0:1746140891.308480:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+40:467:x1830960573956608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.308498:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.308513:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23c9 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.308539:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 33 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.308546:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140891.308548:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140891.308551:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 41 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.308578:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 33 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.308588:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 33 pid: 32377 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.308604:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576144000:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.309166:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.310744:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576144000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.310780:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 41 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.310787:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.310796:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8de000, rc 0) 00000100:00100000:2.0:1746140891.310867:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:467:x1830960573956608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2383us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.310876:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17535 00000100:00100000:3.0:1746140891.310880:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573956736 00000100:00100000:3.0:1746140891.311031:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573956736 00002000:00100000:3.0:1746140891.311072:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (884736->1048575) req@ffff88009b892680 x1830960573956736/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.311089:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892680 with x1830960573956736 ext(884736->1048575) 00010000:00010000:3.0:1746140891.311099:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 34 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.311112:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 34 pid: 32377 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.311119:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b892680 00000100:00100000:3.0:1746140891.311194:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1868 00000100:00100000:3.0:1746140891.311201:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+34:1985:x1830960573956736:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140891.313577:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1985:x1830960573956736:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2368us (2789us total) trans 21474841547 rc 0/0 00000100:00100000:3.0:1746140891.313585:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1868 00002000:00100000:3.0:1746140891.313594:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (884736->1048575) req@ffff88009b892680 x1830960573956736/t21474841547(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.313601:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892680 with x1830960573956736 ext(884736->1048575) 00010000:00010000:3.0:1746140891.313608:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 36 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.313619:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 36 pid: 32377 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.313624:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b892680 00000100:00100000:0.0:1746140891.314692:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.314777:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573956864 00000100:00100000:3.0:1746140891.314783:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573956864 00010000:00010000:3.0:1746140891.314809:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 36 pid: 32377 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.314876:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9085 00000100:00100000:3.0:1746140891.314883:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1983:x1830960573956864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.314895:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.314913:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 36 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.314923:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 36 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.314944:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbb9fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 884736->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a238a expref: 36 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.314966:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.314968:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.314976:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 40 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.314992:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 40 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.315022:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 40 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.315039:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576144128:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.315099:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.317715:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576144128:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.317736:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.317780:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1983:x1830960573956864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2896us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.317789:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9085 00000100:00100000:0.0:1746140891.318093:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.318148:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573957120 00000100:00100000:3.0:1746140891.318153:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573957120 00002000:00100000:3.0:1746140891.318190:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880093134a80 x1830960573957120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.318199:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093134a80 with x1830960573957120 ext(0->1048575) 00002000:00010000:3.0:1746140891.318203:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093134a80 00000100:00100000:3.0:1746140891.318220:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8989 00000100:00100000:3.0:1746140891.318226:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573957120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.325481:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573957120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7244us (7378us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.325494:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8989 00002000:00100000:3.0:1746140891.325505:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880093134a80 x1830960573957120/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.325515:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093134a80 with x1830960573957120 ext(0->1048575) 00002000:00010000:3.0:1746140891.325520:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093134a80 00000100:00100000:0.0:1746140891.334115:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.334251:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573957248 00000100:00100000:2.0:1746140891.334260:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573957248 00000100:00100000:2.0:1746140891.334406:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17536 00000100:00100000:2.0:1746140891.334415:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:467:x1830960573957248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.334433:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.334452:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23d0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.334482:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.334488:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140891.334490:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140891.334493:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 44 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.334527:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 25 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.334539:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 25 pid: 32377 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.334747:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576144256:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.335508:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.335948:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576144256:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.335968:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 44 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.335990:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8de800, rc 0) 00000100:00100000:2.0:1746140891.336022:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:467:x1830960573957248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1609us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.336029:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17536 00000100:00100000:0.0:1746140891.337795:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.338148:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573957376 00000100:00100000:3.0:1746140891.338158:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573957376 00002000:00100000:3.0:1746140891.338202:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1822719) req@ffff880093136d80 x1830960573957376/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.338211:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136d80 with x1830960573957376 ext(1048576->1822719) 00010000:00010000:3.0:1746140891.338221:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 26 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.338236:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 26 pid: 32377 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.338242:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093136d80 00000100:00100000:3.0:1746140891.338273:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1869 00000100:00100000:3.0:1746140891.338281:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573957376:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140891.346882:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573957376:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8596us (9096us total) trans 17179874247 rc 0/0 00000100:00100000:3.0:1746140891.346891:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1869 00002000:00100000:3.0:1746140891.346904:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->1822719) req@ffff880093136d80 x1830960573957376/t17179874247(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.346913:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136d80 with x1830960573957376 ext(1048576->1822719) 00010000:00010000:3.0:1746140891.346922:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 28 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.346936:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 28 pid: 32377 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.346956:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093136d80 00000100:00100000:0.0:1746140891.350681:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.350744:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573957504 00000100:00100000:3.0:1746140891.350752:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573957504 00010000:00010000:3.0:1746140891.350785:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 28 pid: 32377 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.350822:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9086 00000100:00100000:3.0:1746140891.350829:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573957504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.350841:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.350861:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 28 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.350871:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 28 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.350891:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb000/0x8156357b7fdbba01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1822719) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2391 expref: 28 pid: 32377 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.350924:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.350926:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.350936:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.350944:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.350988:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.350999:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576144384:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.351081:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.352552:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576144384:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.352568:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.352598:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1983:x1830960573957504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1769us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.352606:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9086 00000100:00100000:0.0:1746140891.358088:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.358130:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.358212:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.358240:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573957888 00000100:00100000:1.0:1746140891.358248:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573957888 00002000:00100000:1.0:1746140891.358289:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880093135f80 x1830960573957888/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140891.358296:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573958016 00002000:00100000:1.0:1746140891.358296:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135f80 with x1830960573957888 ext(1048576->2097151) 00000100:00100000:3.0:1746140891.358301:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573958016 00002000:00010000:1.0:1746140891.358301:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093135f80 00002000:00100000:3.0:1746140891.358337:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880093137800 x1830960573958016/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.358344:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137800 with x1830960573958016 ext(1048576->2097151) 00000100:00100000:1.0:1746140891.358346:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573958272 00002000:00010000:3.0:1746140891.358347:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093137800 00000100:00100000:1.0:1746140891.358348:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573958272 00002000:00100000:1.0:1746140891.358357:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880093135880 x1830960573958272/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.358361:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135880 with x1830960573958272 ext(1048576->2097151) 00000100:00100000:3.0:1746140891.358362:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8990 00002000:00010000:1.0:1746140891.358363:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135880 00000100:00100000:3.0:1746140891.358369:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573957888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.358373:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8991 00000100:00100000:1.0:1746140891.358376:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573958016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.358528:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8992 00000100:00100000:2.0:1746140891.358536:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573958272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.371750:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1985:x1830960573958016:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13358us (13605us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.371767:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8991 00002000:00100000:1.0:1746140891.371778:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880093137800 x1830960573958016/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.371788:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093137800 with x1830960573958016 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.371794:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093137800 00000100:00100000:3.0:1746140891.372542:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573957888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14165us (14453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.372554:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8990 00002000:00100000:3.0:1746140891.372563:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880093135f80 x1830960573957888/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.372578:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135f80 with x1830960573957888 ext(1048576->2097151) 00002000:00010000:3.0:1746140891.372582:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093135f80 00000100:00100000:2.0:1746140891.373731:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573958272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15186us (15510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.373742:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8992 00002000:00100000:2.0:1746140891.373751:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880093135880 x1830960573958272/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.373766:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135880 with x1830960573958272 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.373771:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135880 00000100:00100000:0.0:1746140891.386023:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.386061:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.386097:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.386116:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573958528 00000100:00100000:3.0:1746140891.386125:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573958528 00000100:00100000:1.0:1746140891.386144:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573958784 00000100:00100000:1.0:1746140891.386152:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573958784 00002000:00100000:3.0:1746140891.386162:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880093135c00 x1830960573958528/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140891.386163:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573959040 00000100:00100000:2.0:1746140891.386167:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573959040 00002000:00100000:3.0:1746140891.386169:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135c00 with x1830960573958528 ext(2097152->3145727) 00002000:00010000:3.0:1746140891.386174:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135c00 00002000:00100000:1.0:1746140891.386196:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880093136a00 x1830960573958784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140891.386202:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8993 00000100:00100000:3.0:1746140891.386207:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573958528:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746140891.386207:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136a00 with x1830960573958784 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.386212:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093136a00 00000100:00100000:1.0:1746140891.386239:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8994 00000100:00100000:1.0:1746140891.386246:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1984:x1830960573958784:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.386344:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.386357:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573959296 00000100:00100000:0.0:1746140891.386359:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573959296 00002000:00100000:0.0:1746140891.386374:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b182680 x1830960573959296/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.386382:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182680 with x1830960573959296 ext(3145728->4194303) 00002000:00010000:0.0:1746140891.386385:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b182680 00000100:00100000:0.0:1746140891.386398:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8995 00000100:00100000:0.0:1746140891.386403:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573959296:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746140891.387374:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b180a80 x1830960573959040/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.387385:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180a80 with x1830960573959040 ext(2097152->3145727) 00002000:00010000:2.0:1746140891.387390:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b180a80 00000100:00100000:2.0:1746140891.387414:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8996 00000100:00100000:2.0:1746140891.387422:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1984:x1830960573959040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.394799:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573958528:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8583us (8779us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.394809:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8993 00002000:00100000:3.0:1746140891.394820:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880093135c00 x1830960573958528/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.394829:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093135c00 with x1830960573958528 ext(2097152->3145727) 00002000:00010000:3.0:1746140891.394834:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093135c00 00000100:00100000:2.0:1746140891.397261:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1985:x1830960573959296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10847us (10906us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.397273:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8995 00002000:00100000:2.0:1746140891.397283:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88012b182680 x1830960573959296/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.397293:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b182680 with x1830960573959296 ext(3145728->4194303) 00002000:00010000:2.0:1746140891.397299:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b182680 00000100:00100000:1.0:1746140891.398521:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573958784:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12272us (12455us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.398529:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8994 00002000:00100000:1.0:1746140891.398537:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880093136a00 x1830960573958784/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.398545:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093136a00 with x1830960573958784 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.398549:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093136a00 00000100:00100000:2.0:1746140891.401019:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573959040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13589us (14910us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.401030:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8996 00002000:00100000:2.0:1746140891.401040:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012b180a80 x1830960573959040/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.401049:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b180a80 with x1830960573959040 ext(2097152->3145727) 00002000:00010000:2.0:1746140891.401055:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b180a80 00000100:00100000:0.0:1746140891.406551:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.406729:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573959552 00000100:00100000:2.0:1746140891.406739:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573959552 00002000:00100000:2.0:1746140891.406781:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b183b80 x1830960573959552/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.406791:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b183b80 with x1830960573959552 ext(4194304->4886527) 00002000:00010000:2.0:1746140891.406796:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b183b80 00000100:00100000:2.0:1746140891.406831:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8997 00000100:00100000:2.0:1746140891.406838:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573959552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.413055:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573959552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6210us (6508us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140891.413065:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8997 00002000:00100000:2.0:1746140891.413080:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88012b183b80 x1830960573959552/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.413088:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b183b80 with x1830960573959552 ext(4194304->4886527) 00002000:00010000:2.0:1746140891.413095:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b183b80 00000100:00100000:0.0:1746140891.424506:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.424722:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573959808 00000100:00100000:2.0:1746140891.424732:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573959808 00000100:00100000:2.0:1746140891.424793:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10875 00000100:00100000:2.0:1746140891.424801:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:469:x1830960573959808:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140891.424824:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.424842:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df800/0x8156357b7fdbba55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23d7 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.424941:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.424958:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 21 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.424965:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 285 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.424972:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.425018:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 285 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.425030:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 285 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.425042:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576144512:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.425276:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 21 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.425289:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 21 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.425298:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576144640:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.425390:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.426357:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.426395:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.426410:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573960064 00000100:00100000:3.0:1746140891.426421:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573960064 00000100:00100000:1.0:1746140891.426439:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573959936 00000100:00100000:1.0:1746140891.426444:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573959936 00000100:00100000:2.0:1746140891.426450:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576144512:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.426461:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576144640:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.426471:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 286 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.426486:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 22 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.426488:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:3.0:1746140891.426544:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9087 00000100:00100000:3.0:1746140891.426551:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:1985:x1830960573959936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140891.426552:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9088 00010000:00010000:3.0:1746140891.426561:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140891.426561:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960573960064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.426566:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 286 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.426571:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.426574:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 286 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.426579:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 22 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.426592:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbb9a6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a233d expref: 286 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.426595:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 22 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.426611:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140891.426611:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b1b3a00/0x8156357b7fdbb983 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2336 expref: 22 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.426615:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.426625:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.426632:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.426644:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140891.426648:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.426680:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+21:1984:x1830960573960064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.426686:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9088 00010000:00010000:3.0:1746140891.426710:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.426727:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.426733:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:3.0:1746140891.426735:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1985:x1830960573959936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 186us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.426741:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9087 00000004:00200000:2.0:1746140891.426747:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140891.426856:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df800/0x8156357b7fdbba55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 286 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.426878:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 285 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.426884:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.426887:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140891.426889:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8dfc00, rc 0) 00000100:00100000:2.0:1746140891.426924:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:469:x1830960573959808:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2124us (2429us total) trans 8589945212 rc 0/0 00000100:00100000:2.0:1746140891.426930:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10875 00000100:00100000:0.0:1746140891.449627:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.449900:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573960320 00000100:00100000:2.0:1746140891.449912:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573960320 00000100:00100000:2.0:1746140891.450011:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10876 00000100:00100000:2.0:1746140891.450019:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:473:x1830960573960320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.450042:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.450060:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfe00/0x8156357b7fdbba6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23de expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.450168:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450178:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450187:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450199:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450204:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450209:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450292:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de600/0x8156357b7fdbba7f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450299:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de600/0x8156357b7fdbba7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450338:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de600/0x8156357b7fdbba7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140891.450346:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140891.450415:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450421:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450430:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450436:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b8dfa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140891.450440:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450446:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450455:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140891.450458:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140891.450461:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450466:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbba71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450492:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450497:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450502:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450506:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b8df600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140891.450508:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450513:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450522:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a47f2d00) 00010000:00010000:2.0:1746140891.450524:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140891.450526:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450531:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbba78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.450565:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfe00/0x8156357b7fdbba6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23de expref: 24 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.450576:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de600/0x8156357b7fdbba7f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23de expref: 23 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.450582:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.450584:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140891.450586:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8de600, rc 0) 00000100:00100000:2.0:1746140891.450654:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:473:x1830960573960320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 636us (1037us total) trans 8589945213 rc 0/0 00000100:00100000:2.0:1746140891.450662:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10876 00000100:00100000:0.0:1746140891.452654:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.452684:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.452716:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.452749:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573960576 00000100:00100000:0.0:1746140891.452755:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573960576 00000100:00100000:0.0:1746140891.452793:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573960704 00000100:00100000:0.0:1746140891.452795:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573960704 00000100:00100000:0.0:1746140891.452806:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17537 00000100:00100000:0.0:1746140891.452810:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573960576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140891.452825:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.452838:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23e5 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.452856:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.452858:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.452864:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 36 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140891.452874:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17538 00010000:00010000:0.0:1746140891.452876:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 36 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.452883:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bce00, rc 0) 00000100:00100000:1.0:1746140891.452890:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1984:x1830960573960704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.452905:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140891.452917:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1984:x1830960573960576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 106us (289us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140891.452920:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23ec expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.452921:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17537 00010000:00010000:1.0:1746140891.452943:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.452945:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.452951:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 28 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.452964:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 28 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.452974:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009071a800, rc 0) 00000100:00100000:3.0:1746140891.453021:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573960448 00000100:00100000:3.0:1746140891.453028:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573960448 00000100:00100000:1.0:1746140891.453115:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573960704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 231us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.453120:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 793 00000100:00100000:1.0:1746140891.453121:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17538 00000100:00100000:3.0:1746140891.453126:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573960448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.453137:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.453156:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de600/0x8156357b7fdbba7f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23de expref: 23 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.453180:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.453188:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.453209:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1985:x1830960573960448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.453215:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 793 00000100:00100000:0.0:1746140891.457538:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.457599:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.457679:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573960960 00000100:00100000:2.0:1746140891.457688:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573960960 00000100:00100000:1.0:1746140891.457701:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573961216 00000100:00100000:1.0:1746140891.457713:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573961216 00002000:00100000:2.0:1746140891.457731:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88013569b100 x1830960573960960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.457742:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b100 with x1830960573960960 ext(0->1048575) 00002000:00010000:2.0:1746140891.457747:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569b100 00002000:00100000:1.0:1746140891.457753:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880135699f80 x1830960573961216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.457763:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699f80 with x1830960573961216 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.457767:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135699f80 00000100:00100000:2.0:1746140891.457780:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8998 00000100:00100000:2.0:1746140891.457787:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1985:x1830960573960960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.457793:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8999 00000100:00100000:1.0:1746140891.457800:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573961216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.464573:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573961216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6639us (6840us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.464585:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8999 00002000:00100000:1.0:1746140891.464598:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880135699f80 x1830960573961216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.464608:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699f80 with x1830960573961216 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.464614:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135699f80 00000100:00100000:2.0:1746140891.468949:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1985:x1830960573960960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11151us (11410us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.468961:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8998 00002000:00100000:2.0:1746140891.468989:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88013569b100 x1830960573960960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.469000:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569b100 with x1830960573960960 ext(0->1048575) 00002000:00010000:2.0:1746140891.469006:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569b100 00000100:00100000:0.0:1746140891.488903:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.489058:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573961472 00000100:00100000:1.0:1746140891.489071:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573961472 00000100:00100000:1.0:1746140891.489146:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4802 00000100:00100000:1.0:1746140891.489153:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+22:473:x1830960573961472:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746140891.489426:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+23:473:x1830960573961472:12345-192.168.204.16@tcp:35:cat.0 Request processed in 272us (534us total) trans 8589945214 rc 0/0 00000100:00100000:1.0:1746140891.489432:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4802 00000100:00100000:0.0:1746140891.493444:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.493561:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573961600 00000100:00100000:1.0:1746140891.493571:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573961600 00000100:00100000:1.0:1746140891.493632:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17539 00000100:00100000:1.0:1746140891.493642:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:469:x1830960573961600:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140891.493662:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.493680:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23f3 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.493709:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 35 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.493721:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 42 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.493728:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.493729:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.493733:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1400832->2097151] (req 1400832->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.493761:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 42 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.493772:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 42 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.493784:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576144768:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.494300:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 35 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.494342:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 35 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.494350:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576144896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.494510:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.495800:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576144768:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140891.497154:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.497244:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573961728 00000100:00100000:3.0:1746140891.497256:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573961728 00010000:00010000:3.0:1746140891.497295:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 43 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.497367:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9089 00000100:00100000:3.0:1746140891.497374:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573961728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.497386:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.497411:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 43 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.497421:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 43 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.497441:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009071a400/0x8156357b7fdbba39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23b4 expref: 43 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.497475:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.497524:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1984:x1830960573961728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.497532:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9089 00000100:00100000:1.0:1746140891.497549:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576144896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.497575:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1400832->2097151] (req 1400832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 41 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.497590:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009071b000, rc 0) 00000100:00100000:1.0:1746140891.497703:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:469:x1830960573961600:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4063us (4266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.497711:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17539 00000100:00100000:3.0:1746140891.498726:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.498726:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.498768:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573962112 00000100:00100000:3.0:1746140891.498773:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573962112 00000100:00100000:3.0:1746140891.498807:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10877 00000100:00100000:2.0:1746140891.498810:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573961856 00000100:00100000:3.0:1746140891.498813:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:477:x1830960573962112:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:2.0:1746140891.498817:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573961856 00010000:00010000:3.0:1746140891.498834:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.498845:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 36 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.498849:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbbaa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a23fa expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.498868:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9090 00000100:00100000:2.0:1746140891.498873:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a49bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1985:x1830960573961856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.498886:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.498906:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 36 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.498916:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 36 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.498935:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8d400/0x8156357b7fdbb9c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2359 expref: 36 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.498953:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.498958:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.498960:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.498964:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.498967:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 40 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.498972:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.498986:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 40 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.498999:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499004:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499009:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.499016:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 40 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.499027:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576145024:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140891.499087:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453300 going to sleep for 11 seconds 00010000:00010000:3.0:1746140891.499106:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b400/0x8156357b7fdbbab7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499114:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b400/0x8156357b7fdbbab7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499120:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b400/0x8156357b7fdbbab7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140891.499127:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140891.499201:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499207:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499212:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499217:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe0ae00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.499220:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499225:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499231:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140891.499233:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.499236:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499240:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0ae00/0x8156357b7fdbbaa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499247:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499250:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499259:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499262:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe0b600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.499264:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499268:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499272:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388000) 00010000:00010000:3.0:1746140891.499274:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.499275:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499278:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b600/0x8156357b7fdbbab0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.499337:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a400/0x8156357b7fdbbaa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23fa expref: 26 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.499347:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b400/0x8156357b7fdbbab7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23fa expref: 25 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.499353:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.499355:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140891.499357:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe0b400, rc 0) 00000100:00100000:3.0:1746140891.499393:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:477:x1830960573962112:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 580us (667us total) trans 8589945215 rc 0/0 00000100:00100000:3.0:1746140891.499398:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10877 00000100:00100000:2.0:1746140891.500722:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576145024:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140891.500744:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.500779:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a49bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1985:x1830960573961856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1905us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.500788:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9090 00000100:00100000:0.0:1746140891.501301:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.501438:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.501533:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573962496 00000100:00100000:3.0:1746140891.501541:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573962496 00000100:00100000:2.0:1746140891.501560:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573962368 00000100:00100000:2.0:1746140891.501564:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573962368 00002000:00100000:2.0:1746140891.501648:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a2:0x0] (1400832->1404927) req@ffff880135698a80 x1830960573962368/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746140891.502141:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 794 00000100:00100000:3.0:1746140891.502706:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573962496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.502723:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.502754:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0b400/0x8156357b7fdbbab7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23fa expref: 25 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.502776:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.502781:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746140891.503019:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698a80 with x1830960573962368 ext(1400832->1404927) 00002000:00010000:2.0:1746140891.503024:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135698a80 00000100:00100000:3.0:1746140891.503038:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960573962496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 337us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.503045:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 794 00000100:00100000:0.0:1746140891.503053:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9000 00000100:00100000:0.0:1746140891.503071:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573962368:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746140891.503245:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1985:x1830960573962368:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 183us (1948us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140891.503252:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9000 00002000:00100000:0.0:1746140891.503258:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1400832->1404927) req@ffff880135698a80 x1830960573962368/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.503272:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135698a80 with x1830960573962368 ext(1400832->1404927) 00002000:00010000:0.0:1746140891.503274:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135698a80 00000100:00100000:0.0:1746140891.505426:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.505496:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573962624 00000100:00100000:1.0:1746140891.505505:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573962624 00000100:00100000:1.0:1746140891.505560:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17540 00000100:00100000:1.0:1746140891.505568:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+35:477:x1830960573962624:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140891.505586:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.505603:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2401 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.505632:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 40 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.505638:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140891.505640:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140891.505643:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1757184->1916927] (req 1757184->1916927) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.505672:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 40 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.505688:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 40 pid: 9872 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.505698:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145152:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.505800:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.507587:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145152:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.507617:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1757184->1916927] (req 1757184->1916927) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 36 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.507634:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009071b800, rc 0) 00000100:00100000:1.0:1746140891.508047:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+36:477:x1830960573962624:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2478us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.508055:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17540 00000100:00100000:0.0:1746140891.511198:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.511293:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.511392:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573963008 00000100:00100000:1.0:1746140891.511398:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573962880 00000100:00100000:2.0:1746140891.511403:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573963008 00000100:00100000:1.0:1746140891.511403:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573962880 00002000:00100000:2.0:1746140891.511449:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1400832->2097151) req@ffff88009abdf100 x1830960573963008/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746140891.511449:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17541 00002000:00100000:2.0:1746140891.511470:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf100 with x1830960573963008 ext(1400832->2097151) 00010000:00010000:2.0:1746140891.511480:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 42 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.511496:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 42 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.511504:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abdf100 00000100:00100000:2.0:1746140891.511526:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1870 00000100:00100000:2.0:1746140891.511532:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1985:x1830960573963008:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746140891.511601:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:469:x1830960573962880:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140891.511612:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.511626:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2408 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.511650:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 35 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.511662:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 43 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.511668:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.511670:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.511672:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 43 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.511700:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 43 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.511710:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 43 pid: 4186 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.511721:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145280:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.511839:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 35 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.511898:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 35 pid: 8459 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.511905:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145408:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.511924:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059600 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.513091:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145280:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.513106:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145408:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.513127:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 44 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.513142:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009071b200, rc 0) 00000100:00100000:1.0:1746140891.513169:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:469:x1830960573962880:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1713us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.513178:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17541 00000100:00100000:0.0:1746140891.516858:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.517177:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573963136 00000100:00100000:3.0:1746140891.517186:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573963136 00010000:00010000:3.0:1746140891.517223:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 44 pid: 4186 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.517251:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9091 00000100:00100000:3.0:1746140891.517258:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573963136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.517271:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.517294:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 44 pid: 4186 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.517333:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 44 pid: 4186 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.517359:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe0b000/0x8156357b7fdbba2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23bb expref: 44 pid: 4186 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.517393:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.517432:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573963136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 173us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.517438:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9091 00000100:00100000:1.0:1746140891.520480:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.520552:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573963264 00000100:00100000:2.0:1746140891.520560:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573963264 00010000:00010000:2.0:1746140891.520590:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 36 pid: 8459 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.520701:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9092 00000100:00100000:2.0:1746140891.520709:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1984:x1830960573963264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.520721:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.520740:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 36 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.520751:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 36 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.520773:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbb9d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2360 expref: 36 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.521767:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.521773:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.521786:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.521796:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.521841:0:8473:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.521855:0:8473:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576145536:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140891.521948:0:8473:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.524203:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573963008:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 12659us (12897us total) trans 21474841548 rc 0/0 00000100:00100000:0.0:1746140891.524216:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1870 00002000:00100000:0.0:1746140891.524227:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1400832->2097151) req@ffff88009abdf100 x1830960573963008/t21474841548(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.524237:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf100 with x1830960573963008 ext(1400832->2097151) 00010000:00010000:0.0:1746140891.524247:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.524262:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:0.0:1746140891.524269:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abdf100 00000100:00100000:1.0:1746140891.525432:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.525563:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573963520 00000100:00100000:0.0:1746140891.525572:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573963520 00002000:00100000:0.0:1746140891.525604:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (2101248->2105343) req@ffff880093130a80 x1830960573963520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.525613:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130a80 with x1830960573963520 ext(2101248->2105343) 00002000:00010000:0.0:1746140891.525619:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093130a80 00000100:00100000:0.0:1746140891.525638:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9001 00000100:00100000:0.0:1746140891.525645:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573963520:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140891.525662:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.525693:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573963648 00000100:00100000:3.0:1746140891.525700:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573963648 00000100:00100000:2.0:1746140891.525703:0:8473:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8473:1830960576145536:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140891.525724:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140891.525729:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 44 pid: 9872 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.525757:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9093 00000100:00100000:2.0:1746140891.525762:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573963264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5054us (5291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.525765:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573963648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140891.525770:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9092 00010000:00010000:3.0:1746140891.525777:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746140891.525792:0:7110:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140891 -> 1746140892 00002000:00010000:3.0:1746140891.525795:0:7110:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140891 -> 1746140892 00010000:00010000:3.0:1746140891.525800:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 44 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.525811:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 44 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.525831:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009071b000/0x8156357b7fdbba9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23f3 expref: 44 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.525845:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.525847:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.525853:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 34 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.525861:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 34 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.525875:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573963520:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 153us (369us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746140891.525882:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9001 00010000:00010000:3.0:1746140891.525888:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 34 pid: 9872 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746140891.525888:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (2101248->2105343) req@ffff880093130a80 x1830960573963520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.525895:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130a80 with x1830960573963520 ext(2101248->2105343) 00002000:00010000:0.0:1746140891.525898:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093130a80 00000100:00100000:3.0:1746140891.525899:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576145664:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.526003:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.527636:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576145664:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.527651:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.527681:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.527719:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1982:x1830960573963648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1954us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.527721:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573963904 00000100:00100000:3.0:1746140891.527727:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9093 00000100:00100000:1.0:1746140891.527727:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573963904 00002000:00100000:1.0:1746140891.527759:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1757184->1761279) req@ffff88009abde680 x1830960573963904/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.527770:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abde680 with x1830960573963904 ext(1757184->1761279) 00002000:00010000:1.0:1746140891.527774:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abde680 00000100:00100000:1.0:1746140891.527794:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9002 00000100:00100000:1.0:1746140891.527800:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1985:x1830960573963904:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140891.527922:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1985:x1830960573963904:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 122us (241us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140891.527928:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9002 00002000:00100000:1.0:1746140891.527934:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1757184->1761279) req@ffff88009abde680 x1830960573963904/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.527941:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abde680 with x1830960573963904 ext(1757184->1761279) 00002000:00010000:1.0:1746140891.527945:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abde680 00000100:00100000:0.0:1746140891.533228:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.533343:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573964032 00000100:00100000:1.0:1746140891.533353:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573964032 00000100:00100000:0.0:1746140891.533363:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.533401:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17542 00000100:00100000:1.0:1746140891.533408:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573964032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.533425:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.533441:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009071be00/0x8156357b7fdbbad3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a240f expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.533491:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145792:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140891.533573:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059600 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.533578:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573964288 00000100:00100000:2.0:1746140891.533583:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573964288 00002000:00100000:2.0:1746140891.533609:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1912832->1916927) req@ffff88009abdc000 x1830960573964288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.533619:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc000 with x1830960573964288 ext(1912832->1916927) 00002000:00010000:2.0:1746140891.533623:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdc000 00000100:00100000:2.0:1746140891.533638:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9003 00000100:00100000:2.0:1746140891.533646:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573964288:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140891.533794:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573964288:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 148us (430us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140891.533800:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9003 00002000:00100000:2.0:1746140891.533805:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1912832->1916927) req@ffff88009abdc000 x1830960573964288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.533813:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdc000 with x1830960573964288 ext(1912832->1916927) 00002000:00010000:2.0:1746140891.533816:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdc000 00002000:00010000:1.0:1746140891.535688:0:9872:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140891 -> 1746140892 00000100:00100000:1.0:1746140891.535712:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145792:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140891.535739:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009071be00/0x8156357b7fdbbad3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a240f expref: 43 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.535751:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009071be00/0x8156357b7fdbbad3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a240f expref: 43 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.535781:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009071be00, rc 0) 00000100:00100000:1.0:1746140891.535823:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573964032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2415us (2607us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140891.535831:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17542 00000100:00100000:0.0:1746140891.535875:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.536462:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573964544 00000100:00100000:2.0:1746140891.536469:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573964544 00000100:00100000:2.0:1746140891.536515:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4803 00000100:00100000:2.0:1746140891.536522:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+24:477:x1830960573964544:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140891.536775:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:477:x1830960573964544:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 253us (899us total) trans 8589945216 rc 0/0 00000100:00100000:2.0:1746140891.536781:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4803 00000100:00100000:0.0:1746140891.540231:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.542778:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573964672 00000100:00100000:1.0:1746140891.542791:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573964672 00000100:00100000:1.0:1746140891.542859:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17543 00000100:00100000:1.0:1746140891.542867:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:482:x1830960573964672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.542885:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.542906:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2416 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.542937:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 34 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.542944:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140891.542946:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140891.542949:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 43 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.542991:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 34 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.543003:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 34 pid: 9872 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.543015:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145920:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.543116:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.545196:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.545333:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576145920:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.545359:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 43 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.545376:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009071ba00, rc 0) 00000100:00100000:1.0:1746140891.545419:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:482:x1830960573964672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2553us (5198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.545425:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573964800 00000100:00100000:1.0:1746140891.545429:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17543 00000100:00100000:2.0:1746140891.545432:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573964800 00002000:00100000:2.0:1746140891.545473:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1757184->1916927) req@ffff88009abded80 x1830960573964800/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.545484:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abded80 with x1830960573964800 ext(1757184->1916927) 00010000:00010000:2.0:1746140891.545490:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 35 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.545502:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 35 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.545513:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abded80 00000100:00100000:2.0:1746140891.545539:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1871 00000100:00100000:2.0:1746140891.545547:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+35:1984:x1830960573964800:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746140891.549754:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573964800:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4197us (4555us total) trans 21474841549 rc 0/0 00000100:00100000:2.0:1746140891.549766:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1871 00002000:00100000:2.0:1746140891.550134:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1757184->1916927) req@ffff88009abded80 x1830960573964800/t21474841549(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.550145:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abded80 with x1830960573964800 ext(1757184->1916927) 00010000:00010000:2.0:1746140891.550155:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 37 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.550171:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 37 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.550179:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009abded80 00000100:00100000:0.0:1746140891.553130:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.553233:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573964928 00000100:00100000:3.0:1746140891.553243:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573964928 00010000:00010000:3.0:1746140891.553277:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 37 pid: 9872 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.553640:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9094 00000100:00100000:3.0:1746140891.553648:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1982:x1830960573964928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.553666:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.553693:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 37 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.553706:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 37 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.553728:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009071b800/0x8156357b7fdbbac5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->1916927) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2401 expref: 37 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.553920:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.553922:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.553929:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.553938:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.553970:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.553995:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576146048:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.554779:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.556647:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576146048:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.556666:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.556987:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1982:x1830960573964928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3328us (3855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.556998:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9094 00000100:00100000:0.0:1746140891.557811:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.557907:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573965184 00000100:00100000:2.0:1746140891.557913:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573965184 00002000:00100000:2.0:1746140891.557947:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009abdf800 x1830960573965184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.557956:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf800 with x1830960573965184 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.557961:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdf800 00000100:00100000:2.0:1746140891.557990:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9004 00000100:00100000:2.0:1746140891.557999:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573965184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.564465:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573965184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6456us (6644us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.564476:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9004 00002000:00100000:2.0:1746140891.564486:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009abdf800 x1830960573965184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.564496:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf800 with x1830960573965184 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.564501:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdf800 00000100:00100000:0.0:1746140891.573399:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.573512:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573965440 00000100:00100000:2.0:1746140891.573521:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573965440 00002000:00100000:2.0:1746140891.573564:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (2105344->3153919) req@ffff880094af6300 x1830960573965440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.573573:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af6300 with x1830960573965440 ext(2105344->3153919) 00002000:00010000:2.0:1746140891.573579:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af6300 00000100:00100000:2.0:1746140891.573598:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9005 00000100:00100000:2.0:1746140891.573604:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573965440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.573709:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.573788:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573965568 00000100:00100000:3.0:1746140891.573793:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573965568 00002000:00100000:3.0:1746140891.573809:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3153920->4194303) req@ffff880093131c00 x1830960573965568/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.573817:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131c00 with x1830960573965568 ext(3153920->4194303) 00002000:00010000:3.0:1746140891.573820:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093131c00 00000100:00100000:3.0:1746140891.573833:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9006 00000100:00100000:3.0:1746140891.573839:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573965568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.581227:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573965440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7610us (7827us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.581240:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9005 00002000:00100000:2.0:1746140891.581252:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (2105344->3153919) req@ffff880094af6300 x1830960573965440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.581263:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af6300 with x1830960573965440 ext(2105344->3153919) 00002000:00010000:2.0:1746140891.581269:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af6300 00000100:00100000:3.0:1746140891.584011:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573965568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10158us (10289us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746140891.584022:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9006 00002000:00100000:3.0:1746140891.584031:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3153920->4194303) req@ffff880093131c00 x1830960573965568/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.584041:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131c00 with x1830960573965568 ext(3153920->4194303) 00002000:00010000:3.0:1746140891.584047:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093131c00 00000100:00100000:0.0:1746140891.587918:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.588075:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573965952 00000100:00100000:3.0:1746140891.588088:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573965952 00002000:00100000:3.0:1746140891.588137:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094af5180 x1830960573965952/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.588146:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5180 with x1830960573965952 ext(4194304->4886527) 00002000:00010000:3.0:1746140891.588151:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5180 00000100:00100000:3.0:1746140891.588189:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9007 00000100:00100000:3.0:1746140891.588196:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573965952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.595500:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573965952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7293us (7585us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746140891.595512:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9007 00002000:00100000:3.0:1746140891.595525:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880094af5180 x1830960573965952/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.595534:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094af5180 with x1830960573965952 ext(4194304->4886527) 00002000:00010000:3.0:1746140891.595539:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094af5180 00000100:00100000:0.0:1746140891.621456:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.621555:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573966080 00000100:00100000:3.0:1746140891.621567:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573966080 00000100:00100000:3.0:1746140891.621635:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10878 00000100:00100000:3.0:1746140891.621646:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:487:x1830960573966080:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140891.621672:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.621688:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbbae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a241d expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.621740:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.621752:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.621762:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.621773:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.621777:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.621785:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.621881:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.621891:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 284 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.621898:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.621929:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 284 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.621940:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 284 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.621950:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576146176:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.622068:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.624359:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.624487:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576146176:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.624488:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573966336 00000100:00100000:2.0:1746140891.624496:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573966336 00010000:00010000:3.0:1746140891.624506:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140891.624533:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4804 00000100:00100000:2.0:1746140891.624539:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca7a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:27404:x1830960573966336:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746140891.625104:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca7a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:27404:x1830960573966336:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 564us (749us total) trans 8589945217 rc 0/0 00000100:00100000:2.0:1746140891.625111:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4804 00000100:00100000:0.0:1746140891.626128:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.626799:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573966464 00000100:00100000:3.0:1746140891.626806:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573966464 00010000:00010000:3.0:1746140891.626835:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 286 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.626870:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9095 00000100:00100000:3.0:1746140891.626877:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:1984:x1830960573966464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.626886:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.626891:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 286 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.626901:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 286 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.626920:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfc00/0x8156357b7fdbba5c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d7 expref: 286 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.626931:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.626935:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.626944:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.626950:0:7110:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.626982:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.627023:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1984:x1830960573966464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 146us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.627028:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9095 00010000:00010000:0.0:1746140891.627116:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627126:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:0.0:1746140891.627169:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140891.627172:0:14741:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140891.627186:0:14741:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627195:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627202:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627205:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627209:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627212:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe0aa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140891.627215:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627219:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627227:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140891.627229:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140891.627231:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627234:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0aa00/0x8156357b7fdbbae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627255:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627259:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627262:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627264:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe0be00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:0.0:1746140891.627265:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627267:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627270:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388c00) 00010000:00010000:0.0:1746140891.627272:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746140891.627273:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627275:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0be00/0x8156357b7fdbbaef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.627323:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0a600/0x8156357b7fdbbae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.627334:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.627338:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140891.627340:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140891.627341:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe0bc00, rc 0) 00000100:00100000:0.0:1746140891.627397:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:487:x1830960573966080:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5754us (5951us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.627406:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10878 00000100:00100000:0.0:1746140891.629125:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.630126:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.630150:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.630168:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573966592 00000100:00100000:0.0:1746140891.630174:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573966592 00000100:00100000:0.0:1746140891.630200:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573966720 00000100:00100000:0.0:1746140891.630201:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573966720 00000100:00100000:0.0:1746140891.630209:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573966976 00000100:00100000:0.0:1746140891.630210:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573966976 00000100:00100000:0.0:1746140891.630229:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17544 00000100:00100000:0.0:1746140891.630235:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573966592:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140891.630252:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.630265:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2424 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.630284:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630285:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630292:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630330:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630339:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bd800, rc 0) 00000100:00100000:0.0:1746140891.630370:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573966592:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 135us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.630375:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17544 00000100:00100000:0.0:1746140891.630388:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17545 00000100:00100000:0.0:1746140891.630391:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960573966720:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140891.630397:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.630404:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a242b expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.630413:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630414:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630417:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 9 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630425:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 9 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630430:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bda00, rc 0) 00000100:00100000:0.0:1746140891.630439:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573966720:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 48us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.630443:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17545 00000100:00100000:0.0:1746140891.630450:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17546 00000100:00100000:0.0:1746140891.630453:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573966976:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140891.630457:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.630461:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2439 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.630468:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630469:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630472:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630479:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630484:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bcc00, rc 0) 00000100:00100000:0.0:1746140891.630492:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573966976:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 39us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.630496:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17546 00000100:00100000:0.0:1746140891.630525:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.630534:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573967232 00000100:00100000:0.0:1746140891.630536:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573967232 00000100:00100000:0.0:1746140891.630547:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17547 00000100:00100000:0.0:1746140891.630550:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960573967232:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140891.630554:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.630559:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2447 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.630568:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630569:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630573:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 10 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630581:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 10 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630587:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bc200, rc 0) 00000100:00100000:0.0:1746140891.630601:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573967232:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 51us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.630606:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17547 00000100:00100000:0.0:1746140891.630643:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.630654:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573966848 00000100:00100000:0.0:1746140891.630656:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573966848 00000100:00100000:0.0:1746140891.630669:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17548 00000100:00100000:0.0:1746140891.630673:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573966848:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140891.630678:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.630684:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2432 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.630693:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630694:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.630698:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630706:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.630713:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bc000, rc 0) 00000100:00100000:0.0:1746140891.630725:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573966848:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 52us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.630729:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17548 00000100:00100000:0.0:1746140891.630765:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.630776:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573967104 00000100:00100000:0.0:1746140891.630778:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573967104 00000100:00100000:0.0:1746140891.630789:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17549 00000100:00100000:0.0:1746140891.630795:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573967104:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140891.630800:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.630805:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbb20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2440 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.630836:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576146304:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140891.630886:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119cc0 going to sleep for 11 seconds 00002000:00010000:2.0:1746140891.632701:0:24958:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime: 1746140891 -> 1746140892 00002000:00010000:2.0:1746140891.632711:0:24958:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140890 -> 1746140892 00002000:00010000:2.0:1746140891.632714:0:24958:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime: 1746140891 -> 1746140892 00000100:00100000:2.0:1746140891.632740:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576146304:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140891.632772:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbb20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2440 expref: 11 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.632786:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbb20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2440 expref: 11 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.632815:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bc400, rc 0) 00000100:00100000:2.0:1746140891.632874:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573967104:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2078us (2107us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140891.632882:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17549 00000100:00100000:0.0:1746140891.635631:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.635720:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573967488 00000100:00100000:2.0:1746140891.635728:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573967488 00000100:00100000:2.0:1746140891.635770:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10879 00000100:00100000:2.0:1746140891.635776:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:487:x1830960573967488:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140891.635794:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.635811:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbbb27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a244e expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.635904:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.635919:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.635926:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.635955:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.635965:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 12 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.635988:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576146432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.636417:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c453a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.637026:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576146432:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.637046:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140891.637378:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.637675:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573967616 00000100:00100000:2.0:1746140891.637679:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573967616 00010000:00010000:2.0:1746140891.637700:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 13 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.638275:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9096 00000100:00100000:2.0:1746140891.638283:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573967616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.638295:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.638302:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 13 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.638344:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 13 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.638365:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe0bc00/0x8156357b7fdbbaf6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a241d expref: 13 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.638379:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.638383:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.638602:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.638608:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.638639:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.638692:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573967616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 409us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.638699:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9096 00010000:00010000:0.0:1746140891.638876:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.638882:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:0.0:1746140891.638902:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140891.639047:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df600/0x8156357b7fdbbb27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a244e expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.639059:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a244e expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.639065:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140891.639068:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140891.639070:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8dfa00, rc 0) 00000100:00100000:0.0:1746140891.639094:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:487:x1830960573967488:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3318us (3471us total) trans 8589945218 rc 0/0 00000100:00100000:0.0:1746140891.639099:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10879 00000100:00100000:0.0:1746140891.641300:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.641500:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573967872 00000100:00100000:2.0:1746140891.641509:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573967872 00000100:00100000:2.0:1746140891.641579:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10880 00000100:00100000:2.0:1746140891.641587:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:487:x1830960573967872:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140891.641607:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.641611:0:14741:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746140891.641632:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dfa00/0x8156357b7fdbbb2e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a244e expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.641647:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.641651:0:14741:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.641661:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de600/0x8156357b7fdbbb3c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2455 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.641743:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbbb43 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.641755:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbbb43 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.641762:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbbb43 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140891.641773:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140891.641869:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de600/0x8156357b7fdbbb3c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2455 expref: 14 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.641880:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbbb43 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2455 expref: 13 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.641886:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.641889:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746140891.641891:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8df200, rc 0) 00000100:00100000:2.0:1746140891.642799:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:487:x1830960573967872:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1210us (1504us total) trans 8589945219 rc 0/0 00000100:00100000:2.0:1746140891.642807:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10880 00000100:00100000:0.0:1746140891.644363:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.644429:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573968000 00000100:00100000:2.0:1746140891.644437:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573968000 00000100:00100000:2.0:1746140891.644477:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10881 00000100:00100000:2.0:1746140891.644483:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:487:x1830960573968000:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140891.644501:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.644515:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dee00/0x8156357b7fdbbb51 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a245c expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.644564:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dee00/0x8156357b7fdbbb51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a245c expref: 14 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.644575:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dee00/0x8156357b7fdbbb51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a245c expref: 14 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.644643:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.644646:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140891.644649:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8dee00, rc 0) 00000100:00100000:2.0:1746140891.644692:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+14:487:x1830960573968000:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 210us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.644698:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10881 00000100:00100000:0.0:1746140891.646096:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.646211:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573968128 00000100:00100000:2.0:1746140891.646218:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573968128 00000100:00100000:2.0:1746140891.646259:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17550 00000100:00100000:2.0:1746140891.646265:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573968128:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746140891.646299:0:24958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.646333:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 42 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.646342:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.646348:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 35 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.646354:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.646356:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.646358:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.646386:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 35 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.646397:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 35 pid: 32377 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.646408:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576146560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.646488:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 10 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.646496:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 10 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.646504:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576146688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.646531:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 42 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.646539:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 42 pid: 4782 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.646546:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576146816:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.646561:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b7b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.646837:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.646868:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.646893:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.646927:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573968256 00000100:00100000:1.0:1746140891.646927:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573968512 00000100:00100000:1.0:1746140891.646931:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573968512 00000100:00100000:3.0:1746140891.646939:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573968256 00000100:00100000:1.0:1746140891.646959:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573968768 00000100:00100000:1.0:1746140891.646961:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573968768 00000100:00100000:0.0:1746140891.646968:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17551 00000100:00100000:0.0:1746140891.646984:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573968512:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140891.647003:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.647010:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17552 00010000:00010000:0.0:1746140891.647015:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.647019:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573968768:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140891.647022:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.647027:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.647028:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.647030:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.647043:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 11 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.647049:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 11 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.647061:0:4782:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.647062:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576146944:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.647077:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647085:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 12 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.647091:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.647093:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 43 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.647098:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 42 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.647099:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.647100:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.647103:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.647105:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576147072:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140891.647117:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5119cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140891.647131:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 43 pid: 24958 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140891.647135:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17553 00000100:00100000:0.0:1746140891.647136:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140891.647141:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 43 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.647143:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573968256:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746140891.647153:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576147200:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.647162:0:20960:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.647164:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140891.647173:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.647180:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 12 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.647186:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.647191:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.647192:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.647194:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.647207:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647220:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 12 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.647221:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 27 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.647230:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576147328:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.647233:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 12 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.647241:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576147456:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.647267:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 12 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647268:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 27 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.647275:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 12 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.647277:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 27 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.647282:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093133800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576147584:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.647286:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576147712:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.647324:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.647353:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.647370:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573968384 00000100:00100000:3.0:1746140891.647373:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573968384 00000100:00100000:3.0:1746140891.647390:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573968640 00000100:00100000:3.0:1746140891.647392:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573968640 00000100:00100000:3.0:1746140891.647406:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17554 00000100:00100000:3.0:1746140891.647411:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573968384:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140891.647428:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.647439:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 27 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647445:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 13 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647453:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 43 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647459:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.647460:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.647461:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.647475:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 43 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647483:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 43 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.647490:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576147968:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.647534:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 13 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647542:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 13 pid: 32377 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.647551:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576148096:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.647561:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17555 00000100:00100000:2.0:1746140891.647568:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+12:1985:x1830960573968640:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140891.647574:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 27 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.647586:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 27 pid: 4785 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.647588:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.647598:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.647599:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576148224:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.647604:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140891.647605:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140891.647607:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.647617:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fae40 going to sleep for 11 seconds 00010000:00010000:2.0:1746140891.647623:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 42 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.647630:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 42 pid: 9872 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.647644:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d083b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576148352:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.647862:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.647875:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576147840:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.647908:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b7ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.648144:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.651172:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.651223:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.651237:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.651253:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.651290:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576147200:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.651336:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573969024 00000100:00100000:2.0:1746140891.651343:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573969024 00010000:00010000:2.0:1746140891.651376:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 13 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.651399:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573969152 00000100:00100000:2.0:1746140891.651401:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573969152 00010000:00010000:2.0:1746140891.651411:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 43 pid: 4782 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.651425:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573968896 00000100:00100000:2.0:1746140891.651426:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573968896 00010000:00010000:2.0:1746140891.651434:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.651442:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573969280 00000100:00100000:2.0:1746140891.651444:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573969280 00010000:00010000:2.0:1746140891.651451:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 36 pid: 32377 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.651462:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9097 00000100:00100000:2.0:1746140891.651468:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573969024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.651480:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.651502:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.651511:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.651533:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.651655:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.651672:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573969408 00000100:00100000:3.0:1746140891.651678:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573969408 00000100:00100000:2.0:1746140891.651760:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573969024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 291us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.651767:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9097 00000100:00100000:2.0:1746140891.651785:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9098 00000100:00100000:2.0:1746140891.651789:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573969152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.651796:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.651805:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 44 pid: 4782 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.651812:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 44 pid: 4782 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.651817:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 44 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.651824:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.651838:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573969152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.651840:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9099 00000100:00100000:2.0:1746140891.651844:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9098 00000100:00100000:3.0:1746140891.651847:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573968896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140891.651855:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9100 00010000:00010000:3.0:1746140891.651859:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140891.651860:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1985:x1830960573969280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.651866:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.651872:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 36 pid: 32377 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.651880:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 13 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.651880:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 36 pid: 32377 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.651889:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 13 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.651891:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.651892:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.651896:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.651904:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.651907:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.651921:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.651937:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+36:1985:x1830960573969280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.651942:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9100 00000100:00100000:3.0:1746140891.651945:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+13:1985:x1830960573968896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.651951:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9099 00000100:00100000:2.0:1746140891.651960:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9101 00000100:00100000:2.0:1746140891.651966:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1983:x1830960573969408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140891.651981:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.651991:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.651998:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.652034:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbb0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2439 expref: 12 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.652058:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576146944:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.652072:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576147072:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.652667:0:32377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.652725:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009071ba00/0x8156357b7fdbbada lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2416 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.652740:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.652742:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.652744:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.652750:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.653130:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.653168:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573969408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1201us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.653174:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9101 00010000:00010000:2.0:1746140891.653214:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bce00/0x8156357b7fdbba8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23e5 expref: 35 pid: 32377 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.653223:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576146560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.653233:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bd800/0x8156357b7fdbbafd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2424 expref: 11 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.653239:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576146688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.653248:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b8de000/0x8156357b7fdbba47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c9 expref: 41 pid: 4782 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.653255:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576146816:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.653272:0:24958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.653279:0:24958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.653285:0:24958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.655892:0:32377:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.655908:0:32377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.655943:0:32377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.655949:0:32377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.655957:0:32377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.655963:0:32377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800924bc800 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140891.655966:0:32377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.655983:0:32377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.656001:0:32377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.656008:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bc800/0x8156357b7fdbbb5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.656119:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573968512:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 9138us (9243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.656129:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17551 00000100:00100000:0.0:1746140891.656486:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.656626:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.656648:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.656666:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573969536 00000100:00100000:0.0:1746140891.656673:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573969536 00010000:00010000:0.0:1746140891.656702:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 44 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.656724:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573970176 00000100:00100000:0.0:1746140891.656726:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573970176 00010000:00010000:0.0:1746140891.656735:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 45 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.656747:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9102 00000100:00100000:0.0:1746140891.656753:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573969536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.656765:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.656782:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 45 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.656792:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 45 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.656810:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f0e00/0x8156357b7fdbba40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23c2 expref: 45 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.656820:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.656836:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573969536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.656841:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9102 00000100:00100000:0.0:1746140891.656854:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9103 00000100:00100000:0.0:1746140891.656858:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573970176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.656863:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.656873:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 43 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.656885:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 43 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.656894:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.656906:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1985:x1830960573970176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.656911:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9103 00000100:00100000:0.0:1746140891.656966:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.656991:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573969920 00000100:00100000:0.0:1746140891.656994:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573969920 00010000:00010000:0.0:1746140891.657006:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 28 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.657017:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9104 00000100:00100000:0.0:1746140891.657022:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573969920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.657027:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.657036:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 28 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657043:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 28 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657054:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.657066:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573969920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 44us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.657074:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9104 00000100:00100000:0.0:1746140891.657170:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.657181:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573969664 00000100:00100000:0.0:1746140891.657184:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573969664 00010000:00010000:0.0:1746140891.657194:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 14 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.657206:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9105 00000100:00100000:0.0:1746140891.657210:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573969664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.657215:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.657222:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 14 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657230:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 14 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657239:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.657253:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573969664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 42us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.657258:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9105 00000100:00100000:0.0:1746140891.657281:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.657290:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573970048 00000100:00100000:0.0:1746140891.657292:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573970048 00010000:00010000:0.0:1746140891.657301:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 14 pid: 32377 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.657333:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9106 00000100:00100000:0.0:1746140891.657338:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573970048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.657344:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.657350:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 14 pid: 32377 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657358:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 14 pid: 32377 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657366:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.657379:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573970048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 41us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.657384:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9106 00000100:00100000:0.0:1746140891.657414:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.657423:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573970560 00000100:00100000:0.0:1746140891.657425:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573970560 00010000:00010000:0.0:1746140891.657433:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 28 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.657446:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9107 00000100:00100000:0.0:1746140891.657450:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573970560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.657455:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.657462:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 28 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657468:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 28 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657483:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.657485:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.657489:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.657496:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.657511:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.657524:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573970560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 74us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.657529:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9107 00000100:00100000:0.0:1746140891.657557:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.657566:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573969792 00000100:00100000:0.0:1746140891.657568:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573969792 00010000:00010000:0.0:1746140891.657576:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.657587:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9108 00000100:00100000:0.0:1746140891.657591:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573969792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.657598:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.657604:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657611:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 14 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657625:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.657637:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+14:1983:x1830960573969792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 45us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.657641:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9108 00000100:00100000:0.0:1746140891.657667:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.657675:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573970304 00000100:00100000:0.0:1746140891.657677:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573970304 00010000:00010000:0.0:1746140891.657684:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 28 pid: 4785 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.657694:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9109 00000100:00100000:0.0:1746140891.657698:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573970304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.657702:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.657709:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 28 pid: 4785 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657717:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 28 pid: 4785 timeout: 970 lvb_type: 1 00010000:00010000:0.0:1746140891.657725:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.657727:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.657729:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.657736:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.657749:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.657760:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573970304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.657764:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9109 00000100:00100000:0.0:1746140891.657807:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.657915:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573970688 00000100:00100000:0.0:1746140891.657917:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573970688 00010000:00010000:0.0:1746140891.657934:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 970 lvb_type: 0 00000100:00100000:0.0:1746140891.657947:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9110 00000100:00100000:0.0:1746140891.657951:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573970688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.657958:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.657964:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.657982:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 43 pid: 4782 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.657992:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.657993:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.657996:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.658002:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.658004:0:24958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.658014:0:24958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.658015:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.658021:0:24958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.658026:0:24958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008b8df000 already unused, calling callback (ffffffffa086ad70) 00000100:00100000:0.0:1746140891.658028:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573970688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (221us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140891.658029:0:24958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.658033:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9110 00010000:00010000:2.0:1746140891.658037:0:24958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.658047:0:24958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.658053:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b8df000/0x8156357b7fdbbb58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.658107:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d083b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576148352:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.658125:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.658152:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573970432 00000100:00100000:3.0:1746140891.658156:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573970432 00000100:00100000:2.0:1746140891.658176:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573968128:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11911us (12084us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.658184:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17550 00002000:00100000:3.0:1746140891.658187:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2105343) req@ffff88009b756300 x1830960573970432/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 8680/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.658197:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756300 with x1830960573970432 ext(2097152->2105343) 00010000:00010000:3.0:1746140891.658202:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 41 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.658212:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 41 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.658217:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b756300 00000100:00100000:3.0:1746140891.658247:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1872 00000100:00100000:3.0:1746140891.658253:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+41:1984:x1830960573970432:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746140891.658355:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009071a800/0x8156357b7fdbba94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ec expref: 27 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.658369:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576147328:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.658385:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924bda00/0x8156357b7fdbbb04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a242b expref: 13 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.658395:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093133800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576147584:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.658407:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b8de800/0x8156357b7fdbba4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23d0 expref: 42 pid: 4782 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.658416:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093130000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576147840:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.658434:0:20960:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.658442:0:20960:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.658453:0:20960:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.658599:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1984:x1830960573970432:12345-192.168.204.16@tcp:4:cat.0 Request processed in 345us (2112us total) trans 21474841550 rc 0/0 00000100:00100000:3.0:1746140891.658605:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1872 00002000:00100000:3.0:1746140891.658609:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->2105343) req@ffff88009b756300 x1830960573970432/t21474841550(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 8680/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.658617:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756300 with x1830960573970432 ext(2097152->2105343) 00010000:00010000:3.0:1746140891.658621:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.658630:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.658634:0:20960:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140891.658641:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b756300 00010000:00010000:1.0:1746140891.658643:0:20960:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.658649:0:20960:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.658655:0:20960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009071b000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140891.658658:0:20960:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.658664:0:20960:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658669:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f0c00/0x8156357b7fdbba24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a23ad expref: 41 pid: 24958 timeout: 970 lvb_type: 1 00010000:00010000:1.0:1746140891.658677:0:20960:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.658682:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576147968:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.658683:0:20960:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009071b000/0x8156357b7fdbbb6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658692:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbb19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2432 expref: 12 pid: 32377 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.658700:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576148096:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.658709:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b8dea00/0x8156357b7fdbb9c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2352 expref: 26 pid: 4785 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.658718:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576148224:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.658731:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960573968256:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11587us (11893us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140891.658732:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658739:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.658739:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17553 00010000:00010000:3.0:1746140891.658745:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658758:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658770:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658776:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658781:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe0be00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140891.658784:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658790:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658799:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.658805:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe0be00/0x8156357b7fdbbb74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.659158:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960573968384:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11746us (12020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.659166:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17554 00010000:00010000:3.0:1746140891.659195:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924bc200/0x8156357b7fdbbb12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2447 expref: 9 pid: 24958 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.659204:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576147456:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.659215:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbb9d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2367 expref: 25 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.659222:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576147712:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.659236:0:4782:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659243:0:4782:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659249:0:4782:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659262:0:4782:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659268:0:4782:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659274:0:4782:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659279:0:4782:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe0b200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140891.659286:0:4782:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659292:0:4782:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659301:0:4782:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.659324:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe0b200/0x8156357b7fdbbb66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.659350:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573968768:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12333us (12456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.659356:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17552 00000100:00100000:1.0:1746140891.665898:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.665967:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573970816 00000100:00100000:3.0:1746140891.665984:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573970816 00010000:00010000:3.0:1746140891.666020:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.666050:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9111 00000100:00100000:3.0:1746140891.666056:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1983:x1830960573970816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.666070:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.666094:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.666105:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.666128:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009071b200/0x8156357b7fdbbacc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2408 expref: 43 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.666144:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.666147:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.666152:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.666160:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.666191:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140891.666213:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.666224:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.666235:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1983:x1830960573970816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 178us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.666241:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9111 00010000:00010000:0.0:1746140891.666244:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.666251:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.666258:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.666264:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936f5c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140891.666268:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.666274:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.666289:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.666295:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f5c00/0x8156357b7fdbbb7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.666354:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573968640:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 18785us (19188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.666362:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17555 00000100:00100000:0.0:1746140891.668006:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.668088:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573971072 00000100:00100000:2.0:1746140891.668099:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573971072 00000100:00100000:2.0:1746140891.668170:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10882 00000100:00100000:2.0:1746140891.668180:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+14:487:x1830960573971072:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:2.0:1746140891.668234:0:14741:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140891.668272:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dee00/0x8156357b7fdbbb51 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a245c expref: 14 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668291:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.668296:0:14741:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.668369:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.668384:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 24 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668390:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 284 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668402:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 284 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668408:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 24 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668414:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 284 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668421:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.668478:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 284 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668492:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 284 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.668506:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d083b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.668596:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 24 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668606:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 24 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.668614:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148608:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.668653:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 284 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668662:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 284 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.668670:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.668705:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 284 pid: 14743 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668713:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 284 pid: 14743 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.668721:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.668757:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 24 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.668766:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 24 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.668774:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.668799:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b7ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.671044:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.671096:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d083b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.671826:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148608:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.671828:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.671836:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d082d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148736:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.671844:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148864:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.671848:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.671855:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576148992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.671874:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.671892:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140891.671926:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573971584 00000100:00100000:2.0:1746140891.671934:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573971584 00000100:00100000:1.0:1746140891.671948:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.671966:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573971200 00000100:00100000:1.0:1746140891.671969:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573971200 00000100:00100000:2.0:1746140891.671997:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4805 00010000:00010000:1.0:1746140891.672001:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 286 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.672007:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:24364:x1830960573971584:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746140891.672026:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573971712 00000100:00100000:1.0:1746140891.672028:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573971712 00010000:00010000:1.0:1746140891.672037:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 287 pid: 14743 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.672047:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573971328 00000100:00100000:1.0:1746140891.672049:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573971328 00010000:00010000:1.0:1746140891.672057:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 25 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.672065:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573971840 00000100:00100000:1.0:1746140891.672067:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573971840 00010000:00010000:1.0:1746140891.672074:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 26 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.672082:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9112 00000100:00100000:1.0:1746140891.672086:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1984:x1830960573971200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.672098:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.672103:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 287 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672112:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 287 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672133:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbb7ae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2264 expref: 287 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672147:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.672152:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.672159:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.672194:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+287:1984:x1830960573971200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.672200:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9112 00000100:00100000:1.0:1746140891.672213:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9113 00000100:00100000:1.0:1746140891.672218:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:1985:x1830960573971712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140891.672221:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:24364:x1830960573971584:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 214us (392us total) trans 8589945220 rc 0/0 00010000:00010000:1.0:1746140891.672226:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140891.672228:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4805 00010000:00010000:1.0:1746140891.672230:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 286 pid: 14743 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672237:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 285 pid: 14743 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672246:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbb673 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21a0 expref: 285 pid: 14743 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672254:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.672257:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.672261:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.672268:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9114 00000100:00100000:1.0:1746140891.672272:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:1985:x1830960573971712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.672277:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573971328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140891.672278:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9113 00010000:00010000:0.0:1746140891.672284:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140891.672285:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9115 00000100:00100000:1.0:1746140891.672289:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573971840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140891.672290:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 26 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672294:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.672298:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 26 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.672299:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 26 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.672330:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df400/0x8156357b7fdbb722 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a21f4 expref: 26 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672334:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 26 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.672340:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140891.672343:0:9847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140891.672349:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.672367:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960573971328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.672372:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9114 00010000:00010000:1.0:1746140891.672737:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c7d400/0x8156357b7fdbb66c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2199 expref: 24 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.672746:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.672750:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.672754:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.672770:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1985:x1830960573971840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 480us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.672779:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9115 00000100:00100000:0.0:1746140891.675470:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.675554:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573971968 00000100:00100000:1.0:1746140891.675564:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573971968 00010000:00010000:1.0:1746140891.675595:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 284 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.675894:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9116 00000100:00100000:1.0:1746140891.675903:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:1984:x1830960573971968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.675918:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.675929:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 284 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.675942:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 284 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.675962:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936f4000/0x8156357b7fdbba0f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2398 expref: 284 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.675986:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.675991:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.675998:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.676005:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.676035:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.676084:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:1.0:1746140891.676086:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:1984:x1830960573971968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 184us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.676092:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9116 00010000:00010000:2.0:1746140891.676093:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000040:00080000:2.0:1746140891.677148:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3548, 88 off300896 00000004:00080000:2.0:1746140891.677160:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870752854563ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.677236:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3563, 88 off302392 00000004:00080000:2.0:1746140891.677244:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870752939402ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.677282:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3564, 88 off302480 00000004:00080000:2.0:1746140891.677288:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870752983273ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.677299:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3549, 88 off300984 00000004:00080000:2.0:1746140891.677330:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870753024763ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.677362:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3550, 88 off301072 00000004:00080000:2.0:1746140891.677367:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870753062492ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.677409:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3565, 88 off302568 00000004:00080000:2.0:1746140891.677415:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870753110113ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.677431:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3566, 88 off302656 00000004:00080000:2.0:1746140891.677434:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870753129493ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.677448:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3567, 88 off302744 00000004:00080000:2.0:1746140891.677889:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870753583200ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.677935:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3551, 88 off301160 00000004:00080000:2.0:1746140891.677940:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870753635442ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.677968:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3568, 88 off302832 00000004:00080000:2.0:1746140891.677985:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870753680125ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.677998:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3552, 88 off301248 00000004:00080000:2.0:1746140891.678001:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870753696632ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.678028:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3569, 88 off302920 00000004:00080000:2.0:1746140891.678033:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870753727689ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.678046:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3553, 88 off301336 00000004:00080000:2.0:1746140891.678050:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870753745012ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.678061:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3554, 88 off301424 00000004:00080000:2.0:1746140891.678065:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870753759983ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.678076:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3555, 88 off301512 00000004:00080000:2.0:1746140891.678079:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870753774612ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.678090:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3556, 88 off301600 00000004:00080000:2.0:1746140891.678093:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870753788727ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.678105:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3570, 88 off303008 00000004:00080000:2.0:1746140891.678108:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870753803115ns, next at 809142599738ns, rc = 0 00010000:00010000:2.0:1746140891.691510:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746140891.701072:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945218 is committed 00000001:00080000:1.0:1746140891.701085:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945196 is committed 00000001:00080000:1.0:1746140891.701090:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945214 is committed 00000001:00080000:1.0:1746140891.701108:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945208 is committed 00000001:00080000:1.0:1746140891.701123:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945221 is committed 00000004:00080000:1.0:1746140891.701128:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2812 committed 00000004:00080000:1.0:1746140891.701135:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2801 committed 00000004:00080000:1.0:1746140891.701141:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2800 committed 00000004:00080000:1.0:1746140891.701143:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2799 committed 00000004:00080000:1.0:1746140891.701144:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2798 committed 00000004:00080000:1.0:1746140891.701146:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2811 committed 00000004:00080000:1.0:1746140891.701147:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2797 committed 00000004:00080000:1.0:1746140891.701149:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2810 committed 00000004:00080000:1.0:1746140891.701151:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2796 committed 00000004:00080000:1.0:1746140891.701152:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2809 committed 00000004:00080000:1.0:1746140891.701153:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2808 committed 00000004:00080000:1.0:1746140891.701154:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2807 committed 00000004:00080000:1.0:1746140891.701155:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2795 committed 00000004:00080000:1.0:1746140891.701157:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2794 committed 00000004:00080000:1.0:1746140891.701158:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2806 committed 00000004:00080000:1.0:1746140891.701159:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2805 committed 00000004:00080000:1.0:1746140891.701161:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2793 committed 00000001:00080000:1.0:1746140891.701166:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945220 is committed 00000001:00080000:1.0:1746140891.701176:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945216 is committed 00000100:00100000:2.0:1746140891.701384:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576149248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.701448:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1746140891.701568:0:14741:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b757800 reply state ffff8800a0ee9400 transno 8589945221 ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:3.0:1746140891.701580:0:14741:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746140891.701659:0:14741:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746140891.701672:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:487:x1830960573971072:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 33492us (33672us total) trans 8589945221 rc 0/0 00000100:00100000:3.0:1746140891.701679:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10882 00000100:00100000:2.0:1746140891.701907:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746140891.701913:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576149120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.701935:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.701950:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576149632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.701959:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576149760:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746140891.701993:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.702004:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.702012:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.702017:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8ca00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140891.702021:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.702027:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.702042:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.702045:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140891.702048:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.702052:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbb82 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140891.702096:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576149248 00000100:00100000:0.0:1746140891.702102:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576149248 00000100:00080000:2.0:1746140891.702128:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140891.702135:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576149120 00000100:00100000:0.0:1746140891.702137:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576149120 00000100:00100000:0.0:1746140891.702149:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17556 00000100:00100000:0.0:1746140891.702154:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+96:3313:x1830960576149248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.702357:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+97:3313:x1830960576149248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (910us total) trans 21474841551 rc 0/0 00000100:00100000:0.0:1746140891.702363:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17556 00000100:00100000:0.0:1746140891.702374:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17557 00000100:00100000:0.0:1746140891.702378:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+96:3313:x1830960576149120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.702456:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+97:3313:x1830960576149120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (520us total) trans 21474841552 rc 0/0 00000100:00100000:0.0:1746140891.702461:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17557 00000100:00100000:0.0:1746140891.702474:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576149376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.702540:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702570:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576150144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.702591:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702600:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576150656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.702612:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702621:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746140891.702624:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576150272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.702637:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702646:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576150784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.702659:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702675:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576149504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.702689:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702698:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576150016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.702710:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702718:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576150528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.702730:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702740:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576151040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.702752:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.702770:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576149632 00000100:00100000:1.0:1746140891.702774:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576149632 00000100:00100000:1.0:1746140891.702787:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576150144 00000100:00100000:1.0:1746140891.702789:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576150144 00000100:00100000:1.0:1746140891.702804:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576150656 00000100:00100000:1.0:1746140891.702805:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576150656 00000100:00100000:1.0:1746140891.702810:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576150272 00000100:00100000:1.0:1746140891.702812:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576150272 00000100:00100000:1.0:1746140891.702817:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576150784 00000100:00100000:1.0:1746140891.702818:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576150784 00000100:00100000:1.0:1746140891.702824:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576149504 00000100:00100000:1.0:1746140891.702826:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576149504 00000100:00100000:1.0:1746140891.702831:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576150016 00000100:00100000:1.0:1746140891.702833:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576150016 00000100:00100000:1.0:1746140891.702838:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576150528 00000100:00100000:1.0:1746140891.702839:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576150528 00000100:00100000:1.0:1746140891.702845:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576151040 00000100:00100000:1.0:1746140891.702846:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576151040 00000100:00100000:1.0:1746140891.702853:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17558 00000100:00100000:1.0:1746140891.702858:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+99:3312:x1830960576149632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.702950:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+100:3312:x1830960576149632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (978us total) trans 21474841553 rc 0/0 00000100:00100000:1.0:1746140891.702956:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17558 00000100:00100000:1.0:1746140891.702966:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17559 00000100:00100000:1.0:1746140891.702981:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:3312:x1830960576150144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.703089:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576150144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (496us total) trans 17179874248 rc 0/0 00000100:00100000:1.0:1746140891.703094:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17559 00000100:00100000:1.0:1746140891.703103:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17560 00000100:00100000:1.0:1746140891.703106:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:3312:x1830960576150656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.703180:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576150656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (566us total) trans 17179874249 rc 0/0 00000100:00100000:1.0:1746140891.703185:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17560 00000100:00100000:1.0:1746140891.703193:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17561 00000100:00100000:1.0:1746140891.703197:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:3312:x1830960576150272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.703270:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576150272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (632us total) trans 17179874250 rc 0/0 00000100:00100000:1.0:1746140891.703276:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17561 00000100:00100000:1.0:1746140891.703285:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17562 00000100:00100000:1.0:1746140891.703289:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:3312:x1830960576150784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.703379:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3312:x1830960576150784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (719us total) trans 17179874251 rc 0/0 00000100:00100000:1.0:1746140891.703384:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17562 00000100:00100000:1.0:1746140891.703392:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17563 00000100:00100000:1.0:1746140891.703396:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+99:3311:x1830960576149504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.703479:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+100:3311:x1830960576149504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (788us total) trans 21474841554 rc 0/0 00000100:00100000:1.0:1746140891.703484:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17563 00000100:00100000:1.0:1746140891.703493:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17564 00000100:00100000:1.0:1746140891.703497:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+99:3311:x1830960576150016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.703565:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140891.703569:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+100:3311:x1830960576150016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (858us total) trans 21474841555 rc 0/0 00000100:00100000:1.0:1746140891.703573:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17564 00000100:00100000:1.0:1746140891.703580:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576149760 00000100:00100000:1.0:1746140891.703582:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576149760 00000100:00100000:1.0:1746140891.703592:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17565 00000100:00100000:1.0:1746140891.703596:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:3311:x1830960576150528:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746140891.703602:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b069880/2, rc 0, transno 21474841552 00000100:00100000:2.0:1746140891.703611:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576149120:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746140891.703618:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b06aa00/2, rc 0, transno 21474841551 00000100:00100000:2.0:1746140891.703622:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576149248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.703638:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17566 00000100:00100000:2.0:1746140891.703643:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+90:3311:x1830960576151040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.703672:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3311:x1830960576150528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (941us total) trans 17179874252 rc 0/0 00000100:00100000:1.0:1746140891.703677:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17565 00000100:00100000:1.0:1746140891.703685:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17567 00000100:00100000:1.0:1746140891.703689:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+100:3313:x1830960576149760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.703722:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+91:3311:x1830960576151040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (969us total) trans 17179874253 rc 0/0 00000100:00100000:2.0:1746140891.703726:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17566 00000100:00080000:2.0:1746140891.703748:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746140891.703759:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+101:3313:x1830960576149760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (194us total) trans 21474841556 rc 0/0 00000100:00100000:1.0:1746140891.703764:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17567 00000004:00080000:2.0:1746140891.703780:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513ce00/2, rc 0, transno 21474841556 00000100:00100000:2.0:1746140891.703782:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576149760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.703787:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746140891.703792:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576151168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140891.703803:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b069180/2, rc 0, transno 21474841554 00000100:00100000:1.0:1746140891.703806:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576149504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.703809:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746140891.703812:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513df80/2, rc 0, transno 21474841555 00000100:00100000:1.0:1746140891.703814:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576150016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140891.703819:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576151168 00000004:00080000:1.0:1746140891.703821:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b755500/2, rc 0, transno 17179874252 00000100:00100000:3.0:1746140891.703824:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576151168 00000100:00100000:1.0:1746140891.703824:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576150528:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140891.703830:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b757b80/2, rc 0, transno 17179874253 00000100:00100000:1.0:1746140891.703832:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576151040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140891.703843:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17568 00000100:00100000:3.0:1746140891.703848:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+101:3313:x1830960576151168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140891.703937:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:3313:x1830960576151168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (127us total) trans 21474841557 rc 0/0 00000100:00100000:3.0:1746140891.703943:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17568 00000004:00080000:2.0:1746140891.704012:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d081880/2, rc 0, transno 21474841557 00000100:00100000:2.0:1746140891.704016:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576151168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140891.704173:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b754a80/2, rc 0, transno 17179874250 00000100:00100000:1.0:1746140891.704177:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576150272:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140891.704186:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b755f80/2, rc 0, transno 17179874251 00000100:00100000:1.0:1746140891.704188:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576150784:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140891.704199:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b756d80/2, rc 0, transno 17179874248 00000100:00100000:1.0:1746140891.704201:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576150144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140891.704207:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b757100/2, rc 0, transno 17179874249 00000100:00100000:1.0:1746140891.704209:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576150656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140891.704215:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba7b80/2, rc 0, transno 21474841553 00000100:00100000:1.0:1746140891.704218:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576149632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.704345:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.704384:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a513c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576149888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.704403:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.704415:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576150400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.704433:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.704681:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576150912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.704700:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140891.704759:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.704884:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576149376 00000100:00100000:1.0:1746140891.704888:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576149376 00000100:00100000:1.0:1746140891.704910:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576149888 00000100:00100000:1.0:1746140891.704912:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576149888 00000100:00100000:1.0:1746140891.704921:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576150400 00000100:00100000:1.0:1746140891.704922:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576150400 00000100:00100000:1.0:1746140891.704929:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576150912 00000100:00100000:1.0:1746140891.704931:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576150912 00000100:00100000:1.0:1746140891.704940:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17569 00000100:00100000:1.0:1746140891.704944:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3310:x1830960576149376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.705088:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+104:3310:x1830960576149376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (742us total) trans 21474841558 rc 0/0 00000100:00100000:1.0:1746140891.705094:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17569 00000100:00100000:1.0:1746140891.705240:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17570 00000100:00100000:1.0:1746140891.705246:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3310:x1830960576149888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.705365:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+104:3310:x1830960576149888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (960us total) trans 21474841559 rc 0/0 00000100:00100000:1.0:1746140891.705370:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17570 00000100:00100000:1.0:1746140891.705378:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17571 00000100:00100000:1.0:1746140891.705382:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+92:3310:x1830960576150400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.705476:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3310:x1830960576150400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1042us total) trans 17179874254 rc 0/0 00000100:00100000:1.0:1746140891.705481:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17571 00000100:00100000:1.0:1746140891.705490:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17572 00000100:00100000:1.0:1746140891.705493:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+92:3310:x1830960576150912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140891.705853:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573972096 00000100:00100000:3.0:1746140891.705857:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573972096 00000100:00100000:3.0:1746140891.705893:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10883 00000100:00100000:3.0:1746140891.705897:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:487:x1830960573972096:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140891.705913:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.705937:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2463 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.706001:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.706014:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.706029:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.706032:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140891.706035:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4cc00, rc 0) 00000100:00100000:3.0:1746140891.706077:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:487:x1830960573972096:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 179us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.706082:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10883 00000004:00080000:0.0:1746140891.706141:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b06b800/2, rc 0, transno 21474841558 00000100:00100000:0.0:1746140891.706146:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576149376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140891.706153:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a513c700/2, rc 0, transno 21474841559 00000100:00100000:0.0:1746140891.706156:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a513c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576149888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140891.706164:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b755880/2, rc 0, transno 17179874254 00000100:00100000:0.0:1746140891.706167:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576150400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.706841:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3310:x1830960576150912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1346us (2140us total) trans 17179874255 rc 0/0 00000100:00100000:1.0:1746140891.706847:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17572 00000004:00080000:0.0:1746140891.706913:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b757480/2, rc 0, transno 17179874255 00000100:00100000:0.0:1746140891.706917:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576150912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140891.710370:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.710415:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573972224 00000100:00100000:0.0:1746140891.710424:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573972224 00000100:00100000:0.0:1746140891.710481:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 795 00000100:00100000:0.0:1746140891.710489:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4797050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:487:x1830960573972224:12345-192.168.204.16@tcp:103:mirror_io.0 00010000:00010000:0.0:1746140891.710506:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140891.710530:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8df200/0x8156357b7fdbbb43 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2455 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.710545:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140891.710549:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140891.710588:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4797050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:487:x1830960573972224:12345-192.168.204.16@tcp:103:mirror_io.0 Request processed in 101us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.710595:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 795 00000100:00100000:0.0:1746140891.713561:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.713611:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573972480 00000100:00100000:2.0:1746140891.713620:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573972480 00000100:00100000:2.0:1746140891.713666:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4806 00000100:00100000:2.0:1746140891.713674:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+7:487:x1830960573972480:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140891.714065:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:487:x1830960573972480:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 391us (511us total) trans 8589945222 rc 0/0 00000100:00100000:2.0:1746140891.714072:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4806 00000100:00100000:0.0:1746140891.716643:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.716694:0:14745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573972736 00000100:00100000:2.0:1746140891.716702:0:14745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573972736 00000100:00100000:2.0:1746140891.716741:0:14745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4807 00000100:00100000:2.0:1746140891.716749:0:14745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:487:x1830960573972736:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140891.716938:0:14745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:487:x1830960573972736:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 188us (301us total) trans 8589945223 rc 0/0 00000100:00100000:2.0:1746140891.716944:0:14745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4807 00000100:00100000:0.0:1746140891.727962:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.728064:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573972992 00000100:00100000:3.0:1746140891.728077:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573972992 00000100:00100000:3.0:1746140891.728153:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10884 00000100:00100000:3.0:1746140891.728164:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:496:x1830960573972992:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.728191:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.728208:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbbb90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a246a expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.728498:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728509:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728520:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728532:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728537:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728541:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728630:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728636:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728641:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140891.728648:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140891.728718:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728723:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728732:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728736:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e4d600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.728739:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728745:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728754:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140891.728757:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.728760:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728764:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d600/0x8156357b7fdbbb97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728790:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728794:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728797:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728801:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e4ce00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140891.728803:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728806:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728814:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388f00) 00010000:00010000:3.0:1746140891.728815:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140891.728817:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728821:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ce00/0x8156357b7fdbbb9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.728853:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c600/0x8156357b7fdbbb90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.728863:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 268 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.728869:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.728871:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140891.728873:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4c400, rc 0) 00000100:00100000:3.0:1746140891.728929:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:496:x1830960573972992:12345-192.168.204.16@tcp:101:cat.0 Request processed in 770us (977us total) trans 8589945224 rc 0/0 00000100:00100000:3.0:1746140891.728935:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10884 00000100:00100000:0.0:1746140891.731055:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.731102:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.731337:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573973632 00000100:00100000:2.0:1746140891.731347:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573973632 00000100:00100000:0.0:1746140891.731350:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.731369:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.731390:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573973760 00000100:00100000:0.0:1746140891.731390:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.731391:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573973760 00000100:00100000:0.0:1746140891.731398:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.731399:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573973888 00000100:00100000:2.0:1746140891.731400:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573973888 00000100:00100000:2.0:1746140891.731407:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573974144 00000100:00100000:0.0:1746140891.731407:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.731408:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573974144 00000100:00100000:2.0:1746140891.731415:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573974016 00000100:00100000:2.0:1746140891.731416:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573974016 00000100:00100000:2.0:1746140891.731425:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17573 00000100:00100000:2.0:1746140891.731429:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573973632:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140891.731440:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.731441:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17574 00010000:00010000:2.0:1746140891.731443:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746140891.731450:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17575 00000100:00100000:3.0:1746140891.731455:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1982:x1830960573973760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.731457:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a247f expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.731458:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573974272 00000100:00100000:1.0:1746140891.731460:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+42:1982:x1830960573973888:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140891.731461:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573974272 00010000:00010000:3.0:1746140891.731467:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.731468:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746140891.731476:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x81f 00010000:00010000:3.0:1746140891.731480:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2486 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.731480:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a248d expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.731483:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17576 00000100:00100000:0.0:1746140891.731489:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573974144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.731491:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.731493:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.731496:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.731499:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 45 pid: 9872 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746140891.731500:0:4782:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x81f 00002000:00010000:1.0:1746140891.731500:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x81d 00010000:00010000:0.0:1746140891.731504:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a249b expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.731510:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 45 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.731513:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.731513:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.731514:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.731515:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746140891.731517:0:8458:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fedc, atime: 0x6813fedc, ctime: 0x6813fedc, blocks: 0x1591 00010000:00010000:2.0:1746140891.731521:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8de00, rc 0) 00010000:00010000:3.0:1746140891.731522:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 45 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.731522:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.731526:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.731527:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.731532:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 46 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.731534:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 45 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.731534:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.731542:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4da00, rc 0) 00010000:00010000:1.0:1746140891.731542:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e78a00, rc 0) 00010000:00010000:0.0:1746140891.731542:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 46 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.731549:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bdc00, rc 0) 00000100:00100000:2.0:1746140891.731559:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1983:x1830960573973632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.731564:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17573 00000100:00100000:3.0:1746140891.731570:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573973760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 121us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.731572:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573973888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 114us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.731576:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17574 00000100:00100000:0.0:1746140891.731576:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573974144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.731579:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17575 00000100:00100000:2.0:1746140891.731588:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17577 00000100:00100000:3.0:1746140891.731593:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17578 00000100:00100000:2.0:1746140891.731593:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573974016:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140891.731597:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17576 00000100:00100000:3.0:1746140891.731599:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+43:1982:x1830960573974272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.731599:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.731604:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.731606:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2494 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.731610:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24a2 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140891.731615:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fedc, atime: 0x6813fedb, ctime: 0x6813fedc, blocks: 0x81f 00002000:00010000:3.0:1746140891.731619:0:4782:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813feda, atime: 0x6813fed9, ctime: 0x6813feda, blocks: 0x102b 00010000:00010000:2.0:1746140891.731622:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.731623:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.731625:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.731626:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.731627:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 45 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.731630:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 44 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.731635:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 45 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.731637:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 44 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.731642:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8ca00, rc 0) 00010000:00010000:3.0:1746140891.731647:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d400, rc 0) 00000100:00100000:2.0:1746140891.731656:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573974016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.731660:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17577 00000100:00100000:3.0:1746140891.731663:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573974272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.731667:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17578 00000100:00100000:2.0:1746140891.731683:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573973376 00000100:00100000:2.0:1746140891.731685:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573973376 00000100:00100000:3.0:1746140891.731688:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573973504 00000100:00100000:3.0:1746140891.731694:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573973504 00000100:00100000:2.0:1746140891.731710:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10885 00000100:00100000:2.0:1746140891.731713:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+6:497:x1830960573973376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.731723:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140891.731731:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10886 00010000:00010000:2.0:1746140891.731731:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbbbdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2478 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.731736:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:492:x1830960573973504:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140891.731747:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.731756:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbbbe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2471 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.731808:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.731816:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.731823:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.731829:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.731833:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.731836:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.731927:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.731933:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.731938:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140891.731946:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140891.732037:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732043:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732049:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732053:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8d800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140891.732056:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732062:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732070:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140891.732072:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140891.732075:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732079:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8d800/0x8156357b7fdbbbeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732098:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732103:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732107:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732110:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a8c200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140891.732112:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732117:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732122:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130d2f100) 00010000:00010000:2.0:1746140891.732124:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140891.732125:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732129:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c200/0x8156357b7fdbbbf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140891.732161:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8da00/0x8156357b7fdbbbdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 9 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.732169:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.732174:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.732175:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140891.732177:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5568800, rc 0) 00010000:00010000:3.0:1746140891.732183:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140891.732194:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.732200:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.732205:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140891.732210:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+8:497:x1830960573973376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 494us (1161us total) trans 8589945225 rc 0/0 00000100:00100000:2.0:1746140891.732215:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10885 00010000:00010000:3.0:1746140891.732253:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.732270:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 7 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.732280:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576151296:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.732367:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.732375:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 269 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.732381:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576151424:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.732423:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3faf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.734333:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.734371:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576151296:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140891.734374:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.734384:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576151424:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.734398:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573974400 00010000:00010000:3.0:1746140891.734404:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:1.0:1746140891.734404:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573974400 00010000:00010000:1.0:1746140891.734432:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 270 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.734464:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9117 00000100:00100000:1.0:1746140891.734471:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1983:x1830960573974400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140891.734479:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573974528 00010000:00010000:1.0:1746140891.734482:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140891.734485:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573974528 00010000:00010000:1.0:1746140891.734487:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 270 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.734502:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 270 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.734514:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10887 00000100:00100000:2.0:1746140891.734519:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:497:x1830960573974528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.734519:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4c400/0x8156357b7fdbbba5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a246a expref: 270 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.734537:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.734543:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.734548:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.734551:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbbc0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24a9 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.734554:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.734560:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.734591:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1983:x1830960573974400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.734597:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9117 00010000:00010000:2.0:1746140891.734599:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.734608:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.734614:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.734627:0:27790:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140891.734631:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.734636:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:1.0:1746140891.734645:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573974656 00000100:00100000:1.0:1746140891.734648:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573974656 00010000:00010000:1.0:1746140891.734658:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 10 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.734673:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9118 00000100:00100000:1.0:1746140891.734678:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573974656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.734683:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.734687:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 10 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.734699:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 10 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.734715:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5568800/0x8156357b7fdbbbf9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2478 expref: 10 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.734724:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.734727:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.734733:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.734738:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140891.734744:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.734749:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.734754:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.734773:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.734806:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573974656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.734812:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9118 00000100:00100000:0.0:1746140891.735225:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.735238:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140891.735245:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00000004:00200000:2.0:1746140891.735261:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:3.0:1746140891.735276:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573974784 00000100:00100000:3.0:1746140891.735280:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573974784 00000100:00100000:3.0:1746140891.735371:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10888 00000100:00100000:3.0:1746140891.735376:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:496:x1830960573974784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.735387:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.735394:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24b0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.735404:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4ca00/0x8156357b7fdbbbe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2471 expref: 272 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.735419:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2471 expref: 271 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.735426:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2471 expref: 271 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.735432:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.735435:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d000, rc 0) 00010000:00010000:3.0:1746140891.735438:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 271 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.735447:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.735449:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140891.735451:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256e600, rc 0) 00000100:00100000:2.0:1746140891.735474:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:492:x1830960573973504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3737us (4124us total) trans 8589945226 rc 0/0 00000100:00100000:3.0:1746140891.735475:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:496:x1830960573974784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.735479:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10888 00000100:00100000:2.0:1746140891.735482:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10886 00000100:00100000:0.0:1746140891.737419:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.737796:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573974912 00000100:00100000:1.0:1746140891.737803:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573974912 00010000:00010000:1.0:1746140891.737832:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2471 expref: 270 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:1.0:1746140891.737868:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9119 00000100:00100000:1.0:1746140891.737875:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1985:x1830960573974912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.737887:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.737893:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2471 expref: 270 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.737904:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2471 expref: 270 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.737923:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4d000/0x8156357b7fdbbc07 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2471 expref: 270 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.737937:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.737942:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.737949:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.737955:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.737994:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.738040:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960573974912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 165us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.738046:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9119 00010000:00010000:2.0:1746140891.738055:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.738065:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:2.0:1746140891.738109:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:2.0:1746140891.738114:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746140891.738128:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.738139:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.738179:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a8c800/0x8156357b7fdbbc0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a9 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.738196:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a9 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.738205:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.738208:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140891.738210:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb4a00, rc 0) 00000100:00100000:2.0:1746140891.738254:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:497:x1830960573974528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3734us (3879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.738263:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10887 00000100:00100000:0.0:1746140891.740217:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.740257:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.740285:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.740301:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.740346:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573975040 00000100:00100000:2.0:1746140891.740351:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573975168 00000100:00100000:0.0:1746140891.740352:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.740355:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573975040 00000100:00100000:2.0:1746140891.740356:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573975168 00000100:00100000:3.0:1746140891.740389:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573975296 00000100:00100000:3.0:1746140891.740391:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573975296 00000100:00100000:2.0:1746140891.740398:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573975424 00000100:00100000:2.0:1746140891.740401:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573975424 00000100:00100000:3.0:1746140891.740410:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573975552 00000100:00100000:3.0:1746140891.740412:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573975552 00000100:00100000:2.0:1746140891.740417:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17579 00000100:00100000:2.0:1746140891.740424:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573975040:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746140891.740439:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17580 00010000:00010000:2.0:1746140891.740441:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140891.740444:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+26:1985:x1830960573975168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.740452:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.740459:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24b7 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.740462:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24be expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.740463:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.740480:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.740482:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.740482:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.740484:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140891.740484:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573975680 00000100:00100000:1.0:1746140891.740489:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573975680 00010000:00010000:2.0:1746140891.740491:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.740494:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 27 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140891.740496:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17581 00000100:00100000:0.0:1746140891.740503:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573975296:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140891.740507:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17582 00010000:00010000:0.0:1746140891.740510:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.740511:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 28 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140891.740511:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1985:x1830960573975424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.740516:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.740517:0:8459:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24c5 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.740521:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256e800, rc 0) 00010000:00010000:1.0:1746140891.740522:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24cc expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.740528:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.740529:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140891.740529:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.740530:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.740534:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 39 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.740534:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 29 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.740543:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 39 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140891.740543:0:8459:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 29 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.740550:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79c00, rc 0) 00010000:00010000:0.0:1746140891.740550:0:8459:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bd000, rc 0) 00000100:00100000:3.0:1746140891.740557:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573975168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.740562:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17580 00000100:00100000:0.0:1746140891.740566:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573975296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.740570:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+39:1985:x1830960573975424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 60us (270us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140891.740572:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 39 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140891.740572:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17581 00000100:00100000:1.0:1746140891.740575:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17582 00000100:00100000:3.0:1746140891.740578:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17583 00010000:00010000:2.0:1746140891.740580:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fcb4600, rc 0) 00000100:00100000:3.0:1746140891.740584:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1984:x1830960573975552:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140891.740584:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17584 00000100:00100000:1.0:1746140891.740588:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+27:1985:x1830960573975680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.740590:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.740593:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.740596:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24d3 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.740598:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1984:x1830960573975040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 175us (392us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140891.740599:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24da expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.740604:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17579 00010000:00010000:3.0:1746140891.740606:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.740607:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.740608:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140891.740610:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.740611:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 38 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.740613:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 28 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.740620:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 38 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.740622:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 28 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.740626:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ea00, rc 0) 00010000:00010000:1.0:1746140891.740628:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79a00, rc 0) 00000100:00100000:3.0:1746140891.740643:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1984:x1830960573975552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.740646:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573975680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.740648:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17583 00000100:00100000:1.0:1746140891.740652:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17584 00000100:00100000:0.0:1746140891.742544:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.742603:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573976064 00000100:00100000:2.0:1746140891.742613:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573976064 00000100:00100000:0.0:1746140891.742619:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.742652:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746140891.742665:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801359b1f80 x1830960573976064/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.742680:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b1f80 with x1830960573976064 ext(0->1048575) 00002000:00010000:2.0:1746140891.742686:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b1f80 00000100:00100000:3.0:1746140891.742693:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573976192 00000100:00100000:3.0:1746140891.742700:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573976192 00000100:00100000:0.0:1746140891.742712:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.742721:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573976576 00000100:00100000:2.0:1746140891.742724:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573976576 00002000:00100000:2.0:1746140891.742739:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801359b2300 x1830960573976576/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.742745:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b2300 with x1830960573976576 ext(1048576->2097151) 00002000:00100000:3.0:1746140891.742746:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8801359b3b80 x1830960573976192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746140891.742748:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b2300 00002000:00100000:3.0:1746140891.742755:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b3b80 with x1830960573976192 ext(1048576->2097151) 00002000:00010000:3.0:1746140891.742760:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b3b80 00000100:00100000:2.0:1746140891.742773:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573976448 00000100:00100000:2.0:1746140891.742776:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573976448 00000100:00100000:3.0:1746140891.742785:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9008 00002000:00100000:2.0:1746140891.742788:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880135b67100 x1830960573976448/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140891.742793:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1983:x1830960573976064:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746140891.742793:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67100 with x1830960573976448 ext(1048576->2097151) 00000100:00100000:1.0:1746140891.742794:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9009 00002000:00010000:2.0:1746140891.742795:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b67100 00000100:00100000:0.0:1746140891.742802:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9010 00000100:00100000:1.0:1746140891.742805:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573976576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.742810:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1983:x1830960573976192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.742816:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9011 00000100:00100000:2.0:1746140891.742821:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573976448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.751225:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1983:x1830960573976064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8423us (8678us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.751237:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9008 00002000:00100000:3.0:1746140891.751248:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8801359b1f80 x1830960573976064/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.751258:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b1f80 with x1830960573976064 ext(0->1048575) 00002000:00010000:3.0:1746140891.751263:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b1f80 00000100:00100000:0.0:1746140891.752087:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.752120:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.752146:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573976960 00000100:00100000:0.0:1746140891.752146:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.752154:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573976960 00000100:00100000:1.0:1746140891.752174:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573977216 00000100:00100000:0.0:1746140891.752177:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.752180:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573977216 00002000:00100000:3.0:1746140891.752185:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880135b64380 x1830960573976960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.752191:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64380 with x1830960573976960 ext(0->1048575) 00002000:00010000:3.0:1746140891.752195:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b64380 00002000:00100000:1.0:1746140891.752209:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880135b66680 x1830960573977216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140891.752211:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573977472 00000100:00100000:3.0:1746140891.752213:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573977472 00002000:00100000:1.0:1746140891.752216:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66680 with x1830960573977216 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.752220:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b66680 00002000:00100000:3.0:1746140891.752225:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880135b67480 x1830960573977472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140891.752231:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573977728 00000100:00100000:1.0:1746140891.752233:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573977728 00002000:00100000:3.0:1746140891.752235:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67480 with x1830960573977472 ext(1048576->2097151) 00002000:00010000:3.0:1746140891.752238:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b67480 00002000:00100000:1.0:1746140891.752240:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880135b66300 x1830960573977728/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.752245:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66300 with x1830960573977728 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.752246:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b66300 00000100:00100000:3.0:1746140891.752258:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9012 00000100:00100000:3.0:1746140891.752264:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+39:1984:x1830960573976960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140891.752550:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9013 00000100:00100000:1.0:1746140891.752558:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9014 00000100:00100000:2.0:1746140891.752559:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573977216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.752566:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573977472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.752623:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573976192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9813us (10002us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140891.752631:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9010 00002000:00100000:0.0:1746140891.752638:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8801359b3b80 x1830960573976192/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.752997:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b3b80 with x1830960573976192 ext(1048576->2097151) 00002000:00010000:0.0:1746140891.753002:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801359b3b80 00000100:00100000:0.0:1746140891.753026:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9015 00000100:00100000:0.0:1746140891.753032:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+40:1984:x1830960573977728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.755133:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801359b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1983:x1830960573976576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12320us (12470us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140891.755147:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9009 00002000:00100000:0.0:1746140891.755158:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff8801359b2300 x1830960573976576/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.755167:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801359b2300 with x1830960573976576 ext(1048576->2097151) 00002000:00010000:0.0:1746140891.755173:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801359b2300 00000100:00100000:2.0:1746140891.760934:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573976448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18098us (18207us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.760947:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9011 00002000:00100000:2.0:1746140891.760958:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880135b67100 x1830960573976448/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.760987:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67100 with x1830960573976448 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.760993:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b67100 00000100:00100000:0.0:1746140891.764493:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.764710:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573977984 00000100:00100000:2.0:1746140891.764718:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573977984 00000100:00100000:2.0:1746140891.764756:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10889 00000100:00100000:2.0:1746140891.764764:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:499:x1830960573977984:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140891.764782:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.764801:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009443dc00/0x8156357b7fdbbc54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24e1 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.764821:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+40:1984:x1830960573976960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12556us (12741us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.764829:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9012 00002000:00100000:3.0:1746140891.764837:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff880135b64380 x1830960573976960/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.764845:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b64380 with x1830960573976960 ext(0->1048575) 00002000:00010000:3.0:1746140891.764849:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b64380 00010000:00010000:2.0:1746140891.764893:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.764905:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.764914:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.764925:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.764931:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.764936:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765046:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cbce00/0x8156357b7fdbbc69 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765058:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cbce00/0x8156357b7fdbbc69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765063:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cbce00/0x8156357b7fdbbc69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:2.0:1746140891.765071:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140891.765137:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765143:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765148:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765152:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009443de00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140891.765156:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765161:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765169:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140891.765172:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140891.765176:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765180:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009443de00/0x8156357b7fdbbc5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765208:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765216:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765220:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765223:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009443da00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140891.765226:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765229:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765235:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130d2f400) 00010000:00010000:2.0:1746140891.765237:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140891.765239:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765243:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009443da00/0x8156357b7fdbbc62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.765271:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009443dc00/0x8156357b7fdbbc54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e1 expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.765280:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cbce00/0x8156357b7fdbbc69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e1 expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.765286:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.765288:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746140891.765289:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cbce00, rc 0) 00000100:00100000:2.0:1746140891.765347:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:499:x1830960573977984:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 584us (861us total) trans 8589945227 rc 0/0 00000100:00100000:2.0:1746140891.765353:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10889 00000100:00100000:2.0:1746140891.767694:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573977216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15131us (15567us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.767704:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9013 00002000:00100000:2.0:1746140891.767714:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff880135b66680 x1830960573977216/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.767722:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66680 with x1830960573977216 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.767727:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b66680 00000100:00100000:1.0:1746140891.769787:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573977472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17212us (17629us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.769798:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9014 00002000:00100000:1.0:1746140891.769809:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff880135b67480 x1830960573977472/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.769818:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67480 with x1830960573977472 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.769824:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b67480 00000100:00100000:0.0:1746140891.770906:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.771061:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573978112 00000100:00100000:1.0:1746140891.771070:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573978112 00000100:00100000:1.0:1746140891.771123:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 796 00000100:00100000:2.0:1746140891.771125:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1984:x1830960573977728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18085us (18939us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.771130:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960573978112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140891.771136:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9015 00010000:00010000:1.0:1746140891.771142:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746140891.771144:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff880135b66300 x1830960573977728/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.771152:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66300 with x1830960573977728 ext(1048576->2097151) 00002000:00010000:2.0:1746140891.771157:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b66300 00010000:00010000:1.0:1746140891.771165:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cbce00/0x8156357b7fdbbc69 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e1 expref: 10 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.771184:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.771188:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.771214:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960573978112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.771220:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 796 00000100:00100000:3.0:1746140891.773873:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.774169:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573978368 00000100:00100000:2.0:1746140891.774181:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573978368 00000100:00100000:2.0:1746140891.774244:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10890 00000100:00100000:2.0:1746140891.774252:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:499:x1830960573978368:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140891.774275:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.774279:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746140891.774324:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fcb4a00/0x8156357b7fdbbc15 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a9 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.774359:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140891.774363:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140891.774377:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cbce00/0x8156357b7fdbbc77 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24e8 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.774423:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.774434:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.774440:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.774446:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 5/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.774474:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 268 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.774484:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 268 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.774495:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013569a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576151552:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140891.774564:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140891.774579:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.774587:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 8 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.774595:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135698380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576151680:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140891.774602:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573978496 00000100:00100000:1.0:1746140891.774609:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573978496 00000100:00100000:2.0:1746140891.774620:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4000 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.774638:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10891 00000100:00100000:1.0:1746140891.774643:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+10:497:x1830960573978496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.774657:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140891.774864:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24ef expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.774904:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.774909:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.774920:0:14741:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.774927:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.774936:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140891.774938:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140891.774939:0:14741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140891.774943:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009071b600, rc 0) 00000100:00100000:1.0:1746140891.774993:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:497:x1830960573978496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 349us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.774999:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10891 00000100:00100000:0.0:1746140891.775542:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.775628:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573978752 00000100:00100000:3.0:1746140891.775633:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573978752 00002000:00100000:3.0:1746140891.775663:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880135b65f80 x1830960573978752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.775672:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b65f80 with x1830960573978752 ext(2097152->3145727) 00002000:00010000:3.0:1746140891.775677:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b65f80 00000100:00100000:3.0:1746140891.775702:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9016 00000100:00100000:3.0:1746140891.775708:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573978752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.776162:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.776190:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.776208:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573979008 00000100:00100000:1.0:1746140891.776211:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573979008 00000100:00100000:0.0:1746140891.776216:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746140891.776232:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135b66d80 x1830960573979008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140891.776235:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573979392 00000100:00100000:2.0:1746140891.776241:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573979392 00002000:00100000:1.0:1746140891.776245:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66d80 with x1830960573979008 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.776250:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b66d80 00000100:00100000:0.0:1746140891.776252:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.776264:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573979264 00002000:00100000:2.0:1746140891.776266:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880135b67b80 x1830960573979392/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140891.776267:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573979264 00002000:00100000:2.0:1746140891.776275:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67b80 with x1830960573979392 ext(3145728->4194303) 00000100:00100000:3.0:1746140891.776279:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573979776 00002000:00010000:2.0:1746140891.776280:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b67b80 00002000:00100000:1.0:1746140891.776281:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880092612300 x1830960573979264/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140891.776283:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573979776 00002000:00100000:1.0:1746140891.776288:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612300 with x1830960573979264 ext(2097152->3145727) 00002000:00010000:1.0:1746140891.776290:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612300 00010000:00010000:3.0:1746140891.776300:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 269 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.776323:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9017 00000100:00100000:0.0:1746140891.776328:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.776331:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1983:x1830960573979008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.776333:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9018 00000100:00100000:1.0:1746140891.776340:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573979392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.776344:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573979648 00000100:00100000:3.0:1746140891.776347:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573979648 00000100:00100000:0.0:1746140891.776348:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9019 00000100:00100000:0.0:1746140891.776356:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573979264:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746140891.776359:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 9 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.776373:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9120 00000100:00100000:3.0:1746140891.776378:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960573979776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.776386:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.776391:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 269 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.776400:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 269 pid: 14785 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.776416:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.776421:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140891.776427:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140891.776431:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.776461:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960573979776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.776466:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9120 00000100:00100000:3.0:1746140891.776479:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9121 00000100:00100000:3.0:1746140891.776483:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573979648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.776490:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.776493:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 9 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.776500:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 9 pid: 14741 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.776510:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.776513:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140891.776519:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140891.776524:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140891.776530:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.776540:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.776554:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960573979648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.776559:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9121 00010000:00010000:2.0:1746140891.777673:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbc23 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b0 expref: 268 pid: 14785 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.777688:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013569a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576151552:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.777699:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e4cc00/0x8156357b7fdbbb89 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2463 expref: 8 pid: 14741 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.777708:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135698380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576151680:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.777726:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.777734:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140891.777738:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27790 initiator: MDT0 00000040:00080000:2.0:1746140891.778342:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3557, 88 off301688 00000004:00080000:2.0:1746140891.778349:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854043445ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.778411:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3572, 88 off303192 00000004:00080000:2.0:1746140891.778415:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870854109970ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.778437:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3573, 88 off303280 00000004:00080000:2.0:1746140891.778440:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870854135009ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.778451:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3558, 88 off301776 00000004:00080000:2.0:1746140891.778454:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854148894ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.778463:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3559, 88 off301864 00000004:00080000:2.0:1746140891.778466:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854161073ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.778483:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3574, 88 off303368 00000004:00080000:2.0:1746140891.778485:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870854180252ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.779133:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3575, 88 off303456 00000004:00080000:2.0:1746140891.779139:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870854833972ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.779164:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3576, 88 off303544 00000004:00080000:2.0:1746140891.779168:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870854863117ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.779176:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3560, 88 off301952 00000004:00080000:2.0:1746140891.779178:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854873414ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.779186:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3577, 88 off303632 00000004:00080000:2.0:1746140891.779189:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870854884052ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.779195:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3561, 88 off302040 00000004:00080000:2.0:1746140891.779197:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854891902ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.779203:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3578, 88 off303720 00000004:00080000:2.0:1746140891.779205:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870854900065ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140891.779210:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3562, 88 off302128 00000004:00080000:2.0:1746140891.779212:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854907382ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.779219:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3563, 88 off302216 00000004:00080000:2.0:1746140891.779221:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854916644ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.779228:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3564, 88 off302304 00000004:00080000:2.0:1746140891.779230:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854925160ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.779235:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3565, 88 off302392 00000004:00080000:2.0:1746140891.779237:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870854932689ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140891.779243:0:27790:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3579, 88 off303808 00000004:00080000:2.0:1746140891.779245:0:27790:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 870854940062ns, next at 809142599738ns, rc = 0 00000100:00100000:1.0:1746140891.786519:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1983:x1830960573979392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10173us (10321us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.786530:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9018 00002000:00100000:1.0:1746140891.786541:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880135b67b80 x1830960573979392/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.786550:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b67b80 with x1830960573979392 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.786555:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b67b80 00000100:00100000:2.0:1746140891.791951:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1983:x1830960573979008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15615us (15784us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.791962:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9017 00002000:00100000:2.0:1746140891.791987:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff880135b66d80 x1830960573979008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.791995:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b66d80 with x1830960573979008 ext(3145728->4194303) 00002000:00010000:2.0:1746140891.792001:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b66d80 00000100:00100000:1.0:1746140891.792300:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573979264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15944us (16081us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.792328:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9019 00002000:00100000:1.0:1746140891.792334:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff880092612300 x1830960573979264/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.792341:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092612300 with x1830960573979264 ext(2097152->3145727) 00002000:00010000:1.0:1746140891.792346:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092612300 00000100:00100000:0.0:1746140891.797188:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573978752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21473us (21641us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140891.797199:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9016 00002000:00100000:0.0:1746140891.797211:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff880135b65f80 x1830960573978752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.797220:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b65f80 with x1830960573978752 ext(2097152->3145727) 00002000:00010000:0.0:1746140891.797226:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b65f80 00000100:00100000:2.0:1746140891.801192:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.801256:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573979904 00000100:00100000:3.0:1746140891.801265:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573979904 00000100:00100000:3.0:1746140891.801325:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10892 00000100:00100000:3.0:1746140891.801332:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:496:x1830960573979904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140891.801352:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.801371:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24f6 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.801423:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.801434:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 269 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.801444:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.801447:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140891.801450:0:14741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.801456:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256f200, rc 0) 00000100:00100000:3.0:1746140891.801495:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:496:x1830960573979904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 163us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.801501:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10892 00000001:00080000:1.0:1746140891.803546:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945228 is committed 00000004:00080000:1.0:1746140891.803553:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2820 committed 00000004:00080000:1.0:1746140891.803559:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2810 committed 00000004:00080000:1.0:1746140891.803564:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2809 committed 00000004:00080000:1.0:1746140891.803565:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2808 committed 00000004:00080000:1.0:1746140891.803566:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2807 committed 00000004:00080000:1.0:1746140891.803568:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2819 committed 00000004:00080000:1.0:1746140891.803569:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2806 committed 00000004:00080000:1.0:1746140891.803571:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2818 committed 00000004:00080000:1.0:1746140891.803572:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2805 committed 00000004:00080000:1.0:1746140891.803573:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2817 committed 00000004:00080000:1.0:1746140891.803575:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2816 committed 00000004:00080000:1.0:1746140891.803577:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2815 committed 00000004:00080000:1.0:1746140891.803578:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2804 committed 00000004:00080000:1.0:1746140891.803580:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2803 committed 00000004:00080000:1.0:1746140891.803581:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2814 committed 00000004:00080000:1.0:1746140891.803582:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2813 committed 00000004:00080000:1.0:1746140891.803584:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2802 committed 00000001:00080000:1.0:1746140891.803593:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945226 is committed 00000001:00080000:1.0:1746140891.803599:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945223 is committed 00010000:00010000:3.0:1746140891.803679:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.803691:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140891.803693:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746140891.803698:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.803909:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576152064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.803939:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576152192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.803962:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.803963:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576151936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140891.804015:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576151808:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746140891.804041:0:27790:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.804054:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.804064:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 266 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.804073:0:27790:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 266 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.804082:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 266 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.804102:0:27790:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 266 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.804110:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576153856:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140891.804515:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576152576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.804561:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.804577:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576152448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.804592:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.804600:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576152960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.804613:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140891.804631:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.804631:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576153472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.804644:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576152320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.804645:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140891.804657:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140891.804666:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576152832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.804669:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140891.804679:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.804679:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576152704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140891.804687:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576153344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.804691:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140891.804699:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.804699:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576153216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.804711:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.804720:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576153728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.804723:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576152064 00000100:00100000:2.0:1746140891.804728:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576152064 00000100:00100000:0.0:1746140891.804730:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.804747:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576151936 00000100:00100000:0.0:1746140891.804749:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576151936 00000100:00100000:2.0:1746140891.804753:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576152448 00000100:00100000:2.0:1746140891.804754:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576152448 00000100:00100000:2.0:1746140891.804760:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576152960 00000100:00100000:0.0:1746140891.804760:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576151808 00000100:00100000:2.0:1746140891.804761:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576152960 00000100:00100000:0.0:1746140891.804762:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576151808 00000100:00100000:0.0:1746140891.804766:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576153472 00000100:00100000:2.0:1746140891.804768:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576152320 00000100:00100000:0.0:1746140891.804768:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576153472 00000100:00100000:2.0:1746140891.804769:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576152320 00000100:00100000:0.0:1746140891.804773:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576152192 00000100:00100000:0.0:1746140891.804774:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576152192 00000100:00100000:2.0:1746140891.804775:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576152832 00000100:00100000:2.0:1746140891.804776:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576152832 00000100:00100000:0.0:1746140891.804779:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576152704 00000100:00100000:0.0:1746140891.804780:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576152704 00000100:00100000:2.0:1746140891.804782:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576153344 00000100:00100000:2.0:1746140891.804783:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576153344 00000100:00100000:0.0:1746140891.804786:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576153216 00000100:00100000:2.0:1746140891.804787:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576153728 00000100:00100000:0.0:1746140891.804787:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576153216 00000100:00100000:2.0:1746140891.804789:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576153728 00000100:00100000:0.0:1746140891.804795:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17585 00000100:00100000:0.0:1746140891.804801:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+99:3311:x1830960576152064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140891.804803:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17586 00000100:00100000:2.0:1746140891.804806:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+99:3310:x1830960576152448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140891.804816:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17587 00000100:00100000:2.0:1746140891.804819:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+99:3310:x1830960576151936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140891.804854:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17588 00000100:00100000:2.0:1746140891.804858:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+99:3313:x1830960576151808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140891.804895:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17589 00000100:00100000:2.0:1746140891.804899:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+109:3310:x1830960576152960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140891.804982:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746140891.804985:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140891.804988:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140889 -> 1746140889 00002000:00010000:0.0:1746140891.804989:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140890 -> 1746140890 00002000:00010000:0.0:1746140891.804991:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:2.0:1746140891.805002:0:32377:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140891.805004:0:32377:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140892 -> 1746140892 00002000:00010000:2.0:1746140891.805005:0:32377:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140891 -> 1746140891 00002000:00010000:2.0:1746140891.805007:0:32377:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140892 -> 1746140892 00002000:00010000:2.0:1746140891.805008:0:32377:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140891.805014:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+100:3311:x1830960576152064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (1052us total) trans 17179874256 rc 0/0 00000100:00100000:0.0:1746140891.805020:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17585 00000100:00100000:2.0:1746140891.805025:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+110:3310:x1830960576152960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (411us total) trans 21474841560 rc 0/0 00000100:00100000:2.0:1746140891.805029:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17589 00000100:00100000:0.0:1746140891.805032:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17590 00000100:00100000:0.0:1746140891.805036:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+110:3310:x1830960576153472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.805039:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17591 00000100:00100000:2.0:1746140891.805043:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+99:3313:x1830960576152320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140891.805075:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17592 00000100:00100000:2.0:1746140891.805079:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+99:3312:x1830960576152192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.805108:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+110:3310:x1830960576153472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (462us total) trans 21474841561 rc 0/0 00000100:00100000:0.0:1746140891.805113:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17590 00000100:00100000:0.0:1746140891.805123:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17593 00000100:00100000:0.0:1746140891.805127:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+109:3313:x1830960576152832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140891.805189:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140891.805191:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140891 -> 1746140891 00002000:00010000:0.0:1746140891.805192:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140891 -> 1746140891 00002000:00010000:0.0:1746140891.805194:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140891 -> 1746140891 00002000:00010000:0.0:1746140891.805195:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746140891.805202:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17594 00000100:00100000:1.0:1746140891.805210:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+100:3312:x1830960576152704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.805214:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+110:3313:x1830960576152832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (534us total) trans 21474841562 rc 0/0 00000100:00100000:0.0:1746140891.805219:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17593 00000100:00100000:0.0:1746140891.805229:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17595 00010000:00010000:3.0:1746140891.805230:0:27790:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140891.805233:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+109:3313:x1830960576153344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140891.805239:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576153984:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.805256:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.805302:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+110:3313:x1830960576153344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (601us total) trans 21474841563 rc 0/0 00000100:00100000:1.0:1746140891.805321:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+101:3312:x1830960576152704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (611us total) trans 17179874258 rc 0/0 00000100:00100000:0.0:1746140891.805324:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17595 00000100:00100000:1.0:1746140891.805329:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17594 00000100:00100000:0.0:1746140891.805333:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17596 00000100:00100000:3.0:1746140891.805337:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17597 00000100:00100000:0.0:1746140891.805338:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+109:3312:x1830960576153216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140891.805341:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+109:3312:x1830960576153728:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140891.805362:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094450a80/2, rc 0, transno 17179874258 00000100:00100000:1.0:1746140891.805366:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576152704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140891.805376:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094450000/2, rc 0, transno 21474841562 00000100:00100000:0.0:1746140891.805383:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576152832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.805384:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746140891.805390:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba4700/2, rc 0, transno 21474841563 00000100:00100000:0.0:1746140891.805393:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576153344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.805397:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576153088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.805404:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576152576 00000100:00100000:0.0:1746140891.805406:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576152576 00000100:00100000:1.0:1746140891.805412:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.805420:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576153088 00000100:00100000:1.0:1746140891.805421:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576153600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.805421:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576153088 00000100:00100000:3.0:1746140891.805424:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+111:3312:x1830960576153728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (691us total) trans 21474841564 rc 0/0 00000100:00100000:3.0:1746140891.805429:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17597 00000100:00100000:0.0:1746140891.805431:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17598 00000100:00100000:1.0:1746140891.805433:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140891.805435:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+101:3311:x1830960576152576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140891.805436:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576153600 00000100:00100000:3.0:1746140891.805438:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576153600 00000100:00100000:3.0:1746140891.805446:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17599 00000004:00080000:1.0:1746140891.805447:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc35c00/2, rc 0, transno 17179874256 00000100:00100000:1.0:1746140891.805450:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576152064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140891.805461:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17600 00000100:00100000:3.0:1746140891.805464:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+111:3311:x1830960576153088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.805470:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+111:3311:x1830960576153600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140891.805510:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+102:3311:x1830960576152576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (125us total) trans 17179874259 rc 0/0 00000100:00100000:0.0:1746140891.805515:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17598 00002000:00010000:3.0:1746140891.805523:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:3.0:1746140891.805525:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140892 -> 1746140892 00002000:00010000:3.0:1746140891.805527:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140892 -> 1746140892 00002000:00010000:3.0:1746140891.805528:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140892 -> 1746140892 00002000:00010000:3.0:1746140891.805530:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5521 -> 5521 00000004:00080000:0.0:1746140891.805535:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba6a00/2, rc 0, transno 21474841560 00000100:00100000:0.0:1746140891.805538:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576152960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140891.805544:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b06ad80/2, rc 0, transno 21474841561 00000100:00100000:0.0:1746140891.805546:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576153472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140891.805549:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+113:3311:x1830960576153088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (137us total) trans 21474841565 rc 0/0 00000100:00100000:3.0:1746140891.805553:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17599 00000100:00100000:1.0:1746140891.805556:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+113:3311:x1830960576153600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (122us total) trans 21474841566 rc 0/0 00000100:00100000:1.0:1746140891.805566:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17600 00000004:00080000:1.0:1746140891.805606:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094af4e00/2, rc 0, transno 21474841564 00000100:00100000:0.0:1746140891.805606:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576154112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.805609:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576153728:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140891.805619:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094452a00/2, rc 0, transno 17179874259 00000100:00100000:1.0:1746140891.805622:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576152576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.805624:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746140891.805628:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba7800/2, rc 0, transno 21474841565 00000100:00100000:1.0:1746140891.805630:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576153088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140891.805635:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b06b480/2, rc 0, transno 21474841566 00000100:00100000:1.0:1746140891.805638:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576153600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.805646:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576154112 00000100:00100000:1.0:1746140891.805649:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576154112 00000100:00100000:1.0:1746140891.805660:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17601 00000100:00100000:1.0:1746140891.805664:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+112:3313:x1830960576154112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140891.805700:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+113:3312:x1830960576153216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 362us (987us total) trans 21474841567 rc 0/0 00000100:00100000:3.0:1746140891.805705:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17596 00000004:00080000:0.0:1746140891.805710:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ba4a80/2, rc 0, transno 21474841567 00000100:00100000:0.0:1746140891.805713:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576153216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140891.805734:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+113:3313:x1830960576154112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (109us total) trans 21474841568 rc 0/0 00000100:00100000:1.0:1746140891.805739:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17601 00000004:00080000:0.0:1746140891.805741:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc0a680/2, rc 0, transno 21474841568 00000100:00100000:0.0:1746140891.805744:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576154112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140891.805964:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+102:3310:x1830960576152448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1156us (1370us total) trans 17179874260 rc 0/0 00000100:00100000:2.0:1746140891.805978:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17586 00000100:00100000:2.0:1746140891.806071:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+102:3313:x1830960576152320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1027us (1412us total) trans 17179874261 rc 0/0 00000100:00100000:2.0:1746140891.806077:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17591 00002000:00010000:2.0:1746140891.806089:0:32376:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140891.806091:0:32376:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140891 -> 1746140891 00002000:00010000:2.0:1746140891.806093:0:32376:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140891 -> 1746140891 00002000:00010000:2.0:1746140891.806094:0:32376:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140891 -> 1746140891 00002000:00010000:2.0:1746140891.806096:0:32376:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746140891.806112:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+101:3313:x1830960576151808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1255us (1481us total) trans 17179874257 rc 0/0 00000100:00100000:2.0:1746140891.806117:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17588 00000004:00080000:0.0:1746140891.806146:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094453100/2, rc 0, transno 17179874260 00000100:00100000:0.0:1746140891.806150:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576152448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140891.806344:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc35500/2, rc 0, transno 17179874257 00000100:00100000:1.0:1746140891.806348:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576151808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140891.806356:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094451880/2, rc 0, transno 17179874261 00000100:00100000:1.0:1746140891.806358:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576152320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140891.806746:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+101:3312:x1830960576152192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1666us (2075us total) trans 17179874262 rc 0/0 00000100:00100000:3.0:1746140891.806752:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17592 00002000:00010000:2.0:1746140891.806846:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00000004:00080000:0.0:1746140891.806846:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc36d80/2, rc 0, transno 17179874262 00002000:00010000:2.0:1746140891.806848:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140891 -> 1746140891 00002000:00010000:2.0:1746140891.806849:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140891 -> 1746140891 00000100:00100000:0.0:1746140891.806850:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576152192:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746140891.806851:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140891 -> 1746140891 00002000:00010000:2.0:1746140891.806853:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746140891.806886:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+101:3310:x1830960576151936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2065us (2324us total) trans 17179874263 rc 0/0 00000100:00100000:2.0:1746140891.806891:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17587 00000004:00080000:1.0:1746140891.806930:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc35f80/2, rc 0, transno 17179874263 00000100:00100000:1.0:1746140891.806934:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576151936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140891.808001:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.808068:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.808166:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573980032 00000100:00100000:1.0:1746140891.808172:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573980032 00000100:00100000:1.0:1746140891.808194:0:14744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573980160 00000100:00100000:1.0:1746140891.808196:0:14744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573980160 00000100:00100000:1.0:1746140891.808206:0:14744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4808 00000100:00100000:1.0:1746140891.808210:0:14744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:496:x1830960573980032:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746140891.808217:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4809 00000100:00100000:0.0:1746140891.808224:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:497:x1830960573980160:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:3.0:1746140891.808271:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576153856:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140891.808279:0:14744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:496:x1830960573980032:12345-192.168.204.16@tcp:49:cat.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.808280:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576153984:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140891.808282:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:497:x1830960573980160:12345-192.168.204.16@tcp:49:cat.0 Request processed in 59us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.808283:0:14744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4808 00000100:00100000:0.0:1746140891.808288:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4809 00010000:00010000:3.0:1746140891.808329:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cbce00/0x8156357b7fdbbc77 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 9 pid: 27790 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746140891.808606:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.808630:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e79800, rc 0) 00000100:00100000:3.0:1746140891.808661:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:499:x1830960573978368:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 34410us (34798us total) trans 8589945228 rc 0/0 00000100:00100000:3.0:1746140891.808667:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10890 00000100:00100000:2.0:1746140891.816732:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.816765:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.816788:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573980544 00000100:00100000:2.0:1746140891.816795:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573980544 00000100:00100000:2.0:1746140891.816843:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17602 00000100:00100000:2.0:1746140891.816850:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+28:499:x1830960573980544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140891.816867:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.816884:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a24fd expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.816912:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 43 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.816920:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 29 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.816926:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.816928:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.816931:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2756608->2863103] (req 2756608->2863103) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 29 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.816960:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 29 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.816984:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 29 pid: 12255 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.817014:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573980416 00000100:00100000:0.0:1746140891.817018:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573980416 00002000:00100000:0.0:1746140891.817046:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009abdd500 x1830960573980416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.817054:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdd500 with x1830960573980416 ext(1048576->2097151) 00002000:00010000:0.0:1746140891.817058:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdd500 00000100:00100000:0.0:1746140891.817081:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9020 00000100:00100000:0.0:1746140891.817086:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1985:x1830960573980416:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140891.817648:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576154240:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.817775:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 43 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.817787:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 43 pid: 4782 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.817795:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576154368:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.817815:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.820445:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.820554:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576154240:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.820565:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576154368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.820592:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2756608->2863103] (req 2756608->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 29 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.820609:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f19de00, rc 0) 00000100:00100000:3.0:1746140891.820756:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+29:499:x1830960573980544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3906us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.820765:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17602 00000100:00100000:1.0:1746140891.820792:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573980672 00000100:00100000:1.0:1746140891.820798:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573980672 00010000:00010000:1.0:1746140891.820821:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 29 pid: 12255 timeout: 970 lvb_type: 1 00000100:00100000:1.0:1746140891.820845:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9122 00000100:00100000:1.0:1746140891.820851:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4796c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1983:x1830960573980672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140891.820861:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140891.820880:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 29 pid: 12255 timeout: 970 lvb_type: 1 00010000:00010000:1.0:1746140891.820889:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 29 pid: 12255 timeout: 970 lvb_type: 1 00010000:00010000:1.0:1746140891.820908:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e79a00/0x8156357b7fdbbc4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24da expref: 29 pid: 12255 timeout: 970 lvb_type: 1 00010000:00010000:1.0:1746140891.820922:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140891.820939:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4796c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1983:x1830960573980672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.820944:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9122 00000100:00100000:1.0:1746140891.823353:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1985:x1830960573980416:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6260us (6622us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.823364:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9020 00002000:00100000:1.0:1746140891.823374:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009abdd500 x1830960573980416/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.823382:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdd500 with x1830960573980416 ext(1048576->2097151) 00002000:00010000:1.0:1746140891.823386:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdd500 00000100:00100000:0.0:1746140891.825181:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.825214:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.825248:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.825272:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573981056 00000100:00100000:2.0:1746140891.825280:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573981056 00002000:00100000:2.0:1746140891.825354:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008f3c2680 x1830960573981056/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140891.825357:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573981184 00000100:00100000:3.0:1746140891.825361:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573981184 00002000:00100000:2.0:1746140891.825363:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c2680 with x1830960573981056 ext(2097152->3145727) 00010000:00010000:2.0:1746140891.825371:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 45 pid: 4782 timeout: 970 lvb_type: 1 00002000:00100000:3.0:1746140891.825377:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f3c3800 x1830960573981184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.825384:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c3800 with x1830960573981184 ext(3145728->4194303) 00010000:00010000:2.0:1746140891.825385:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 45 pid: 4782 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.825388:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 45 pid: 4782 timeout: 970 lvb_type: 1 00002000:00010000:2.0:1746140891.825391:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3c2680 00010000:00010000:3.0:1746140891.825397:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 45 pid: 4782 timeout: 970 lvb_type: 1 00002000:00010000:3.0:1746140891.825403:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3c3800 00000100:00100000:2.0:1746140891.825411:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573981440 00000100:00100000:2.0:1746140891.825413:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573981440 00000100:00100000:3.0:1746140891.825416:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1873 00000100:00100000:3.0:1746140891.825422:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573981056:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746140891.825426:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008f3c1180 x1830960573981440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.825432:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1180 with x1830960573981440 ext(3145728->4194303) 00002000:00010000:2.0:1746140891.825436:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c1180 00000100:00100000:2.0:1746140891.825451:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1874 00000100:00100000:2.0:1746140891.825457:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573981184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.825580:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9021 00000100:00100000:1.0:1746140891.825587:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573981440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.829748:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.830075:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573981568 00000100:00100000:2.0:1746140891.830084:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573981568 00000100:00100000:2.0:1746140891.830131:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17603 00000100:00100000:2.0:1746140891.830139:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573981568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.830155:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.830170:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8d600/0x8156357b7fdbbc9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2504 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.830195:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.830206:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8d600/0x8156357b7fdbbc9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2504 expref: 29 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.830217:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8d600/0x8156357b7fdbbc9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2504 expref: 29 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.830236:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8d600, rc 0) 00000100:00100000:2.0:1746140891.830282:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573981568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 143us (543us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140891.830288:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17603 00000100:00100000:1.0:1746140891.837914:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.838179:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573981824 00000100:00100000:0.0:1746140891.838192:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573981824 00000100:00100000:3.0:1746140891.838227:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1983:x1830960573981056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12803us (13050us total) trans 0 rc 1048576/1048576 00002000:00100000:0.0:1746140891.838237:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009fc08000 x1830960573981824/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140891.838238:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1873 00002000:00100000:0.0:1746140891.838247:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08000 with x1830960573981824 ext(2097152->3145727) 00002000:00100000:3.0:1746140891.838248:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008f3c2680 x1830960573981056/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746140891.838252:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc08000 00002000:00100000:3.0:1746140891.838257:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c2680 with x1830960573981056 ext(2097152->3145727) 00010000:00010000:3.0:1746140891.838266:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 46 pid: 4782 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.838275:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9022 00010000:00010000:3.0:1746140891.838278:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 46 pid: 4782 timeout: 970 lvb_type: 1 00000100:00100000:0.0:1746140891.838283:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1985:x1830960573981824:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:3.0:1746140891.838284:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3c2680 00000100:00100000:2.0:1746140891.839253:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573981184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13792us (14033us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.839262:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1874 00002000:00100000:2.0:1746140891.839269:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f3c3800 x1830960573981184/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.839275:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c3800 with x1830960573981184 ext(3145728->4194303) 00010000:00010000:2.0:1746140891.839281:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 44 pid: 4782 timeout: 970 lvb_type: 1 00010000:00010000:2.0:1746140891.839291:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 44 pid: 4782 timeout: 970 lvb_type: 1 00002000:00010000:2.0:1746140891.839297:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3c3800 00000100:00100000:1.0:1746140891.844676:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573981440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19080us (19417us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.844688:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9021 00002000:00100000:1.0:1746140891.844700:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008f3c1180 x1830960573981440/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.844708:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1180 with x1830960573981440 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.844713:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c1180 00000100:00100000:0.0:1746140891.847671:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.848008:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573981952 00000100:00100000:3.0:1746140891.848021:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573981952 00010000:00010000:3.0:1746140891.848065:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 44 pid: 4782 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.848115:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9123 00000100:00100000:2.0:1746140891.848116:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1985:x1830960573981824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9833us (10210us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.848122:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573981952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140891.848125:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9022 00010000:00010000:3.0:1746140891.848133:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746140891.848133:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009fc08000 x1830960573981824/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.848140:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc08000 with x1830960573981824 ext(2097152->3145727) 00002000:00010000:2.0:1746140891.848144:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc08000 00010000:00010000:3.0:1746140891.848150:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 44 pid: 4782 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.848160:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 44 pid: 4782 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.848180:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d400/0x8156357b7fdbbbd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24a2 expref: 44 pid: 4782 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.848239:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.848241:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.848247:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.848254:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.849020:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.849036:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576154496:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.849099:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.850619:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.850686:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573982080 00000100:00100000:2.0:1746140891.850694:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573982080 00000100:00100000:2.0:1746140891.850745:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17604 00000100:00100000:2.0:1746140891.850752:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:496:x1830960573982080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.850767:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.850781:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a250b expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.850812:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.850819:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140891.850821:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140891.850824:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 45 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.850847:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.850858:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 27 pid: 9872 timeout: 970 lvb_type: 0 00000100:00100000:2.0:1746140891.850867:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576154624:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.850936:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.851543:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576154496:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.851557:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.851583:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573981952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3461us (3922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.851590:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9123 00000100:00100000:0.0:1746140891.853473:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.853513:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.853605:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573982336 00000100:00100000:2.0:1746140891.853615:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573982336 00002000:00100000:2.0:1746140891.853660:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2756607) req@ffff88008f3c0380 x1830960573982336/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.853668:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0380 with x1830960573982336 ext(2097152->2756607) 00010000:00010000:2.0:1746140891.853676:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 28 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.853689:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 28 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.853695:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3c0380 00000100:00100000:2.0:1746140891.853729:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573982592 00000100:00100000:2.0:1746140891.853732:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573982592 00002000:00100000:2.0:1746140891.853743:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2785280->3145727) req@ffff88008f3c1c00 x1830960573982592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.853749:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1c00 with x1830960573982592 ext(2785280->3145727) 00010000:00010000:2.0:1746140891.853753:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 29 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.853765:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 29 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.853769:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3c1c00 00000100:00100000:2.0:1746140891.853790:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1875 00000100:00100000:2.0:1746140891.853796:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573982336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.853802:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1876 00000100:00100000:1.0:1746140891.853808:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573982592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.854439:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576154624:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140891.854463:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 44 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140891.854475:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8da00, rc 0) 00000100:00100000:1.0:1746140891.854499:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:496:x1830960573982080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3748us (3887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140891.854505:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17604 00000100:00100000:0.0:1746140891.856670:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.856746:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573982848 00000100:00100000:3.0:1746140891.856757:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573982848 00002000:00100000:3.0:1746140891.856798:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008f3c0e00 x1830960573982848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.856807:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0e00 with x1830960573982848 ext(3145728->4194303) 00002000:00010000:3.0:1746140891.856811:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c0e00 00000100:00100000:3.0:1746140891.856851:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9023 00000100:00100000:3.0:1746140891.856858:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1985:x1830960573982848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.858403:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.858439:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573983104 00000100:00100000:0.0:1746140891.858444:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573983104 00000100:00100000:1.0:1746140891.858456:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.858485:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17605 00000100:00100000:0.0:1746140891.858493:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+32:497:x1830960573983104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140891.858505:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140891.858520:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2512 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.858547:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140891.858550:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140891.858554:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 33 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.858564:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 33 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140891.858574:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fac00, rc 0) 00000100:00100000:0.0:1746140891.858602:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+33:497:x1830960573983104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 110us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140891.858609:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17605 00000100:00100000:0.0:1746140891.858627:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573983232 00000100:00100000:0.0:1746140891.858630:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573983232 00002000:00100000:0.0:1746140891.858645:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009fc0b100 x1830960573983232/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140891.858654:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0b100 with x1830960573983232 ext(3145728->4194303) 00010000:00010000:0.0:1746140891.858658:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 33 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:0.0:1746140891.858668:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 33 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:0.0:1746140891.858674:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc0b100 00000100:00100000:0.0:1746140891.858684:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1877 00000100:00100000:0.0:1746140891.858689:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1985:x1830960573983232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.858702:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573982592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4892us (5186us total) trans 0 rc 360448/360448 00000100:00100000:1.0:1746140891.858711:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1876 00002000:00100000:1.0:1746140891.858716:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (2785280->3145727) req@ffff88008f3c1c00 x1830960573982592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 360448/360448 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.858723:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c1c00 with x1830960573982592 ext(2785280->3145727) 00010000:00010000:1.0:1746140891.858727:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 32 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.858736:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 32 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:1.0:1746140891.858741:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3c1c00 00000100:00100000:2.0:1746140891.861326:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573982336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7503us (7834us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746140891.861336:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1875 00002000:00100000:2.0:1746140891.861346:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->2756607) req@ffff88008f3c0380 x1830960573982336/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.861355:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0380 with x1830960573982336 ext(2097152->2756607) 00010000:00010000:2.0:1746140891.861363:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:2.0:1746140891.861375:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:2.0:1746140891.861381:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3c0380 00000100:00100000:3.0:1746140891.865843:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1985:x1830960573982848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8977us (9173us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140891.865855:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9023 00002000:00100000:3.0:1746140891.865866:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88008f3c0e00 x1830960573982848/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.865874:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0e00 with x1830960573982848 ext(3145728->4194303) 00002000:00010000:3.0:1746140891.865879:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c0e00 00000100:00100000:2.0:1746140891.866254:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.866287:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.866326:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573983744 00000100:00100000:0.0:1746140891.866334:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573983744 00000100:00100000:0.0:1746140891.866365:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4810 00000100:00100000:0.0:1746140891.866371:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:499:x1830960573983744:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140891.866409:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573983488 00000100:00100000:3.0:1746140891.866413:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573983488 00002000:00100000:3.0:1746140891.866433:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2756608->2863103) req@ffff88009abdf480 x1830960573983488/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.866446:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf480 with x1830960573983488 ext(2756608->2863103) 00010000:00010000:3.0:1746140891.866453:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.866467:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.866473:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009abdf480 00000100:00100000:3.0:1746140891.866485:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1878 00000100:00100000:3.0:1746140891.866490:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1983:x1830960573983488:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140891.866556:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573983232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7866us (8098us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.866564:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1877 00000100:00100000:0.0:1746140891.866565:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:499:x1830960573983744:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 195us (278us total) trans 8589945229 rc 0/0 00002000:00100000:1.0:1746140891.866569:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009fc0b100 x1830960573983232/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746140891.866570:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4810 00002000:00100000:1.0:1746140891.866576:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0b100 with x1830960573983232 ext(3145728->4194303) 00010000:00010000:1.0:1746140891.866581:0:21376:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 30 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:1.0:1746140891.866590:0:21376:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 30 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:1.0:1746140891.866597:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc0b100 00000100:00100000:3.0:1746140891.869857:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1983:x1830960573983488:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3358us (3596us total) trans 17179874264 rc 0/0 00000100:00100000:3.0:1746140891.869867:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1878 00002000:00100000:3.0:1746140891.869878:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2756608->2863103) req@ffff88009abdf480 x1830960573983488/t17179874264(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/448 e 0 to 0 dl 1746140902 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140891.869887:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdf480 with x1830960573983488 ext(2756608->2863103) 00010000:00010000:3.0:1746140891.869895:0:8464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.869907:0:8464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00002000:00010000:3.0:1746140891.869914:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009abdf480 00000100:00100000:0.0:1746140891.874987:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.875140:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573983872 00000100:00100000:3.0:1746140891.875151:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573983872 00010000:00010000:3.0:1746140891.875187:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00000100:00100000:3.0:1746140891.875837:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9124 00000100:00100000:3.0:1746140891.875847:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1984:x1830960573983872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.875864:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746140891.875881:0:7110:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140890 -> 1746140892 00002000:00010000:3.0:1746140891.875884:0:7110:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140890 -> 1746140892 00010000:00010000:3.0:1746140891.875889:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.875901:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.875921:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f19de00/0x8156357b7fdbbc93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2756608->2863103) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24fd expref: 31 pid: 9872 timeout: 970 lvb_type: 0 00010000:00010000:3.0:1746140891.875947:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.875949:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.875955:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 43 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.875962:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 43 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.875976:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.875978:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.875981:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.875986:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.876011:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 30 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.876020:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576154752:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.876093:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 43 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.876101:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576154880:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.876119:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.880612:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.880706:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573984128 00000100:00100000:2.0:1746140891.880713:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573984128 00002000:00100000:2.0:1746140891.880754:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f3c2300 x1830960573984128/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.880763:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c2300 with x1830960573984128 ext(3145728->4194303) 00002000:00010000:2.0:1746140891.880768:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c2300 00000100:00100000:2.0:1746140891.880786:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9024 00000100:00100000:2.0:1746140891.880793:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573984128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140891.880896:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576154752:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.880911:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576154880:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.880927:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.880982:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573983872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5136us (6016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.880990:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9124 00000100:00100000:0.0:1746140891.885038:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.885096:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.885174:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573984384 00000100:00100000:1.0:1746140891.885186:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573984384 00002000:00100000:1.0:1746140891.885229:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008f3c0000 x1830960573984384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.885239:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0000 with x1830960573984384 ext(2097152->3145727) 00002000:00010000:1.0:1746140891.885253:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c0000 00000100:00100000:1.0:1746140891.885349:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573984512 00000100:00100000:1.0:1746140891.885353:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573984512 00000100:00100000:2.0:1746140891.885356:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9025 00000100:00100000:2.0:1746140891.885366:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573984384:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746140891.885366:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880093130000 x1830960573984512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.885372:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130000 with x1830960573984512 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.885375:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130000 00000100:00100000:1.0:1746140891.885390:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9026 00000100:00100000:1.0:1746140891.885394:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1985:x1830960573984512:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.887912:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.889362:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573984128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8565us (8753us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.889373:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9024 00002000:00100000:2.0:1746140891.889384:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88008f3c2300 x1830960573984128/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.889393:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c2300 with x1830960573984128 ext(3145728->4194303) 00002000:00010000:2.0:1746140891.889398:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c2300 00000100:00100000:3.0:1746140891.889488:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573984768 00000100:00100000:3.0:1746140891.889495:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573984768 00000100:00100000:3.0:1746140891.889540:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17606 00000100:00100000:3.0:1746140891.889547:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:492:x1830960573984768:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140891.889561:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.889580:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2519 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.889603:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.889612:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 33 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.889617:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.889619:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.889622:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1802240->2097151] (req 1802240->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 45 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.889664:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 33 pid: 8459 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.889674:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 33 pid: 8459 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.889684:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576155008:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.889746:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.889754:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.890834:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576155136:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.890888:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.894655:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1985:x1830960573984384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9282us (9624us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140891.894667:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9025 00002000:00100000:2.0:1746140891.894677:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88008f3c0000 x1830960573984384/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.894687:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c0000 with x1830960573984384 ext(2097152->3145727) 00002000:00010000:2.0:1746140891.894692:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c0000 00000100:00100000:3.0:1746140891.897026:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576155008:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140891.897038:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576155136:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140891.897063:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1802240->2097151] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 45 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.897078:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256e400, rc 0) 00000100:00100000:3.0:1746140891.897136:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:492:x1830960573984768:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7589us (9231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.897143:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17606 00000100:00100000:1.0:1746140891.897170:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573984512:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11774us (12073us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140891.897177:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9026 00002000:00100000:1.0:1746140891.897183:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880093130000 x1830960573984512/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.897192:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093130000 with x1830960573984512 ext(3145728->4194303) 00002000:00010000:1.0:1746140891.897196:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093130000 00000100:00100000:0.0:1746140891.897449:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.897469:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.897490:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.897511:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573984896 00000100:00100000:3.0:1746140891.897517:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573984896 00010000:00010000:3.0:1746140891.897541:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 30 pid: 8459 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.897568:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573985152 00000100:00100000:3.0:1746140891.897571:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573985152 00010000:00010000:3.0:1746140891.897580:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.897593:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9125 00000100:00100000:3.0:1746140891.897598:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573984896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.897608:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.897623:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 30 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.897631:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 30 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.897654:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924bd000/0x8156357b7fdbbc38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24c5 expref: 30 pid: 8459 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.897666:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.897692:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573984896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.897697:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9125 00000100:00100000:3.0:1746140891.897707:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9126 00000100:00100000:3.0:1746140891.897711:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1984:x1830960573985152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.897717:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.897724:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.897732:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.897749:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e78a00/0x8156357b7fdbbbc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a248d expref: 45 pid: 20960 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.897762:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.897763:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.897773:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.897780:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.897811:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.897821:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576155264:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.897883:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.898892:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573985024 00000100:00100000:2.0:1746140891.898898:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573985024 00000100:00100000:2.0:1746140891.898923:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17607 00000100:00100000:2.0:1746140891.898929:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573985024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.898941:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.898955:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924bde00/0x8156357b7fdbbcb6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2520 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.898989:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576155392:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140891.899040:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4300 going to sleep for 11 seconds 00000100:00100000:3.0:1746140891.900362:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576155264:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140891.900376:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.900404:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1984:x1830960573985152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2692us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.900412:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9126 00000100:00100000:0.0:1746140891.900749:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.901370:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573985408 00000100:00100000:1.0:1746140891.901375:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573985408 00002000:00100000:1.0:1746140891.901405:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1802240->1806335) req@ffff880099496a00 x1830960573985408/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.901416:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496a00 with x1830960573985408 ext(1802240->1806335) 00002000:00010000:1.0:1746140891.901420:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099496a00 00000100:00100000:1.0:1746140891.901439:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9027 00000100:00100000:1.0:1746140891.901448:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1984:x1830960573985408:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140891.901594:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1984:x1830960573985408:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 149us (850us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140891.901600:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9027 00002000:00100000:1.0:1746140891.901605:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a8:0x0] (1802240->1806335) req@ffff880099496a00 x1830960573985408/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.901612:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099496a00 with x1830960573985408 ext(1802240->1806335) 00002000:00010000:1.0:1746140891.901615:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099496a00 00002000:00010000:2.0:1746140891.904208:0:24958:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime: 1746140891 -> 1746140892 00002000:00010000:2.0:1746140891.904216:0:24958:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140891 -> 1746140892 00002000:00010000:2.0:1746140891.904217:0:24958:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime: 1746140891 -> 1746140892 00000100:00100000:2.0:1746140891.904237:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576155392:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140891.904266:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924bde00/0x8156357b7fdbbcb6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2520 expref: 45 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.904277:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924bde00/0x8156357b7fdbbcb6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2520 expref: 45 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.904337:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bde00, rc 0) 00000100:00100000:2.0:1746140891.904856:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1985:x1830960573985024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5925us (7382us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140891.904864:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17607 00000100:00100000:0.0:1746140891.905794:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.905956:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573985536 00000100:00100000:2.0:1746140891.905961:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573985536 00000100:00100000:2.0:1746140891.906013:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17608 00000100:00100000:2.0:1746140891.906020:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573985536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.906035:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.906048:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbcbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2527 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.906088:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576155520:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140891.906149:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.908954:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:24958:1830960576155520:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140891.908991:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbcbd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2527 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.909004:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924bc000/0x8156357b7fdbbcbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2527 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.909025:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bc000, rc 0) 00000100:00100000:2.0:1746140891.909069:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573985536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3049us (3277us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140891.909077:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17608 00000100:00100000:0.0:1746140891.909346:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.909367:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573985792 00000100:00100000:1.0:1746140891.909373:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573985792 00002000:00100000:1.0:1746140891.909406:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880099497b80 x1830960573985792/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.909414:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497b80 with x1830960573985792 ext(4194304->4886527) 00002000:00010000:1.0:1746140891.909419:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497b80 00000100:00100000:1.0:1746140891.909446:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9028 00000100:00100000:1.0:1746140891.909452:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1984:x1830960573985792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.911834:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.912864:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573985920 00000100:00100000:2.0:1746140891.912872:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573985920 00000100:00100000:2.0:1746140891.912905:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17609 00000100:00100000:2.0:1746140891.912921:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:492:x1830960573985920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140891.912939:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.912954:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a252e expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.912994:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 48 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.913003:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.913009:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.913011:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140891.913014:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->1781759] (req 1048576->1781759) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 48 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.913041:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.913053:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 37 pid: 12255 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.913068:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576155648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.913234:0:24958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 48 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.913243:0:24958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 48 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.913251:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576155776:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140891.913271:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.914639:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.915041:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573986176 00000100:00100000:2.0:1746140891.915047:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573986176 00000100:00100000:1.0:1746140891.915071:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1984:x1830960573985792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5617us (5724us total) trans 0 rc 692224/692224 00002000:00100000:2.0:1746140891.915080:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880099495f80 x1830960573986176/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140891.915081:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9028 00002000:00100000:1.0:1746140891.915088:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880099497b80 x1830960573985792/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140891.915089:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495f80 with x1830960573986176 ext(4194304->4886527) 00002000:00010000:2.0:1746140891.915094:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099495f80 00002000:00100000:1.0:1746140891.915095:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497b80 with x1830960573985792 ext(4194304->4886527) 00002000:00010000:1.0:1746140891.915099:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497b80 00000100:00100000:1.0:1746140891.915115:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9029 00000100:00100000:1.0:1746140891.915122:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+38:1984:x1830960573986176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140891.916116:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.916160:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573986304 00000100:00100000:3.0:1746140891.916164:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573986304 00010000:00010000:3.0:1746140891.916185:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 47 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.916207:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9127 00000100:00100000:3.0:1746140891.916213:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1983:x1830960573986304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.916223:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.916237:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 47 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.916250:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 47 pid: 9872 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.916270:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140891.916293:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1983:x1830960573986304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140891.916298:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9127 00000100:00100000:2.0:1746140891.916417:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576155648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.916429:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8ca00/0x8156357b7fdbbbcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2494 expref: 46 pid: 9872 timeout: 970 lvb_type: 1 00000100:00100000:2.0:1746140891.916445:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576155776:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140891.916465:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->1781759] (req 1048576->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 45 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.916475:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bcc00, rc 0) 00000100:00100000:2.0:1746140891.916494:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:492:x1830960573985920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3582us (4723us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.916507:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17609 00000100:00100000:0.0:1746140891.917027:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140891.917072:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573986432 00000100:00100000:3.0:1746140891.917076:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573986432 00010000:00010000:3.0:1746140891.917089:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 40 pid: 12255 timeout: 970 lvb_type: 1 00000100:00100000:3.0:1746140891.917106:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9128 00000100:00100000:3.0:1746140891.917110:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+40:1983:x1830960573986432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140891.917116:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140891.917123:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 40 pid: 12255 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.917131:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 40 pid: 12255 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.917142:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e79c00/0x8156357b7fdbbc3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24cc expref: 40 pid: 12255 timeout: 970 lvb_type: 1 00010000:00010000:3.0:1746140891.917154:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.917157:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140891.917163:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.917169:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.917193:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.917203:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576155904:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140891.917263:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.920271:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.920347:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573986560 00000100:00100000:2.0:1746140891.920360:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573986560 00000100:00100000:2.0:1746140891.920410:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17610 00000100:00100000:2.0:1746140891.920418:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573986560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140891.920435:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.920452:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bd600/0x8156357b7fdbbccb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2535 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140891.920501:0:24958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576156032:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140891.920595:0:24958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.920716:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576155904:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140891.920729:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140891.920753:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+39:1983:x1830960573986432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3642us (3732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140891.920761:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9128 00002000:00010000:2.0:1746140891.921940:0:24958:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140891 -> 1746140892 00000100:00100000:2.0:1746140891.921962:0:24958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:24958:1830960576156032:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140891.921994:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bd600/0x8156357b7fdbbccb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2535 expref: 46 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.922006:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bd600/0x8156357b7fdbbccb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2535 expref: 46 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140891.922029:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bd600, rc 0) 00000100:00100000:2.0:1746140891.922422:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573986560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1650us (1808us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140891.922431:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17610 00000100:00100000:1.0:1746140891.922709:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573986176:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7582us (8069us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140891.922719:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9029 00002000:00100000:1.0:1746140891.922730:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880099495f80 x1830960573986176/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:307/0 lens 488/440 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.922740:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099495f80 with x1830960573986176 ext(4194304->4886527) 00002000:00010000:1.0:1746140891.922746:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099495f80 00000100:00100000:0.0:1746140891.925384:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.925454:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573986688 00000100:00100000:0.0:1746140891.925463:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.925464:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573986688 00000100:00100000:2.0:1746140891.925515:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573986816 00000100:00100000:2.0:1746140891.925518:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573986816 00000100:00100000:1.0:1746140891.925529:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17611 00000100:00100000:1.0:1746140891.925541:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573986688:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140891.925555:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17612 00010000:00010000:1.0:1746140891.925557:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140891.925561:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1982:x1830960573986816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.925573:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f1000/0x8156357b7fdbbcd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a253c expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140891.925574:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140891.925586:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbbcd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2543 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140891.925624:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576156160:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140891.925625:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576156288:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140891.925718:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746140891.925864:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a70d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140891.926602:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.926636:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.926741:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573987200 00000100:00100000:2.0:1746140891.926747:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573987200 00000100:00100000:2.0:1746140891.926778:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4811 00000100:00100000:2.0:1746140891.926783:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:496:x1830960573987200:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140891.926846:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576156288:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140891.926869:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576156160:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140891.926872:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbbcd9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2543 expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.926883:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bd000/0x8156357b7fdbbcd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2543 expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.926886:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f1000/0x8156357b7fdbbcd2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a253c expref: 30 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.926896:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bd000, rc 0) 00010000:00010000:1.0:1746140891.926896:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f1000/0x8156357b7fdbbcd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a253c expref: 30 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.926908:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f1000, rc 0) 00000100:00100000:3.0:1746140891.926920:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1982:x1830960573986816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1360us (1456us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140891.926926:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573986688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1389us (1551us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140891.926927:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17612 00000100:00100000:1.0:1746140891.926932:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17611 00000100:00100000:2.0:1746140891.926934:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:496:x1830960573987200:12345-192.168.204.16@tcp:35:cat.0 Request processed in 151us (333us total) trans 8589945230 rc 0/0 00000100:00100000:2.0:1746140891.926941:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4811 00000100:00100000:1.0:1746140891.926950:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573987328 00000100:00100000:1.0:1746140891.926953:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573987328 00002000:00100000:1.0:1746140891.926989:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1777664->1781759) req@ffff88009abb9180 x1830960573987328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/0 e 0 to 0 dl 1746140902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.926998:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb9180 with x1830960573987328 ext(1777664->1781759) 00002000:00010000:1.0:1746140891.927001:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb9180 00000100:00100000:1.0:1746140891.927014:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9030 00000100:00100000:1.0:1746140891.927019:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1984:x1830960573987328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140891.927143:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1984:x1830960573987328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 123us (506us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140891.927149:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9030 00002000:00100000:1.0:1746140891.927154:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a2:0x0] (1777664->1781759) req@ffff88009abb9180 x1830960573987328/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746140902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140891.927161:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abb9180 with x1830960573987328 ext(1777664->1781759) 00002000:00010000:1.0:1746140891.927163:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abb9180 00000100:00100000:0.0:1746140891.929353:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.929390:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140891.929468:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140891.929526:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573987456 00000100:00100000:1.0:1746140891.929535:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573987456 00000100:00100000:3.0:1746140891.929555:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573987840 00000100:00100000:3.0:1746140891.929560:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573987840 00000100:00100000:1.0:1746140891.929573:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17613 00000100:00100000:1.0:1746140891.929578:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573987456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.929592:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140891.929593:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17614 00000100:00100000:3.0:1746140891.929600:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1982:x1830960573987840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140891.929608:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936f1a00/0x8156357b7fdbbce0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a254a expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140891.929609:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140891.929620:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x8156357b7fdbbce7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2551 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140891.929652:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576156544:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140891.929652:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576156416:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140891.929724:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.929726:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573987712 00000100:00100000:2.0:1746140891.929731:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573987712 00000100:00100000:2.0:1746140891.929755:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4812 00000100:00100000:2.0:1746140891.929760:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:492:x1830960573987712:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746140891.929942:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a70c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746140891.929945:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:492:x1830960573987712:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 184us (553us total) trans 8589945231 rc 0/0 00000100:00100000:2.0:1746140891.929950:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4812 00000100:00100000:1.0:1746140891.930938:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576156416:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140891.930960:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936f1a00/0x8156357b7fdbbce0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a254a expref: 30 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.930983:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936f1a00/0x8156357b7fdbbce0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a254a expref: 30 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140891.930993:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f1a00, rc 0) 00000100:00100000:3.0:1746140891.931004:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576156544:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140891.931026:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x8156357b7fdbbce7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2551 expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140891.931026:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1982:x1830960573987456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1447us (1680us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140891.931032:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17613 00010000:00010000:3.0:1746140891.931039:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009256e600/0x8156357b7fdbbce7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2551 expref: 38 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140891.931049:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256e600, rc 0) 00000100:00100000:3.0:1746140891.931079:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1982:x1830960573987840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1479us (1610us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140891.931086:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17614 00000100:00100000:0.0:1746140891.933657:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140891.933764:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573988096 00000100:00100000:2.0:1746140891.933776:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573988096 00000100:00100000:2.0:1746140891.933836:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4813 00000100:00100000:2.0:1746140891.933844:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+9:497:x1830960573988096:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140891.934065:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+10:497:x1830960573988096:12345-192.168.204.16@tcp:35:cat.0 Request processed in 221us (412us total) trans 8589945232 rc 0/0 00000100:00100000:2.0:1746140891.934072:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4813 00000100:00100000:0.0:1746140892.046114:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.046220:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573988352 00000100:00100000:3.0:1746140892.046238:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573988352 00000100:00100000:3.0:1746140892.046369:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10893 00000100:00100000:3.0:1746140892.046380:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:505:x1830960573988352:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140892.046405:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.046421:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbcee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2558 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746140892.046439:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746140892.046512:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046524:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046535:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046545:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046549:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046553:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046649:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046657:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046661:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140892.046669:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.046742:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046748:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046752:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046760:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256e000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.046764:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046769:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046778:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.046781:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.046784:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046789:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbcf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046815:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046819:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046823:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046827:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256ec00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.046829:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046833:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046838:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388f00) 00010000:00010000:3.0:1746140892.046840:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.046842:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046846:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbcfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.046878:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbcee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 272 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.046887:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.046893:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.046894:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140892.046896:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256f400, rc 0) 00000100:00100000:3.0:1746140892.046973:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:505:x1830960573988352:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 586us (859us total) trans 8589945233 rc 0/0 00000100:00100000:3.0:1746140892.046980:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10893 00000100:00100000:0.0:1746140892.083246:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.083340:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573988608 00000100:00100000:3.0:1746140892.083349:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573988608 00000100:00080000:2.0:1746140892.083445:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746140892.083500:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10894 00000100:00100000:3.0:1746140892.083509:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:507:x1830960573988608:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140892.083535:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.083552:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x8156357b7fdbbd11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a255f expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.083654:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083665:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083676:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083690:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083695:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083699:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083802:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083810:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083816:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140892.083825:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.083909:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083915:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083921:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083926:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256fc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.083930:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083936:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083945:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.083946:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.083949:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083952:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fc00/0x8156357b7fdbbd18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083981:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083985:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083990:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.083994:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256f800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.083996:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.084000:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.084006:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388000) 00010000:00010000:3.0:1746140892.084008:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.084010:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.084015:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x8156357b7fdbbd1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.084052:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256fe00/0x8156357b7fdbbd11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 13 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.084063:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 12 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.084068:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.084070:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140892.084072:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256e200, rc 0) 00000100:00100000:3.0:1746140892.084122:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:507:x1830960573988608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 614us (887us total) trans 8589945234 rc 0/0 00000100:00100000:3.0:1746140892.084128:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10894 00000100:00100000:0.0:1746140892.134014:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.134130:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573988736 00000100:00100000:3.0:1746140892.134139:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573988736 00000100:00100000:3.0:1746140892.134206:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10895 00000100:00100000:3.0:1746140892.134212:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+6:508:x1830960573988736:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140892.134235:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.134252:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbd34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2566 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.134338:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134350:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134359:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134374:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134378:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134383:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134491:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134496:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134501:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140892.134529:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140892.134532:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140892.134546:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134553:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134559:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134565:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134570:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134579:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256e000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.134584:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134589:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134600:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.134603:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.134607:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134611:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e000/0x8156357b7fdbbd3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134639:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134643:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134648:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134652:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256e600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.134655:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134660:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134666:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388900) 00010000:00010000:3.0:1746140892.134668:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.134671:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134675:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x8156357b7fdbbd42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.134701:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x8156357b7fdbbd34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.134711:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 7 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.134717:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.134719:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140892.134722:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ee00, rc 0) 00000100:00100000:3.0:1746140892.134772:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:508:x1830960573988736:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 560us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.134779:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10895 00000100:00080000:2.0:1746140892.134960:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746140892.137646:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.137684:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.137710:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.138477:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.138491:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573988864 00000100:00100000:0.0:1746140892.138498:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.138502:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573988864 00000100:00100000:0.0:1746140892.138524:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.138848:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573989120 00000100:00100000:3.0:1746140892.138851:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573989120 00000100:00100000:1.0:1746140892.138858:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573988992 00000100:00100000:0.0:1746140892.138862:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573989248 00000100:00100000:1.0:1746140892.138863:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573988992 00000100:00100000:3.0:1746140892.138867:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573989376 00000100:00100000:3.0:1746140892.138869:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573989376 00000100:00100000:0.0:1746140892.138869:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573989248 00000100:00100000:3.0:1746140892.138879:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573989504 00000100:00100000:3.0:1746140892.138881:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573989504 00000100:00100000:1.0:1746140892.138899:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17615 00000100:00100000:3.0:1746140892.138905:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17616 00000100:00100000:1.0:1746140892.138906:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573988864:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:3.0:1746140892.138910:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573989120:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746140892.138912:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17617 00000100:00100000:0.0:1746140892.138920:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573989376:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140892.138922:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.138922:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140892.138935:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.138937:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256fc00/0x8156357b7fdbbd57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a257b expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.138937:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a256d expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.138949:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2589 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.138955:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.138957:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.138977:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.138980:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.138988:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 12 pid: 4785 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140892.138993:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576156672:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140892.139004:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 12 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.139020:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d400, rc 0) 00000100:00100000:0.0:1746140892.139054:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+12:1984:x1830960573989376:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 134us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.139060:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17617 00000100:00100000:3.0:1746140892.139068:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.139077:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17618 00010000:00010000:1.0:1746140892.139082:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 11 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140892.139084:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573988992:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:3.0:1746140892.139088:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17619 00010000:00010000:0.0:1746140892.139092:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140892.139093:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573989504:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140892.139096:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 11 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.139100:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140892.139100:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2574 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.139104:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f0600, rc 0) 00010000:00010000:3.0:1746140892.139106:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2590 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.139111:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.139112:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.139114:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.139115:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.139116:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 13 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.139120:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 13 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.139128:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 13 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.139129:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 13 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140892.139129:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960573988864:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 223us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.139135:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17615 00010000:00010000:0.0:1746140892.139135:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4d000, rc 0) 00010000:00010000:3.0:1746140892.139136:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bd400, rc 0) 00000100:00100000:1.0:1746140892.139150:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17620 00000100:00100000:0.0:1746140892.139154:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573988992:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 71us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.139156:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+13:1984:x1830960573989504:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 63us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.139156:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573989248:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746140892.139160:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17618 00010000:00010000:1.0:1746140892.139162:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746140892.139164:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17619 00010000:00010000:1.0:1746140892.139169:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936f0000/0x8156357b7fdbbd73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2582 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.139190:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576156800:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140892.139214:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a70c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746140892.140634:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576156672:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140892.140656:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256fc00/0x8156357b7fdbbd57 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a257b expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.140669:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256fc00/0x8156357b7fdbbd57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a257b expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.140678:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256fc00, rc 0) 00000100:00100000:3.0:1746140892.140727:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573989120:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1815us (3041us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140892.140733:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17616 00000100:00100000:2.0:1746140892.142035:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8460:1830960576156800:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140892.142058:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936f0000/0x8156357b7fdbbd73 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2582 expref: 11 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.142069:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f0000/0x8156357b7fdbbd73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2582 expref: 11 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.142083:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936f0000, rc 0) 00000100:00100000:2.0:1746140892.142166:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960573989248:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3009us (3688us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140892.142173:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17620 00000100:00100000:0.0:1746140892.142908:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.142988:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573989760 00000100:00100000:2.0:1746140892.142995:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573989760 00000100:00100000:2.0:1746140892.143037:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10896 00000100:00100000:2.0:1746140892.143044:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:512:x1830960573989760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.143062:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.143076:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de800/0x8156357b7fdbbd7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2597 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.143147:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140892.143158:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:2.0:1746140892.143168:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:2.0:1746140892.143177:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:0.0:1746140892.143257:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140892.143268:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8de800/0x8156357b7fdbbd7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 274 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.143279:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 273 pid: 14785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.143283:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573989888 00010000:00010000:2.0:1746140892.143286:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00000100:00100000:0.0:1746140892.143287:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573989888 00010000:00010000:2.0:1746140892.143289:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746140892.143292:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8dea00, rc 0) 00000100:00100000:2.0:1746140892.143345:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:512:x1830960573989760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 301us (438us total) trans 8589945235 rc 0/0 00000100:00100000:2.0:1746140892.143351:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10896 00000100:00100000:0.0:1746140892.144259:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17621 00000100:00100000:0.0:1746140892.144267:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:505:x1830960573989888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746140892.144276:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140892.144288:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a259e expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.144325:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 45 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.144333:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 9 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.144339:0:8460:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 28 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.144344:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.144346:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.144349:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3317760->4157439] (req 3317760->4157439) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 45 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.144374:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 28 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.144610:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 28 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.144622:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094add880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576156928:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140892.145510:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 9 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.145519:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 9 pid: 32376 timeout: 971 lvb_type: 1 00000100:00100000:0.0:1746140892.145527:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576157056:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140892.145555:0:8460:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 45 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.145563:0:8460:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 45 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.145570:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094aded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576157184:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.145585:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b7ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.146853:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.146914:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094add880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576156928:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.146951:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576157056:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.146988:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094aded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576157184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140892.147054:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573990144 00000100:00100000:3.0:1746140892.147060:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573990144 00000100:00100000:3.0:1746140892.147106:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10897 00000100:00100000:3.0:1746140892.147112:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:508:x1830960573990144:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140892.147127:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.147142:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bd600/0x8156357b7fdbbd96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25a5 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.147220:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.147233:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 272 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.147239:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.147245:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.147255:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140892.147276:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.147284:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 8 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.147292:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576157312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140892.147380:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 11 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.147387:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 11 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.147395:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576157440:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140892.147418:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 272 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.147425:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 272 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.147432:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576157568:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140892.147447:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3fa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.147625:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140892.147750:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3317760->4157439] (req 3317760->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 45 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.147763:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e4ce00, rc 0) 00000100:00100000:0.0:1746140892.147787:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:505:x1830960573989888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3522us (4530us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.148102:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573990272 00000100:00100000:2.0:1746140892.148107:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573990272 00010000:00010000:2.0:1746140892.148132:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 10 pid: 32376 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.148155:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9129 00000100:00100000:2.0:1746140892.148160:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:1983:x1830960573990272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.148169:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.148189:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 10 pid: 32376 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.148201:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 10 pid: 32376 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.148223:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924bd400/0x8156357b7fdbbd6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2590 expref: 10 pid: 32376 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.148232:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.148248:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960573990272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.148254:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9129 00000100:00100000:0.0:1746140892.148346:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17621 00000100:00100000:0.0:1746140892.149752:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.149811:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.149914:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573990400 00000100:00100000:2.0:1746140892.149919:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573990400 00010000:00010000:2.0:1746140892.149942:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 45 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.150183:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573990528 00000100:00100000:2.0:1746140892.150187:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573990528 00010000:00010000:2.0:1746140892.150198:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 29 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.150228:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9130 00000100:00100000:3.0:1746140892.150236:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573990400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.150247:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.150262:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 45 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.150270:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 45 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.150287:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a8da00/0x8156357b7fdbbca1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a250b expref: 45 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.150327:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.150667:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573990400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 430us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.150673:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9130 00000100:00100000:3.0:1746140892.150689:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9131 00000100:00100000:3.0:1746140892.150694:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094addc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573990528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.150701:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.150708:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 29 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.150716:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 29 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.150727:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fac00/0x8156357b7fdbbca8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2512 expref: 29 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.150739:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.150742:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.150747:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 43 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.150754:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 43 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.150779:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 43 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140892.150789:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576157696:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140892.151505:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576157312:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.151516:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576157440:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.151523:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576157568:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140892.151543:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140892.151615:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3faf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.152477:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.152530:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.152558:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.152573:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.152587:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573990656 00000100:00100000:0.0:1746140892.152592:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573990656 00010000:00010000:0.0:1746140892.152614:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 9 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.152638:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573990912 00000100:00100000:0.0:1746140892.152640:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573990912 00010000:00010000:0.0:1746140892.152649:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 273 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.152659:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573990784 00000100:00100000:0.0:1746140892.152661:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573990784 00010000:00010000:0.0:1746140892.152667:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 12 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.152668:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.152681:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9132 00000100:00100000:0.0:1746140892.152687:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1985:x1830960573990656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140892.152691:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140892.152696:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140892.152700:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 9 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.152705:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140892.152708:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 9 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.152723:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x8156357b7fdbbd49 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2566 expref: 9 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.152727:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746140892.152736:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140892.152740:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140892.152747:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140892.152752:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.152816:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9133 00000100:00100000:2.0:1746140892.152823:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:1985:x1830960573990912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.152830:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.152834:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 273 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.152837:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573991424 00010000:00010000:2.0:1746140892.152841:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 273 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.152841:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573991424 00010000:00010000:2.0:1746140892.152855:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x8156357b7fdbbd03 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2558 expref: 273 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.152863:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.152866:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.152870:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00002000:00100000:1.0:1746140892.152872:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc0aa00 x1830960573991424/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746140892.152874:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746140892.152880:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0aa00 with x1830960573991424 ext(0->1048575) 00002000:00010000:1.0:1746140892.152884:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc0aa00 00000100:00100000:3.0:1746140892.152931:0:14785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573991168 00000100:00100000:3.0:1746140892.152934:0:14785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573991168 00000100:00100000:3.0:1746140892.152955:0:14785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10898 00000100:00100000:3.0:1746140892.152960:0:14785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:514:x1830960573991168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140892.152988:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.152998:0:14785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3400/0x8156357b7fdbbda4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25ac expref: -99 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.153085:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153094:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153105:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153116:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153122:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153127:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153212:0:14785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153219:0:14785:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153225:0:14785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14785 initiator: MDT0 00000004:00200000:3.0:1746140892.153232:0:14785:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.153333:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153340:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153346:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153351:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5f2400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.153355:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153362:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153368:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.153370:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.153373:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153376:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2400/0x8156357b7fdbbdab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153383:0:14785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153386:0:14785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153390:0:14785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153393:0:14785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5f3e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.153395:0:14785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153398:0:14785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153402:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f388000) 00010000:00010000:3.0:1746140892.153404:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.153405:0:14785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153409:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3e00/0x8156357b7fdbbdb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14785 initiator: MDT0 00010000:00010000:3.0:1746140892.153437:0:14785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f3400/0x8156357b7fdbbda4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 16 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.153446:0:14785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 15 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.153451:0:14785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.153452:0:14785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140892.153454:0:14785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5f2c00, rc 0) 00000100:00100000:1.0:1746140892.154060:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573991936 00000100:00100000:1.0:1746140892.154064:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573991936 00002000:00100000:1.0:1746140892.154081:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a2:0x0] (1781760->2097151) req@ffff88009fc0b800 x1830960573991936/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.154088:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0b800 with x1830960573991936 ext(1781760->2097151) 00002000:00010000:1.0:1746140892.154091:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc0b800 00000100:00100000:1.0:1746140892.154101:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573991808 00000100:00100000:1.0:1746140892.154103:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573991808 00002000:00100000:1.0:1746140892.154111:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc09880 x1830960573991808/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.154116:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc09880 with x1830960573991808 ext(1048576->2097151) 00002000:00010000:1.0:1746140892.154119:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc09880 00000100:00100000:1.0:1746140892.154126:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573992064 00000100:00100000:1.0:1746140892.154128:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573992064 00002000:00100000:1.0:1746140892.154135:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1802239) req@ffff88009b754e00 x1830960573992064/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.154140:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754e00 with x1830960573992064 ext(1048576->1802239) 00002000:00010000:1.0:1746140892.154142:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754e00 00000100:00100000:1.0:1746140892.154149:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9031 00000100:00100000:1.0:1746140892.154153:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1982:x1830960573991424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.155101:0:14785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:514:x1830960573991168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2136us (2566us total) trans 8589945236 rc 0/0 00000100:00100000:3.0:1746140892.155109:0:14785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10898 00000100:00100000:3.0:1746140892.155143:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9032 00000100:00100000:3.0:1746140892.155149:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1982:x1830960573991936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.155512:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9033 00000100:00100000:3.0:1746140892.155517:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573991808:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.155679:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9034 00000100:00100000:1.0:1746140892.155685:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573992064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140892.156726:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1985:x1830960573990656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4030us (4242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.156736:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9132 00000100:00100000:0.0:1746140892.156760:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9134 00000100:00100000:2.0:1746140892.156762:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1985:x1830960573990912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3938us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.156769:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9133 00000100:00100000:0.0:1746140892.156769:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960573990784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.156781:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140892.156791:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 14 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.156805:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 14 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.156824:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e200/0x8156357b7fdbbd26 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a255f expref: 14 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.156835:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140892.156839:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140892.156847:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140892.156853:0:8473:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140892.156881:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140892.156901:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960573990784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (4326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.156905:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9134 00010000:00010000:0.0:1746140892.156925:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140892.156931:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140892.156946:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140892.157074:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bd600/0x8156357b7fdbbd96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25a5 expref: 9 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.157090:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25a5 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.157096:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140892.157098:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140892.157101:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924bc400, rc 0) 00000100:00100000:0.0:1746140892.157117:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:508:x1830960573990144:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 10005us (10268us total) trans 8589945237 rc 0/0 00000100:00100000:0.0:1746140892.157122:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10897 00000100:00100000:1.0:1746140892.158877:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.158913:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f121c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576157696:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140892.158929:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.158973:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094addc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1984:x1830960573990528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8278us (9161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.158982:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9131 00000100:00100000:3.0:1746140892.159054:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573992448 00000100:00100000:3.0:1746140892.159063:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573992448 00002000:00100000:3.0:1746140892.159088:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3317760->3321855) req@ffff88009b756a00 x1830960573992448/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.159097:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756a00 with x1830960573992448 ext(3317760->3321855) 00002000:00010000:3.0:1746140892.159100:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756a00 00000100:00100000:3.0:1746140892.159120:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9035 00000100:00100000:3.0:1746140892.159126:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+48:1983:x1830960573992448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.160172:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+48:1983:x1830960573992448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1042us (1297us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140892.160181:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9035 00002000:00100000:3.0:1746140892.160188:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3317760->3321855) req@ffff88009b756a00 x1830960573992448/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.160197:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b756a00 with x1830960573992448 ext(3317760->3321855) 00002000:00010000:3.0:1746140892.160201:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b756a00 00000100:00100000:0.0:1746140892.164760:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.164844:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573992576 00000100:00100000:2.0:1746140892.164857:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573992576 00000100:00100000:2.0:1746140892.164922:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17622 00000100:00100000:2.0:1746140892.164933:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+28:1985:x1830960573992576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.164952:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.164979:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008b8df800/0x8156357b7fdbbdce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25b3 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.165041:0:8460:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576157824:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140892.166126:0:8460:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.166196:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.166339:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.166341:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573992704 00000100:00100000:2.0:1746140892.166346:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573992704 00000100:00100000:0.0:1746140892.166567:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.166762:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1982:x1830960573991424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12605us (14092us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.166776:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9031 00002000:00100000:1.0:1746140892.166785:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff88009fc0aa00 x1830960573991424/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.166796:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0aa00 with x1830960573991424 ext(0->1048575) 00002000:00010000:1.0:1746140892.166801:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc0aa00 00000100:00100000:0.0:1746140892.167088:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573992832 00000100:00100000:0.0:1746140892.167095:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573992832 00000100:00100000:1.0:1746140892.167096:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573992960 00000100:00100000:1.0:1746140892.167101:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573992960 00000100:00100000:1.0:1746140892.167125:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17623 00000100:00100000:1.0:1746140892.167131:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573992704:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140892.167137:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17624 00000100:00100000:0.0:1746140892.167144:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+31:507:x1830960573992960:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140892.167145:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.167157:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009454e400/0x8156357b7fdbbdd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25ba expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.167161:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140892.167176:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25c8 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.167193:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576157952:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140892.167202:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 47 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.167210:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140892.167211:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140892.167216:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3346432->4100095] (req 3346432->4100095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.167231:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a70600 going to sleep for 11 seconds 00010000:00010000:0.0:1746140892.167241:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 47 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.167245:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17625 00000100:00100000:1.0:1746140892.167251:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1985:x1830960573992832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140892.167253:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 47 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.167259:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140892.167264:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576158080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.167268:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009454ea00/0x8156357b7fdbbde3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25c1 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.167290:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576158208:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140892.167321:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b7ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.167328:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a70c00 going to sleep for 11 seconds 00000100:00080000:2.0:1746140892.167418:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746140892.167504:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1982:x1830960573991936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12354us (14811us total) trans 0 rc 315392/315392 00000100:00100000:3.0:1746140892.167511:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9032 00002000:00100000:3.0:1746140892.167517:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1781760->2097151) req@ffff88009fc0b800 x1830960573991936/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 315392/315392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.167523:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc0b800 with x1830960573991936 ext(1781760->2097151) 00002000:00010000:3.0:1746140892.167526:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc0b800 00000100:00100000:1.0:1746140892.176785:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1983:x1830960573992064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21088us (24045us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746140892.176797:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9034 00002000:00100000:1.0:1746140892.176810:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->1802239) req@ffff88009b754e00 x1830960573992064/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.176819:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b754e00 with x1830960573992064 ext(1048576->1802239) 00002000:00010000:1.0:1746140892.176824:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b754e00 00000100:00100000:1.0:1746140892.177714:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576157952:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140892.177747:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009454e400/0x8156357b7fdbbdd5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ba expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.177763:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009454e400/0x8156357b7fdbbdd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ba expref: 38 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.177780:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009454e400, rc 0) 00000100:00100000:1.0:1746140892.177815:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573992704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 10683us (11622us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140892.177821:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17623 00002000:00010000:1.0:1746140892.177851:0:8458:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140889 -> 1746140892 00000100:00100000:1.0:1746140892.177863:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576158208:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140892.177882:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009454ea00/0x8156357b7fdbbde3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c1 expref: 33 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.177893:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009454ea00/0x8156357b7fdbbde3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c1 expref: 33 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.177901:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009454ea00, rc 0) 00000100:00100000:1.0:1746140892.177924:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1985:x1830960573992832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 10671us (11584us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140892.177930:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17625 00000100:00100000:0.0:1746140892.178068:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576158080:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.178087:0:8460:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8460:1830960576157824:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140892.178087:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3346432->4100095] (req 3346432->4100095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 31 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.178100:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ee00, rc 0) 00010000:00010000:2.0:1746140892.178103:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008b8df800/0x8156357b7fdbbdce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25b3 expref: 31 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.178112:0:8460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b8df800/0x8156357b7fdbbdce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25b3 expref: 31 pid: 8460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746140892.178117:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+31:507:x1830960573992960:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10974us (11550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.178122:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17624 00010000:00010000:2.0:1746140892.178664:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008b8df800, rc 0) 00000100:00100000:2.0:1746140892.179393:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1985:x1830960573992576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 14460us (14643us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140892.179399:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17622 00000100:00100000:3.0:1746140892.181568:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1983:x1830960573991808:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26044us (28855us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.181578:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9033 00002000:00100000:3.0:1746140892.181588:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009fc09880 x1830960573991808/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.181597:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc09880 with x1830960573991808 ext(1048576->2097151) 00002000:00010000:3.0:1746140892.181603:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc09880 00000100:00100000:0.0:1746140892.182813:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.183102:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573993216 00000100:00100000:1.0:1746140892.183111:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573993216 00000100:00100000:1.0:1746140892.183167:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10899 00000100:00100000:1.0:1746140892.183177:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:508:x1830960573993216:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140892.183199:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.183202:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746140892.183228:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924bc400/0x8156357b7fdbbd9d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25a5 expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.183244:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140892.183248:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140892.183260:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f200/0x8156357b7fdbbdea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25cf expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.183902:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183912:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183924:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183934:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183940:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183945:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183950:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009454f400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140892.183954:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183959:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183973:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140892.183975:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140892.183977:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.183982:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f400/0x8156357b7fdbbdf1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.184002:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f200/0x8156357b7fdbbdea lrc: 1/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25cf expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.184008:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009454f200/0x8156357b7fdbbdea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25cf expref: 8 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.184017:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009454f200, rc 0) 00000100:00100000:1.0:1746140892.184050:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:508:x1830960573993216:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 877us (1242us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140892.184056:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10899 00000100:00100000:1.0:1746140892.186713:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.186738:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.186958:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.186989:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573993472 00000100:00100000:1.0:1746140892.186996:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573993472 00002000:00100000:1.0:1746140892.187033:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (4153344->4157439) req@ffff8800948faa00 x1830960573993472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.187041:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948faa00 with x1830960573993472 ext(4153344->4157439) 00010000:00010000:1.0:1746140892.187049:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 44 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.187062:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 44 pid: 8460 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.187069:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948faa00 00000100:00100000:1.0:1746140892.187084:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573993984 00000100:00100000:1.0:1746140892.187086:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573993984 00002000:00100000:1.0:1746140892.187099:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8800948fb800 x1830960573993984/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.187105:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fb800 with x1830960573993984 ext(0->1048575) 00002000:00010000:1.0:1746140892.187108:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948fb800 00000100:00100000:1.0:1746140892.187119:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1879 00000100:00100000:1.0:1746140892.187126:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573993472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.187266:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1982:x1830960573993472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 141us (561us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.187273:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1879 00002000:00100000:1.0:1746140892.187278:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (4153344->4157439) req@ffff8800948faa00 x1830960573993472/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.187284:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948faa00 with x1830960573993472 ext(4153344->4157439) 00010000:00010000:1.0:1746140892.187288:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 44 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.187296:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 44 pid: 8460 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.187322:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948faa00 00000100:00100000:1.0:1746140892.187334:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9036 00000100:00100000:1.0:1746140892.187339:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573993984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140892.188996:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.189467:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573993728 00000100:00100000:2.0:1746140892.189476:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573993728 00000100:00100000:2.0:1746140892.189509:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4814 00000100:00100000:2.0:1746140892.189515:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:508:x1830960573993728:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746140892.189579:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573994240 00000100:00100000:1.0:1746140892.189584:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573994240 00002000:00100000:1.0:1746140892.189605:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f7ab800 x1830960573994240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.189613:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ab800 with x1830960573994240 ext(1048576->2097151) 00002000:00010000:1.0:1746140892.189617:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7ab800 00000100:00100000:1.0:1746140892.189631:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9037 00000100:00100000:1.0:1746140892.189636:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573994240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140892.189723:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:508:x1830960573993728:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 207us (2983us total) trans 8589945238 rc 0/0 00000100:00100000:2.0:1746140892.189729:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4814 00000100:00100000:0.0:1746140892.191941:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.191971:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573994496 00000100:00100000:1.0:1746140892.191981:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573994496 00000100:00100000:0.0:1746140892.191994:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746140892.192011:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3317760->4157439) req@ffff88009f7a8e00 x1830960573994496/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.192019:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a8e00 with x1830960573994496 ext(3317760->4157439) 00010000:00010000:1.0:1746140892.192027:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 44 pid: 8460 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.192661:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573994752 00000100:00100000:2.0:1746140892.192667:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573994752 00000100:00100000:2.0:1746140892.192699:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4815 00000100:00100000:2.0:1746140892.192706:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:505:x1830960573994752:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140892.192857:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:505:x1830960573994752:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 151us (862us total) trans 8589945239 rc 0/0 00000100:00100000:2.0:1746140892.192863:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4815 00010000:00010000:1.0:1746140892.194593:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 44 pid: 8460 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.194603:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7a8e00 00000100:00100000:1.0:1746140892.194626:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1880 00000100:00100000:1.0:1746140892.194636:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+44:1984:x1830960573994496:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746140892.194667:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.196692:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573995008 00000100:00100000:1.0:1746140892.196701:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573995008 00002000:00100000:1.0:1746140892.196735:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009abdca80 x1830960573995008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.196743:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdca80 with x1830960573995008 ext(2097152->3145727) 00002000:00010000:1.0:1746140892.196749:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdca80 00000100:00100000:1.0:1746140892.196787:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9038 00000100:00100000:1.0:1746140892.196794:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573995008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.202557:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+29:1984:x1830960573994240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12912us (13562us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.202570:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9037 00002000:00100000:1.0:1746140892.202580:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a7:0x0] (1048576->2097151) req@ffff88009f7ab800 x1830960573994240/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.202588:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ab800 with x1830960573994240 ext(1048576->2097151) 00002000:00010000:1.0:1746140892.202592:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7ab800 00000100:00100000:1.0:1746140892.205341:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1983:x1830960573995008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8539us (10666us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.205351:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9038 00002000:00100000:1.0:1746140892.205361:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009abdca80 x1830960573995008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.205369:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdca80 with x1830960573995008 ext(2097152->3145727) 00002000:00010000:1.0:1746140892.205373:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abdca80 00000100:00100000:3.0:1746140892.206615:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+37:1984:x1830960573993984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19272us (19654us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.206627:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9036 00002000:00100000:3.0:1746140892.206634:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a0:0x0] (0->1048575) req@ffff8800948fb800 x1830960573993984/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.206641:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fb800 with x1830960573993984 ext(0->1048575) 00002000:00010000:3.0:1746140892.206645:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948fb800 00000100:00100000:1.0:1746140892.216766:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1984:x1830960573994496:12345-192.168.204.16@tcp:4:cat.0 Request processed in 22125us (24824us total) trans 17179874265 rc 0/0 00000100:00100000:1.0:1746140892.216777:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1880 00002000:00100000:1.0:1746140892.216789:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3317760->4157439) req@ffff88009f7a8e00 x1830960573994496/t17179874265(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.216797:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a8e00 with x1830960573994496 ext(3317760->4157439) 00010000:00010000:1.0:1746140892.216807:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 46 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.216824:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 46 pid: 8460 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.216836:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7a8e00 00000100:00100000:0.0:1746140892.219253:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.220290:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.220337:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573995136 00000100:00100000:0.0:1746140892.220346:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573995136 00000100:00100000:0.0:1746140892.220385:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573995392 00000100:00100000:0.0:1746140892.220387:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573995392 00000100:00100000:2.0:1746140892.220410:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17626 00000100:00100000:2.0:1746140892.220424:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:512:x1830960573995136:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140892.220425:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17627 00000100:00100000:0.0:1746140892.220431:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+29:514:x1830960573995392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.220441:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140892.220444:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140892.220459:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25dd expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.220460:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25d6 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.220487:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 47 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.220489:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.220491:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140892.220494:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.220495:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 47 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.220495:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140892.220498:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 30 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.220505:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 47 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.220514:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee3c400, rc 0) 00010000:00010000:0.0:1746140892.220525:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 47 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.220536:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 47 pid: 24958 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.220548:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576158336:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.220565:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:512:x1830960573995136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 145us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.220571:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17626 00000100:00100000:0.0:1746140892.220608:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.220643:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.220718:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573995264 00000100:00100000:0.0:1746140892.220722:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573995264 00010000:00010000:0.0:1746140892.220737:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 47 pid: 8460 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.220754:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9135 00000100:00100000:0.0:1746140892.220759:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1982:x1830960573995264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.220767:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140892.220790:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 47 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.220800:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 47 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.220815:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4ce00/0x8156357b7fdbbd8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3317760->4157439) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a259e expref: 47 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.220825:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.220827:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.220832:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 30 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.220839:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 30 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.220893:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.220895:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.220900:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 46 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.220907:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 46 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.220927:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 46 pid: 8460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.220935:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576158464:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140892.220975:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 30 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.220984:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576158592:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140892.221000:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.223373:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576158336:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140892.223710:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 30 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.223726:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092664200, rc 0) 00000100:00100000:0.0:1746140892.223764:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+30:514:x1830960573995392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3332us (3475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.223772:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17627 00000100:00100000:0.0:1746140892.225540:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576158464:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140892.225652:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.225665:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.225687:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.225703:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573995520 00000100:00100000:1.0:1746140892.225709:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573995520 00002000:00100000:1.0:1746140892.225743:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1802240->2097151) req@ffff8800948fbb80 x1830960573995520/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.225752:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fbb80 with x1830960573995520 ext(1802240->2097151) 00010000:00010000:1.0:1746140892.225759:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 47 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.225771:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 47 pid: 24958 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.225777:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948fbb80 00000100:00100000:1.0:1746140892.225789:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573995776 00000100:00100000:1.0:1746140892.225791:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573995776 00002000:00100000:1.0:1746140892.225798:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (3346432->3350527) req@ffff8800948fad80 x1830960573995776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.225804:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fad80 with x1830960573995776 ext(3346432->3350527) 00002000:00010000:1.0:1746140892.225806:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948fad80 00000100:00100000:1.0:1746140892.225812:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573996032 00000100:00100000:1.0:1746140892.225814:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573996032 00002000:00100000:1.0:1746140892.225820:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8800948f9880 x1830960573996032/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.225826:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948f9880 with x1830960573996032 ext(2097152->3145727) 00002000:00010000:1.0:1746140892.225828:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948f9880 00000100:00100000:1.0:1746140892.225837:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1881 00000100:00100000:1.0:1746140892.225843:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+48:1985:x1830960573995520:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140892.226107:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9039 00000100:00100000:1.0:1746140892.226113:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573995776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.226214:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573995776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 100us (546us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.226220:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9039 00002000:00100000:1.0:1746140892.226224:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3346432->3350527) req@ffff8800948fad80 x1830960573995776/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.226231:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fad80 with x1830960573995776 ext(3346432->3350527) 00002000:00010000:1.0:1746140892.226233:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948fad80 00000100:00100000:1.0:1746140892.226245:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9040 00000100:00100000:1.0:1746140892.226249:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+49:1982:x1830960573996032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.226347:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576158592:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140892.226364:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140892.226386:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+49:1982:x1830960573995264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5627us (5743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.226392:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9135 00000100:00100000:1.0:1746140892.233885:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.233908:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573996288 00000100:00100000:1.0:1746140892.233916:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573996288 00002000:00100000:1.0:1746140892.233951:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (4096000->4100095) req@ffff8800948fb100 x1830960573996288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.233970:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fb100 with x1830960573996288 ext(4096000->4100095) 00002000:00010000:1.0:1746140892.233975:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948fb100 00000100:00100000:1.0:1746140892.233996:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9041 00000100:00100000:1.0:1746140892.234002:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573996288:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.234108:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1985:x1830960573996288:12345-192.168.204.16@tcp:3:cat.0 Request processed in 105us (230us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.234113:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9041 00002000:00100000:1.0:1746140892.234118:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (4096000->4100095) req@ffff8800948fb100 x1830960573996288/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.234124:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fb100 with x1830960573996288 ext(4096000->4100095) 00002000:00010000:1.0:1746140892.234126:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948fb100 00000100:00100000:2.0:1746140892.240738:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+50:1985:x1830960573995520:12345-192.168.204.16@tcp:4:cat.0 Request processed in 14886us (15082us total) trans 17179874266 rc 0/0 00000100:00100000:2.0:1746140892.240858:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1881 00002000:00100000:2.0:1746140892.240872:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3a8:0x0] (1802240->2097151) req@ffff8800948fbb80 x1830960573995520/t17179874266(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.240881:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948fbb80 with x1830960573995520 ext(1802240->2097151) 00010000:00010000:2.0:1746140892.240890:0:8463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 50 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.240903:0:8463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 50 pid: 24958 timeout: 971 lvb_type: 0 00002000:00010000:2.0:1746140892.240909:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948fbb80 00000100:00100000:2.0:1746140892.241056:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.241073:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573996544 00000100:00100000:2.0:1746140892.241079:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573996544 00000100:00100000:2.0:1746140892.241108:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4816 00000100:00100000:2.0:1746140892.241113:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:507:x1830960573996544:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140892.241223:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:507:x1830960573996544:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 110us (168us total) trans 8589945240 rc 0/0 00000100:00100000:2.0:1746140892.241227:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4816 00000100:00100000:2.0:1746140892.241617:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+48:1982:x1830960573996032:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15367us (15928us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140892.241623:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9040 00002000:00100000:2.0:1746140892.241628:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff8800948f9880 x1830960573996032/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.241641:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948f9880 with x1830960573996032 ext(2097152->3145727) 00002000:00010000:2.0:1746140892.241644:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948f9880 00000100:00100000:1.0:1746140892.244190:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.244689:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573996672 00000100:00100000:0.0:1746140892.244698:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573996672 00010000:00010000:0.0:1746140892.244731:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 48 pid: 24958 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.244756:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9136 00000100:00100000:0.0:1746140892.244764:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+48:1984:x1830960573996672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.244775:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746140892.244789:0:7110:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:0.0:1746140892.244794:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 48 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.244803:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 48 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.244821:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256e400/0x8156357b7fdbbcaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2519 expref: 48 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.244837:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.244839:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.244846:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 29 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.244853:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 29 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.244881:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 29 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.244891:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576158720:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140892.244952:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.251037:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.251063:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573996800 00000100:00100000:2.0:1746140892.251070:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573996800 00000100:00100000:1.0:1746140892.251082:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576158720:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140892.251101:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.251103:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17628 00000100:00100000:2.0:1746140892.251110:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+48:512:x1830960573996800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.251125:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.251139:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25e4 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.251164:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 29 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.251171:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.251173:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.251176:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 49 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.251179:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+49:1984:x1830960573996672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6415us (6993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.251187:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9136 00010000:00010000:2.0:1746140892.251197:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 29 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.251207:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 29 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.251216:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576158848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.251250:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0f0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.252209:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.252238:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573997056 00000100:00100000:0.0:1746140892.252247:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573997056 00002000:00100000:0.0:1746140892.252292:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009abdd180 x1830960573997056/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140892.252321:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdd180 with x1830960573997056 ext(1048576->2097151) 00002000:00010000:0.0:1746140892.252328:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdd180 00000100:00100000:0.0:1746140892.252348:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9042 00000100:00100000:0.0:1746140892.252356:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+30:1984:x1830960573997056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.252538:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576158848:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140892.252555:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 48 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.252567:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135257c00, rc 0) 00000100:00100000:3.0:1746140892.252589:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+48:512:x1830960573996800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1479us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.252596:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17628 00000100:00100000:0.0:1746140892.254388:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.254411:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573997184 00000100:00100000:0.0:1746140892.254417:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573997184 00002000:00100000:0.0:1746140892.254451:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3346432->4100095) req@ffff88009f7aad80 x1830960573997184/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140892.254461:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aad80 with x1830960573997184 ext(3346432->4100095) 00010000:00010000:0.0:1746140892.254469:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.254483:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 971 lvb_type: 0 00002000:00010000:0.0:1746140892.254490:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7aad80 00000100:00100000:0.0:1746140892.254506:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1882 00000100:00100000:0.0:1746140892.254513:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1983:x1830960573997184:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140892.266097:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1984:x1830960573997056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13736us (13883us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.266109:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9042 00002000:00100000:1.0:1746140892.266122:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88009abdd180 x1830960573997056/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.266131:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abdd180 with x1830960573997056 ext(1048576->2097151) 00002000:00010000:1.0:1746140892.266136:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abdd180 00000100:00100000:0.0:1746140892.267422:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1983:x1830960573997184:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12900us (13032us total) trans 17179874267 rc 0/0 00000100:00100000:0.0:1746140892.267434:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1882 00002000:00100000:0.0:1746140892.267445:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3346432->4100095) req@ffff88009f7aad80 x1830960573997184/t17179874267(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140892.267455:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aad80 with x1830960573997184 ext(3346432->4100095) 00010000:00010000:0.0:1746140892.267464:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.267480:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 971 lvb_type: 0 00002000:00010000:0.0:1746140892.267487:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7aad80 00000100:00100000:1.0:1746140892.270958:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.270998:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573997312 00000100:00100000:2.0:1746140892.271008:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573997312 00000100:00100000:2.0:1746140892.271050:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17629 00000100:00100000:2.0:1746140892.271057:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+37:514:x1830960573997312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.271074:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.271089:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25eb expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.271116:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.271123:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.271125:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.271128:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 38 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.271156:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 44 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.271167:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 44 pid: 24958 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.271178:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576158976:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.271237:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.272794:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.272822:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573997440 00000100:00100000:0.0:1746140892.272831:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573997440 00000100:00100000:2.0:1746140892.272862:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576158976:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.272885:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 38 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.272900:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a3200, rc 0) 00000100:00100000:2.0:1746140892.272929:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+38:514:x1830960573997312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1872us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.272937:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17629 00010000:00010000:0.0:1746140892.273192:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.273218:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9137 00000100:00100000:0.0:1746140892.273225:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+32:1982:x1830960573997440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.273241:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140892.273262:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.273273:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.273294:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x8156357b7fdbbddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3346432->4100095) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25c8 expref: 32 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.273378:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.273380:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.273386:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 47 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.273395:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 47 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.273425:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 47 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.273436:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576159104:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140892.273509:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.273566:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.273641:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573997568 00000100:00100000:0.0:1746140892.273644:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573997568 00002000:00100000:0.0:1746140892.273669:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1781759) req@ffff88009f7ab100 x1830960573997568/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140892.273678:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ab100 with x1830960573997568 ext(1048576->1781759) 00010000:00010000:0.0:1746140892.273684:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 45 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.273694:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 45 pid: 24958 timeout: 971 lvb_type: 0 00002000:00010000:0.0:1746140892.273704:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7ab100 00000100:00100000:0.0:1746140892.273720:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1883 00000100:00100000:0.0:1746140892.273725:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+45:1985:x1830960573997568:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140892.274333:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576159104:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140892.274347:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140892.274373:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+31:1982:x1830960573997440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1149us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.274383:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9137 00000001:00080000:2.0:1746140892.277023:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874259 is committed 00000001:00080000:2.0:1746140892.277041:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874245 is committed 00000001:00080000:2.0:1746140892.277074:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874187 is committed 00000001:00080000:2.0:1746140892.277118:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874145 is committed 00000001:00080000:2.0:1746140892.277144:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874244 is committed 00000001:00080000:2.0:1746140892.277203:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874263 is committed 00000001:00080000:2.0:1746140892.277268:0:2291:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874264 is committed 00000100:00100000:0.0:1746140892.277574:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.277662:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573997824 00000100:00100000:1.0:1746140892.277671:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573997824 00002000:00100000:1.0:1746140892.277705:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f7aa680 x1830960573997824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.277715:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aa680 with x1830960573997824 ext(3145728->4194303) 00002000:00010000:1.0:1746140892.277720:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7aa680 00000100:00100000:1.0:1746140892.277757:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9043 00000100:00100000:1.0:1746140892.277763:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573997824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140892.283882:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1985:x1830960573997568:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10133us (10292us total) trans 21474841569 rc 0/0 00000100:00100000:0.0:1746140892.283894:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1883 00002000:00100000:0.0:1746140892.283905:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->1781759) req@ffff88009f7ab100 x1830960573997568/t21474841569(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140892.283914:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ab100 with x1830960573997568 ext(1048576->1781759) 00010000:00010000:0.0:1746140892.283924:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 47 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.283937:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 47 pid: 24958 timeout: 971 lvb_type: 0 00002000:00010000:0.0:1746140892.283944:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7ab100 00000100:00100000:3.0:1746140892.284169:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1985:x1830960573997824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6404us (6599us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.284176:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9043 00002000:00100000:3.0:1746140892.284183:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009f7aa680 x1830960573997824/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.284190:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7aa680 with x1830960573997824 ext(3145728->4194303) 00002000:00010000:3.0:1746140892.284193:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7aa680 00000100:00100000:1.0:1746140892.288658:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.288738:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573997952 00000100:00100000:0.0:1746140892.288747:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573997952 00010000:00010000:0.0:1746140892.288775:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 47 pid: 24958 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.288876:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9138 00000100:00100000:1.0:1746140892.288915:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.288976:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573998080 00000100:00100000:2.0:1746140892.288981:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573998080 00000100:00100000:1.0:1746140892.288982:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.289003:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573998208 00000100:00100000:2.0:1746140892.289005:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573998208 00000100:00100000:2.0:1746140892.289018:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17630 00000100:00100000:2.0:1746140892.289024:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+24:1984:x1830960573998080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.289037:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.289052:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25f2 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.289072:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.289074:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.289082:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 25 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.289096:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 25 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.289107:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a3000, rc 0) 00000100:00100000:0.0:1746140892.289109:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17631 00000100:00100000:0.0:1746140892.289117:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+48:1984:x1830960573998208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746140892.289124:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140892.289132:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ecd8a00/0x8156357b7fdbbe1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a25f9 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.289155:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960573998080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.289160:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17630 00000100:00100000:0.0:1746140892.289169:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576159232:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140892.289210:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.289224:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+49:1984:x1830960573997952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.289233:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140892.289251:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 49 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.289262:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 49 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.289277:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.289278:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.289283:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 37 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.289291:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 37 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.289329:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 37 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.289338:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576159360:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140892.289384:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131059000 going to sleep for 11 seconds 00010000:00010000:0.0:1746140892.293845:0:9872:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff88009f7aaa00 x1830960576159232) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 49 pid: 24958 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.293890:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bcc00/0x8156357b7fdbbcc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a252e expref: 49 pid: 24958 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.293899:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576159232:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140892.293922:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ecd8a00/0x8156357b7fdbbe1b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f9 expref: 48 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.293930:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ecd8a00/0x8156357b7fdbbe1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f9 expref: 48 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.293934:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ecd8a00, rc 0) 00000100:00100000:0.0:1746140892.293999:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+47:1984:x1830960573998208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4883us (5017us total) trans 0 rc 301/301 00000100:00100000:0.0:1746140892.294005:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17631 00000100:00100000:0.0:1746140892.294033:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7110:1830960576159360:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746140892.294039:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140892.294050:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+46:1984:x1830960573997952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5168us (5400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.294055:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9138 00000001:00080000:0.0:1746140892.294393:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841563 is committed 00000001:00080000:0.0:1746140892.294404:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841548 is committed 00000001:00080000:0.0:1746140892.294437:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841476 is committed 00000001:00080000:0.0:1746140892.294485:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841428 is committed 00000001:00080000:0.0:1746140892.294492:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841568 is committed 00000001:00080000:0.0:1746140892.294512:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841540 is committed 00000001:00080000:0.0:1746140892.294560:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841549 is committed 00000001:00080000:0.0:1746140892.294618:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841429 is committed 00000001:00080000:0.0:1746140892.294632:0:609:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841550 is committed 00000100:00100000:0.0:1746140892.296086:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.296122:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.296208:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573998592 00000100:00100000:3.0:1746140892.296216:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573998592 00000100:00100000:1.0:1746140892.296226:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573998464 00000100:00100000:1.0:1746140892.296229:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573998464 00002000:00100000:3.0:1746140892.296251:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f7a9f80 x1830960573998592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140892.296260:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17632 00002000:00100000:3.0:1746140892.296266:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a9f80 with x1830960573998592 ext(1048576->2097151) 00000100:00100000:1.0:1746140892.296266:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+14:1982:x1830960573998464:12345-192.168.204.16@tcp:101:cat.0 00002000:00010000:3.0:1746140892.296271:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7a9f80 00010000:00010000:1.0:1746140892.296277:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.296288:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2600 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140892.296293:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9044 00000100:00100000:3.0:1746140892.296299:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573998592:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746140892.296321:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.296323:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.296329:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 15 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.296342:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 15 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.296350:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a8b800, rc 0) 00000100:00100000:1.0:1746140892.296462:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1982:x1830960573998464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 107us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.296468:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17632 00000100:00100000:3.0:1746140892.301893:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960573998592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5584us (5801us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.301906:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9044 00002000:00100000:3.0:1746140892.301917:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88009f7a9f80 x1830960573998592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.301926:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7a9f80 with x1830960573998592 ext(1048576->2097151) 00002000:00010000:3.0:1746140892.301932:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7a9f80 00000100:00100000:0.0:1746140892.312157:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.312224:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573998720 00000100:00100000:1.0:1746140892.312234:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573998720 00000100:00100000:1.0:1746140892.312297:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17633 00000100:00100000:1.0:1746140892.312335:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:514:x1830960573998720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140892.312353:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.312401:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2607 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.312426:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.312428:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.312436:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 10 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.312454:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 10 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.312463:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5260800, rc 0) 00000100:00100000:1.0:1746140892.312507:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+10:514:x1830960573998720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 203us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.312513:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17633 00000100:00100000:0.0:1746140892.324896:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.324937:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.324954:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573999104 00000100:00100000:3.0:1746140892.324975:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573999104 00000100:00100000:1.0:1746140892.324995:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573998976 00000100:00100000:1.0:1746140892.325000:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573998976 00002000:00100000:3.0:1746140892.325013:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009eea9880 x1830960573999104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.325018:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009eeab100 x1830960573998976/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.325023:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eea9880 with x1830960573999104 ext(3145728->4194303) 00002000:00100000:1.0:1746140892.325026:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eeab100 with x1830960573998976 ext(2097152->3145727) 00002000:00010000:3.0:1746140892.325028:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eea9880 00002000:00010000:1.0:1746140892.325029:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eeab100 00000100:00100000:3.0:1746140892.325059:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9045 00000100:00100000:3.0:1746140892.325067:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573999104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.325070:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9046 00000100:00100000:1.0:1746140892.325076:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960573998976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.335006:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960573999104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9930us (10107us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.335018:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9045 00002000:00100000:3.0:1746140892.335029:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009eea9880 x1830960573999104/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.335038:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eea9880 with x1830960573999104 ext(3145728->4194303) 00002000:00010000:3.0:1746140892.335043:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eea9880 00000100:00100000:1.0:1746140892.337844:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1983:x1830960573998976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12759us (12898us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.337855:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9046 00002000:00100000:1.0:1746140892.337865:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009eeab100 x1830960573998976/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.337874:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eeab100 with x1830960573998976 ext(2097152->3145727) 00002000:00010000:1.0:1746140892.337879:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eeab100 00000100:00100000:0.0:1746140892.348036:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.348134:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573999488 00000100:00100000:2.0:1746140892.348147:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573999488 00000100:00100000:2.0:1746140892.348208:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4817 00000100:00100000:2.0:1746140892.348214:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:514:x1830960573999488:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140892.348464:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+15:514:x1830960573999488:12345-192.168.204.16@tcp:35:cat.0 Request processed in 249us (437us total) trans 8589945241 rc 0/0 00000100:00100000:2.0:1746140892.348471:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4817 00000100:00100000:0.0:1746140892.362117:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.362197:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960573999744 00000100:00100000:1.0:1746140892.362209:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960573999744 00000100:00100000:1.0:1746140892.362293:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10900 00000100:00100000:1.0:1746140892.362358:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+15:521:x1830960573999744:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140892.362387:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.362408:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260a00/0x8156357b7fdbbe30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a260e expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.362617:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.362633:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.362644:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.362657:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.362663:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.362668:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.362924:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.362934:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.362940:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:1.0:1746140892.362955:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140892.363053:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363060:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363065:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363071:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5260600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140892.363075:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363081:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363091:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140892.363093:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140892.363097:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363102:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260600/0x8156357b7fdbbe37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363130:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363135:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363140:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363145:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5261e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140892.363147:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363150:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363154:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f600) 00010000:00010000:1.0:1746140892.363155:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140892.363156:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363159:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5261e00/0x8156357b7fdbbe3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.363189:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5260a00/0x8156357b7fdbbe30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 18 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.363197:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 17 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.363202:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140892.363203:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140892.363205:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134952c00, rc 0) 00000100:00100000:1.0:1746140892.363258:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:521:x1830960573999744:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 958us (1156us total) trans 8589945242 rc 0/0 00000100:00100000:1.0:1746140892.363262:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10900 00000100:00100000:0.0:1746140892.419288:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.419429:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574000000 00000100:00100000:1.0:1746140892.419439:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574000000 00000100:00100000:1.0:1746140892.419507:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10901 00000100:00100000:1.0:1746140892.419515:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+273:526:x1830960574000000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140892.419539:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.419557:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134953a00/0x8156357b7fdbbe53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2615 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.419666:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.419678:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.419688:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.419700:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.419705:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.419711:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.419820:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.419829:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.419835:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:1.0:1746140892.419845:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140892.420720:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.420728:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.420913:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.420919:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134952800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140892.420923:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.420929:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.420939:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:1.0:1746140892.420942:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140892.420945:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.420950:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134952800/0x8156357b7fdbbe5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.421000:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.421005:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.421010:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.421014:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134952600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:1.0:1746140892.421016:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.421021:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.421027:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf7f600) 00010000:00010000:1.0:1746140892.421028:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746140892.421030:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.421034:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134952600/0x8156357b7fdbbe61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.421071:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134953a00/0x8156357b7fdbbe53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 276 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.421082:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 275 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.421088:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140892.421090:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140892.421092:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134952e00, rc 0) 00000100:00100000:1.0:1746140892.421146:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:526:x1830960574000000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1631us (1868us total) trans 8589945243 rc 0/0 00000100:00100000:1.0:1746140892.421152:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10901 00000100:00100000:0.0:1746140892.423407:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.423512:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574000256 00000100:00100000:2.0:1746140892.423521:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574000256 00000100:00100000:2.0:1746140892.423574:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4818 00000100:00100000:2.0:1746140892.423581:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+275:526:x1830960574000256:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140892.423834:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:526:x1830960574000256:12345-192.168.204.16@tcp:35:cat.0 Request processed in 252us (433us total) trans 8589945244 rc 0/0 00000100:00100000:2.0:1746140892.423840:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4818 00000100:00100000:0.0:1746140892.426493:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.426635:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574000512 00000100:00100000:1.0:1746140892.426644:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574000512 00000100:00100000:1.0:1746140892.426691:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10902 00000100:00100000:1.0:1746140892.426698:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+276:523:x1830960574000512:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140892.426720:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.426737:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134953600/0x8156357b7fdbbe76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a261c expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.426822:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.426834:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 16 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.426838:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 277 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.426842:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.426866:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 277 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.426876:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 277 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.426886:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576159488:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.427236:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 16 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.427245:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 16 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.427253:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b755180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576159616:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.427450:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4780 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.428291:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.428391:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576159488:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.428399:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b755180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576159616:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.428418:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:2.0:1746140892.428567:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574000640 00000100:00100000:2.0:1746140892.428572:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574000640 00010000:00010000:2.0:1746140892.428593:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 278 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.428612:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9139 00000100:00100000:2.0:1746140892.428617:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+278:1985:x1830960574000640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.428632:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.428636:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 278 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.428644:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 278 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.428660:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134952e00/0x8156357b7fdbbe68 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2615 expref: 278 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.428675:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.428678:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.428684:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.428688:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.428711:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:1985:x1830960574000640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.428717:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9139 00000100:00100000:2.0:1746140892.429059:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.429583:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574000768 00000100:00100000:1.0:1746140892.429587:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574000768 00010000:00010000:1.0:1746140892.429601:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 17 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.429624:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9140 00000100:00100000:1.0:1746140892.429629:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+17:1984:x1830960574000768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140892.429636:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140892.429639:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 17 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.429646:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 17 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.429658:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134952c00/0x8156357b7fdbbe45 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a260e expref: 17 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.429677:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140892.429679:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.429685:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.429693:0:8473:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140892.429716:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140892.429735:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960574000768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.429740:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9140 00010000:00010000:0.0:1746140892.429937:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140892.429944:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:0.0:1746140892.429972:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:0.0:1746140892.430099:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134953600/0x8156357b7fdbbe76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 278 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.430125:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 277 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.430144:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140892.430146:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746140892.430148:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134953e00, rc 0) 00000100:00100000:0.0:1746140892.430173:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:523:x1830960574000512:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3475us (3687us total) trans 8589945245 rc 0/0 00000100:00100000:0.0:1746140892.430179:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10902 00000100:00100000:0.0:1746140892.431246:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.431286:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.431344:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574001152 00000100:00100000:1.0:1746140892.431350:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574001152 00000100:00100000:3.0:1746140892.431363:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574001280 00000100:00100000:3.0:1746140892.431370:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574001280 00002000:00100000:1.0:1746140892.431380:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008ece0a80 x1830960574001152/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.431388:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0a80 with x1830960574001152 ext(1048576->2097151) 00002000:00010000:1.0:1746140892.431392:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece0a80 00002000:00100000:3.0:1746140892.431400:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008ece2a00 x1830960574001280/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.431409:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2a00 with x1830960574001280 ext(1048576->2097151) 00000100:00100000:1.0:1746140892.431410:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9047 00002000:00010000:3.0:1746140892.431413:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece2a00 00000100:00100000:1.0:1746140892.431416:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960574001152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.431431:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9048 00000100:00100000:3.0:1746140892.431437:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960574001280:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.447563:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960574001152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16140us (16316us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.447564:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960574001280:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16116us (16267us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.447573:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9047 00000100:00100000:3.0:1746140892.447582:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9048 00002000:00100000:1.0:1746140892.447582:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88008ece0a80 x1830960574001152/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.447589:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0a80 with x1830960574001152 ext(1048576->2097151) 00002000:00100000:3.0:1746140892.447591:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff88008ece2a00 x1830960574001280/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746140892.447594:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ece0a80 00002000:00100000:3.0:1746140892.447599:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2a00 with x1830960574001280 ext(1048576->2097151) 00002000:00010000:3.0:1746140892.447603:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ece2a00 00000100:00100000:0.0:1746140892.481021:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.481134:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574001408 00000100:00100000:1.0:1746140892.481143:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574001408 00000100:00100000:1.0:1746140892.481205:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17634 00000100:00100000:1.0:1746140892.481214:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:523:x1830960574001408:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140892.481232:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.481249:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2623 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.481279:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 26 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.481287:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.481293:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.481295:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.481298:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.481362:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.481373:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 9 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.481385:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576159744:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.481488:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 26 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.481497:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 26 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.481505:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576159872:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.482373:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.483088:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576159744:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.486421:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.486456:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.486497:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.486540:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574001536 00000100:00100000:0.0:1746140892.486548:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574001536 00000100:00100000:2.0:1746140892.486567:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574001792 00000100:00100000:1.0:1746140892.486568:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576159872:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.486571:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574001792 00010000:00010000:2.0:1746140892.486589:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 27 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.486589:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 10 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.486599:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 27 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.486614:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fda00, rc 0) 00000100:00100000:0.0:1746140892.486614:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9141 00000100:00100000:2.0:1746140892.486620:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9142 00000100:00100000:0.0:1746140892.486621:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960574001536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140892.486627:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960574001792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.486633:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.486635:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140892.486651:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:523:x1830960574001408:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5439us (5642us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140892.486653:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 27 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.486653:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 10 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.486656:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17634 00010000:00010000:2.0:1746140892.486662:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 27 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.486671:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574001664 00000100:00100000:1.0:1746140892.486672:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574001664 00000100:00100000:1.0:1746140892.486683:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17635 00000100:00100000:1.0:1746140892.486686:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+11:521:x1830960574001664:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140892.486695:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.486704:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a262a expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.486765:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.486791:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135257c00/0x8156357b7fdbbe06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25e4 expref: 26 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.486791:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.486794:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 9 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 26 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.486798:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140892.486801:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [3387392->4194303] (req 3387392->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 12 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.486812:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.486813:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.486813:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5260800/0x8156357b7fdbbe29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2607 expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.486820:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.486827:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.486844:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.486852:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.486860:0:7110:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.486861:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576160000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.486867:0:7110:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.486875:0:7110:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576160128:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140892.486895:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4780 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.486898:0:7110:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4bccd80 going to sleep for 11 seconds 00010000:00010000:0.0:1746140892.487166:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140892.487197:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960574001536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 576us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.487203:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9141 00000100:00100000:1.0:1746140892.488596:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576160000:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.488613:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->4194303] (req 3387392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 10 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.488623:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fd000, rc 0) 00000100:00100000:1.0:1746140892.488659:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+10:521:x1830960574001664:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1970us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.488665:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17635 00000100:00100000:2.0:1746140892.488782:0:7110:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7110:1830960576160128:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140892.488792:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.488811:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1983:x1830960574001792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2186us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.488818:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9142 00000100:00100000:0.0:1746140892.488887:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.489008:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574002048 00000100:00100000:3.0:1746140892.489013:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574002048 00002000:00100000:3.0:1746140892.489042:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (4112384->4116479) req@ffff88008ece2d80 x1830960574002048/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.489051:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2d80 with x1830960574002048 ext(4112384->4116479) 00010000:00010000:3.0:1746140892.489057:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.489068:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:3.0:1746140892.489079:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ece2d80 00000100:00100000:3.0:1746140892.489102:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1884 00000100:00100000:3.0:1746140892.489111:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960574002048:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140892.489242:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1982:x1830960574002048:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 132us (356us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140892.489248:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1884 00002000:00100000:3.0:1746140892.489253:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (4112384->4116479) req@ffff88008ece2d80 x1830960574002048/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.489260:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2d80 with x1830960574002048 ext(4112384->4116479) 00010000:00010000:3.0:1746140892.489264:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.489272:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:3.0:1746140892.489278:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ece2d80 00000100:00100000:0.0:1746140892.491045:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.491095:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574002304 00000100:00100000:1.0:1746140892.491103:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574002304 00002000:00100000:1.0:1746140892.491128:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (4112384->4194303) req@ffff88008ece2300 x1830960574002304/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.491136:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2300 with x1830960574002304 ext(4112384->4194303) 00010000:00010000:1.0:1746140892.491142:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.491157:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 25 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.491164:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ece2300 00000100:00100000:1.0:1746140892.491273:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1885 00000100:00100000:1.0:1746140892.491280:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960574002304:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140892.491403:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.491450:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574002432 00000100:00100000:1.0:1746140892.491453:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574002432 00000100:00100000:1.0:1746140892.491471:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17636 00000100:00100000:1.0:1746140892.491475:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:523:x1830960574002432:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140892.491484:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.491497:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2631 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.491517:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 16 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.491525:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 6 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.491531:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 7 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.492066:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.492068:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.492072:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4681727] (req 4194304->4681727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 16 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.492096:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 7 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.492103:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 7 pid: 4782 timeout: 971 lvb_type: 1 00000100:00100000:1.0:1746140892.492115:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576160256:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.492175:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 6 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.492181:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 6 pid: 4785 timeout: 971 lvb_type: 1 00000100:00100000:1.0:1746140892.492185:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576160384:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.492200:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 16 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.492205:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 16 pid: 8458 timeout: 971 lvb_type: 1 00000100:00100000:1.0:1746140892.492209:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576160512:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.492217:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4780 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.493245:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960574002304:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1963us (2202us total) trans 17179874268 rc 0/0 00000100:00100000:1.0:1746140892.493253:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1885 00002000:00100000:1.0:1746140892.493261:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (4112384->4194303) req@ffff88008ece2300 x1830960574002304/t17179874268(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.493268:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece2300 with x1830960574002304 ext(4112384->4194303) 00010000:00010000:1.0:1746140892.493275:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 27 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.493285:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 27 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.493292:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ece2300 00000100:00100000:1.0:1746140892.494428:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576160256:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.494438:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576160384:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.494444:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576160512:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.494471:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [4194304->4681727] (req 4194304->4681727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 16 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.494486:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fdc00, rc 0) 00000100:00100000:1.0:1746140892.494528:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:523:x1830960574002432:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3051us (3125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.494535:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17636 00000100:00100000:0.0:1746140892.498288:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.498362:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.498390:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.498558:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.499170:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574002688 00000100:00100000:3.0:1746140892.499183:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574002560 00000100:00100000:2.0:1746140892.499185:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574002688 00000100:00100000:3.0:1746140892.499190:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574002560 00000100:00100000:1.0:1746140892.499222:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574002816 00000100:00100000:1.0:1746140892.499226:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574002816 00010000:00010000:2.0:1746140892.499271:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 8 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:3.0:1746140892.499285:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 7 pid: 4785 timeout: 971 lvb_type: 1 00000100:00100000:3.0:1746140892.499332:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574002944 00000100:00100000:3.0:1746140892.499334:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574002944 00000100:00100000:2.0:1746140892.499344:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9143 00010000:00010000:3.0:1746140892.499346:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 27 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.499352:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960574002688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.499367:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.499385:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 8 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.499396:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 8 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.499415:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009256ea00/0x8156357b7fdbbc46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24d3 expref: 8 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.499439:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140892.499496:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 16 pid: 8458 timeout: 971 lvb_type: 1 00000100:00100000:3.0:1746140892.499531:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9144 00000100:00100000:3.0:1746140892.499539:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1985:x1830960574002560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.499550:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.499566:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 7 pid: 4785 timeout: 971 lvb_type: 1 00000100:00100000:0.0:1746140892.499587:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9145 00000100:00100000:1.0:1746140892.499598:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9146 00000100:00100000:0.0:1746140892.499598:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960574002944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140892.499604:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960574002816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.499605:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140892.499611:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746140892.499617:0:7111:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140892 -> 1746140893 00002000:00010000:0.0:1746140892.499620:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140892 -> 1746140893 00010000:00010000:0.0:1746140892.499624:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 27 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.499632:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 27 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.499654:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fda00/0x8156357b7fdbbe8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [4112384->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2623 expref: 27 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.499672:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.499673:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140892.499679:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.499686:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.499716:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.499721:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1985:x1830960574002688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 370us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.499726:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f24c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576160640:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140892.499727:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9143 00000100:00100000:0.0:1746140892.499782:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47449c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746140892.499858:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 7 pid: 4785 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.499871:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 16 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:3.0:1746140892.499874:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e4d400/0x8156357b7fdbbd5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2589 expref: 7 pid: 4785 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.499880:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 16 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.499891:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924bdc00/0x8156357b7fdbbbc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a249b expref: 16 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:3.0:1746140892.499892:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.499893:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.499898:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 15 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.499905:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 15 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.499912:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140892.499924:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 15 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.499931:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960574002816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 327us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.499934:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576160768:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140892.499936:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9146 00000100:00100000:3.0:1746140892.499970:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.501467:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.501469:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576160768:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140892.501472:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f24c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576160640:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140892.501484:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140892.501489:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.501520:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28b972ba-4133-49d1-b679-ce80456803d9+6:1985:x1830960574002560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1982us (3158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.501528:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9144 00000100:00100000:1.0:1746140892.501639:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1982:x1830960574002944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2045us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.501647:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9145 00000100:00100000:1.0:1746140892.501667:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574003200 00000100:00100000:1.0:1746140892.501672:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574003200 00002000:00100000:1.0:1746140892.501700:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3387392->3391487) req@ffff88009f24c380 x1830960574003200/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.501711:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24c380 with x1830960574003200 ext(3387392->3391487) 00002000:00010000:1.0:1746140892.501715:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f24c380 00000100:00100000:1.0:1746140892.501749:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9049 00000100:00100000:1.0:1746140892.501754:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960574003200:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140892.501911:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960574003200:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 156us (447us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.501917:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9049 00002000:00100000:1.0:1746140892.501922:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3387392->3391487) req@ffff88009f24c380 x1830960574003200/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.501929:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24c380 with x1830960574003200 ext(3387392->3391487) 00002000:00010000:1.0:1746140892.501931:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f24c380 00000100:00100000:0.0:1746140892.503772:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.503985:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574003456 00000100:00100000:1.0:1746140892.503991:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574003456 00002000:00100000:1.0:1746140892.504016:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4677632->4681727) req@ffff88009f24ca80 x1830960574003456/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.504024:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ca80 with x1830960574003456 ext(4677632->4681727) 00002000:00010000:1.0:1746140892.504028:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24ca80 00000100:00100000:1.0:1746140892.504085:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9050 00000100:00100000:1.0:1746140892.504090:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960574003456:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140892.504260:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960574003456:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 169us (493us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.504266:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9050 00002000:00100000:1.0:1746140892.504271:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4677632->4681727) req@ffff88009f24ca80 x1830960574003456/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.504278:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24ca80 with x1830960574003456 ext(4677632->4681727) 00002000:00010000:1.0:1746140892.504281:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24ca80 00000100:00100000:0.0:1746140892.509285:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.509355:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574003584 00000100:00100000:1.0:1746140892.509365:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574003584 00000100:00100000:1.0:1746140892.509586:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17637 00000100:00100000:1.0:1746140892.509594:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+7:521:x1830960574003584:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746140892.509614:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.509633:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2638 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.509665:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 14 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.509673:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140892.509674:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140892.509678:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [4194304->4300799] (req 4194304->4300799) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 8 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.509752:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 14 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.509766:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.509779:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576160896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.510907:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.511380:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576160896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.511404:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [4194304->4300799] (req 4194304->4300799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 8 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.511416:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f191000, rc 0) 00000100:00100000:1.0:1746140892.511491:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+8:521:x1830960574003584:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1896us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.511499:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17637 00000100:00100000:0.0:1746140892.512747:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.512993:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574003712 00000100:00100000:3.0:1746140892.513001:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574003712 00002000:00100000:3.0:1746140892.513126:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4681727) req@ffff88009f24fb80 x1830960574003712/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.513135:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24fb80 with x1830960574003712 ext(4194304->4681727) 00010000:00010000:3.0:1746140892.513142:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 15 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.513155:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 15 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:3.0:1746140892.513161:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f24fb80 00000100:00100000:3.0:1746140892.513185:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1886 00000100:00100000:3.0:1746140892.513192:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+15:1985:x1830960574003712:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140892.518650:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960574003712:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5444us (5892us total) trans 21474841570 rc 0/0 00000100:00100000:3.0:1746140892.518667:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1886 00002000:00100000:3.0:1746140892.518679:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4681727) req@ffff88009f24fb80 x1830960574003712/t21474841570(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.518793:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24fb80 with x1830960574003712 ext(4194304->4681727) 00010000:00010000:3.0:1746140892.518900:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 17 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.518933:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 17 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:3.0:1746140892.518939:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f24fb80 00000100:00100000:0.0:1746140892.520369:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.520464:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574003840 00000100:00100000:1.0:1746140892.520475:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574003840 00010000:00010000:1.0:1746140892.520512:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 17 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.520606:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9147 00000100:00100000:1.0:1746140892.520614:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1984:x1830960574003840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140892.520632:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746140892.520649:0:7111:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140892 -> 1746140893 00002000:00010000:1.0:1746140892.520653:0:7111:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140892 -> 1746140893 00010000:00010000:1.0:1746140892.520658:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 17 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.520672:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 17 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.520696:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbe99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2631 expref: 17 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.520728:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.520731:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.520739:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 7 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.520747:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 7 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.520778:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 7 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.520790:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576161024:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140892.520872:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.522227:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576161024:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140892.522244:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140892.522284:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960574003840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1670us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.522293:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9147 00000100:00100000:0.0:1746140892.523195:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.523249:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574004096 00000100:00100000:3.0:1746140892.523256:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574004096 00002000:00100000:3.0:1746140892.523292:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (4296704->4300799) req@ffff88009f24f480 x1830960574004096/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.523301:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f480 with x1830960574004096 ext(4296704->4300799) 00002000:00010000:3.0:1746140892.523346:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24f480 00000100:00100000:3.0:1746140892.523371:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9051 00000100:00100000:3.0:1746140892.523377:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960574004096:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140892.523746:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960574004096:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 369us (552us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140892.523752:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9051 00002000:00100000:3.0:1746140892.523757:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (4296704->4300799) req@ffff88009f24f480 x1830960574004096/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.523770:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f480 with x1830960574004096 ext(4296704->4300799) 00002000:00010000:3.0:1746140892.523773:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24f480 00000100:00100000:0.0:1746140892.524934:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.525085:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574004352 00000100:00100000:2.0:1746140892.525092:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574004352 00000100:00100000:2.0:1746140892.525137:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4819 00000100:00100000:2.0:1746140892.525144:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+16:521:x1830960574004352:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140892.525456:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+17:521:x1830960574004352:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 312us (526us total) trans 8589945246 rc 0/0 00000100:00100000:2.0:1746140892.525463:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4819 00000100:00100000:0.0:1746140892.565886:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.566266:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574004608 00000100:00100000:2.0:1746140892.566276:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574004608 00000100:00100000:2.0:1746140892.566361:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10903 00000100:00100000:2.0:1746140892.566369:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+17:532:x1830960574004608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.566393:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.566439:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a263f expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.566556:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566569:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566577:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566588:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566593:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566598:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566703:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3a00/0x8156357b7fdbbebc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566710:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3a00/0x8156357b7fdbbebc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566716:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3a00/0x8156357b7fdbbebc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:2.0:1746140892.566724:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140892.566811:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566816:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566822:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566827:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351a2e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140892.566830:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566835:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566844:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140892.566846:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140892.566850:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566853:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566885:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566891:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566896:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566900:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351a2000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140892.566902:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566907:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566913:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800936f8c00) 00010000:00010000:2.0:1746140892.566915:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140892.566917:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566921:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2000/0x8156357b7fdbbeb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.566967:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a263f expref: 20 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.566979:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3a00/0x8156357b7fdbbebc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a263f expref: 19 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.566985:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.566987:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140892.566990:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a3a00, rc 0) 00000100:00100000:2.0:1746140892.567048:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+19:532:x1830960574004608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 680us (1175us total) trans 8589945247 rc 0/0 00000100:00100000:2.0:1746140892.567055:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10903 00000100:00100000:0.0:1746140892.569237:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.569512:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.569534:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574004864 00000100:00100000:1.0:1746140892.569543:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574004864 00000100:00100000:2.0:1746140892.569600:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574004736 00000100:00100000:1.0:1746140892.569602:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 797 00000100:00100000:2.0:1746140892.569603:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574004736 00000100:00100000:1.0:1746140892.569609:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1984:x1830960574004864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140892.569624:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17638 00010000:00010000:1.0:1746140892.569624:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140892.569628:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960574004736:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.569640:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.569644:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3a00/0x8156357b7fdbbebc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a263f expref: 19 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.569651:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2646 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.569671:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140892.569675:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.569700:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576161152:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140892.569710:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+18:1984:x1830960574004864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.569715:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 797 00000100:00100000:2.0:1746140892.569751:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4bcc600 going to sleep for 11 seconds 00002000:00010000:2.0:1746140892.570988:0:9872:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime: 1746140892 -> 1746140893 00000100:00100000:2.0:1746140892.571013:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576161152:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140892.571038:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2646 expref: 11 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.571049:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2646 expref: 11 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.571058:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a2e00, rc 0) 00000100:00100000:2.0:1746140892.571106:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960574004736:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1476us (1876us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140892.571115:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17638 00000100:00100000:0.0:1746140892.579878:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.580965:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574005120 00000100:00100000:3.0:1746140892.580976:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574005120 00002000:00100000:3.0:1746140892.581025:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f24f100 x1830960574005120/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.581036:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f100 with x1830960574005120 ext(2097152->3145727) 00002000:00010000:3.0:1746140892.581042:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24f100 00000100:00100000:3.0:1746140892.581077:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9052 00000100:00100000:3.0:1746140892.581083:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960574005120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.589269:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960574005120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8174us (9389us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.589282:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9052 00002000:00100000:3.0:1746140892.589294:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009f24f100 x1830960574005120/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.589321:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f100 with x1830960574005120 ext(2097152->3145727) 00002000:00010000:3.0:1746140892.589328:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24f100 00000100:00100000:0.0:1746140892.592643:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.593106:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574005248 00000100:00100000:2.0:1746140892.593116:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574005248 00000100:00100000:2.0:1746140892.593167:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17639 00000100:00100000:2.0:1746140892.593175:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+10:532:x1830960574005248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.593193:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.593210:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a264d expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.593238:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.593240:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.593247:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 11 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.593262:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 11 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.593271:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a2000, rc 0) 00000100:00100000:2.0:1746140892.593401:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+11:532:x1830960574005248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 226us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.593407:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17639 00000100:00100000:0.0:1746140892.597565:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.597617:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.597645:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574005632 00000100:00100000:3.0:1746140892.597654:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574005632 00002000:00100000:3.0:1746140892.597694:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f24f800 x1830960574005632/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746140892.597695:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574005760 00000100:00100000:1.0:1746140892.597698:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574005760 00002000:00100000:3.0:1746140892.597704:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f800 with x1830960574005632 ext(2097152->3145727) 00002000:00010000:3.0:1746140892.597710:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f24f800 00002000:00100000:1.0:1746140892.597715:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f24c000 x1830960574005760/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.597721:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24c000 with x1830960574005760 ext(3145728->4194303) 00002000:00010000:1.0:1746140892.597724:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24c000 00000100:00100000:3.0:1746140892.597728:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9053 00000100:00100000:3.0:1746140892.597734:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960574005632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.597751:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9054 00000100:00100000:1.0:1746140892.597756:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960574005760:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.608016:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960574005632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10274us (10450us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.608026:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9053 00002000:00100000:3.0:1746140892.608037:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009f24f800 x1830960574005632/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.608047:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24f800 with x1830960574005632 ext(2097152->3145727) 00002000:00010000:3.0:1746140892.608052:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f24f800 00000100:00100000:1.0:1746140892.608493:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960574005760:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10729us (10867us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.608503:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9054 00002000:00100000:1.0:1746140892.608512:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009f24c000 x1830960574005760/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.608521:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f24c000 with x1830960574005760 ext(3145728->4194303) 00002000:00010000:1.0:1746140892.608526:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f24c000 00000100:00100000:0.0:1746140892.617160:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.617361:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574005888 00000100:00100000:2.0:1746140892.617372:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574005888 00000100:00100000:2.0:1746140892.617439:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17640 00000100:00100000:2.0:1746140892.617446:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+11:532:x1830960574005888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.617465:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.617487:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2654 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.617518:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 12 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.617525:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.617527:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.617531:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 12 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.617563:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 12 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.617575:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.617586:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576161280:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.617691:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4bcc600 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.619213:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576161280:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.619249:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 12 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.619267:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a2a00, rc 0) 00000100:00100000:2.0:1746140892.619333:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+12:532:x1830960574005888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1886us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.619341:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17640 00000100:00100000:0.0:1746140892.620702:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.620795:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574006016 00000100:00100000:1.0:1746140892.620803:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574006016 00002000:00100000:1.0:1746140892.620841:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3387392->4194303) req@ffff88008ece0700 x1830960574006016/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.620853:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0700 with x1830960574006016 ext(3387392->4194303) 00010000:00010000:1.0:1746140892.620861:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.620872:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.620877:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ece0700 00000100:00100000:1.0:1746140892.620902:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1887 00000100:00100000:1.0:1746140892.620907:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960574006016:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746140892.624471:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.625111:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574006272 00000100:00100000:2.0:1746140892.625121:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574006272 00000100:00100000:2.0:1746140892.625720:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10904 00000100:00100000:2.0:1746140892.625728:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ece3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+277:534:x1830960574006272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140892.625752:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.625769:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbedf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a265b expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.625897:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.625912:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.625923:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.625938:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.625943:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.625948:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626088:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626098:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626105:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:2.0:1746140892.626117:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:2.0:1746140892.626227:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626235:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626242:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626248:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351a2200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140892.626254:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626262:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626273:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140892.626276:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140892.626280:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626286:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2200/0x8156357b7fdbbee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626345:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626351:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626356:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626365:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351a2e00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140892.626368:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626373:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626381:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800936f8a00) 00010000:00010000:2.0:1746140892.626382:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140892.626385:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626390:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2e00/0x8156357b7fdbbeed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140892.626430:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbedf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 280 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.626443:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 279 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.626450:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.626452:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746140892.626455:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a3800, rc 0) 00000100:00100000:2.0:1746140892.626522:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:534:x1830960574006272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 795us (2065us total) trans 8589945248 rc 0/0 00000100:00100000:2.0:1746140892.626530:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10904 00000100:00100000:0.0:1746140892.628273:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.628347:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574006528 00000100:00100000:2.0:1746140892.628354:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574006528 00000100:00100000:2.0:1746140892.628401:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4820 00000100:00100000:2.0:1746140892.628409:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+279:534:x1830960574006528:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140892.628570:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:534:x1830960574006528:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 162us (303us total) trans 8589945249 rc 0/0 00000100:00100000:2.0:1746140892.628577:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4820 00000100:00100000:1.0:1746140892.629925:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ece0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960574006016:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9015us (9226us total) trans 17179874269 rc 0/0 00000100:00100000:1.0:1746140892.629935:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1887 00002000:00100000:1.0:1746140892.629944:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3387392->4194303) req@ffff88008ece0700 x1830960574006016/t17179874269(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.629968:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ece0700 with x1830960574006016 ext(3387392->4194303) 00010000:00010000:1.0:1746140892.629977:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.629992:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.629999:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ece0700 00000100:00100000:0.0:1746140892.631444:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.631506:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574006656 00000100:00100000:3.0:1746140892.631514:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574006656 00010000:00010000:3.0:1746140892.631542:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.631579:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9148 00000100:00100000:3.0:1746140892.631585:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960574006656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.631596:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.631613:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.631623:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.631645:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbbe92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3387392->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a262a expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.631679:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.631681:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.631688:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 13 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.631696:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 13 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.631727:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 13 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140892.631738:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576161408:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140892.631808:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.635549:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.635599:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9847:1830960576161408:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140892.635621:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.635675:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960574006656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4089us (4237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.635685:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9148 00000100:00100000:1.0:1746140892.635696:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574006912 00000100:00100000:1.0:1746140892.635704:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574006912 00002000:00100000:1.0:1746140892.635742:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009abbbb80 x1830960574006912/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.635752:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbbb80 with x1830960574006912 ext(3145728->4194303) 00002000:00010000:1.0:1746140892.635757:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abbbb80 00000100:00100000:1.0:1746140892.635779:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9055 00000100:00100000:1.0:1746140892.635784:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960574006912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140892.644790:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.644976:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574007168 00000100:00100000:3.0:1746140892.644986:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574007168 00000100:00100000:3.0:1746140892.645036:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10905 00000100:00100000:3.0:1746140892.645043:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+18:536:x1830960574007168:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140892.645068:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.645091:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbbf02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2662 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.645204:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645218:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645229:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645244:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645250:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645255:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645386:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbf17 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645394:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbf17 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645400:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbf17 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140892.645408:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:0.0:1746140892.645474:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960574006912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9689us (9935us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140892.645484:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9055 00002000:00100000:0.0:1746140892.645493:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009abbbb80 x1830960574006912/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140892.645501:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abbbb80 with x1830960574006912 ext(3145728->4194303) 00002000:00010000:0.0:1746140892.645505:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abbbb80 00010000:00010000:3.0:1746140892.645510:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645517:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645526:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645531:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fbc00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.645535:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645541:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645552:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.645555:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.645559:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645564:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbf09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645577:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645582:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645587:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645591:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50faa00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.645593:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645598:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645607:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152a00) 00010000:00010000:3.0:1746140892.645609:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.645611:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645615:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50faa00/0x8156357b7fdbbf10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.645648:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa600/0x8156357b7fdbbf02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2662 expref: 21 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.645658:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbf17 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2662 expref: 20 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.645664:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.645666:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140892.645668:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb200, rc 0) 00000100:00100000:3.0:1746140892.645701:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+20:536:x1830960574007168:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 658us (920us total) trans 8589945250 rc 0/0 00000100:00100000:3.0:1746140892.645706:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10905 00000100:00100000:0.0:1746140892.650495:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.650777:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574007296 00000100:00100000:3.0:1746140892.650787:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574007296 00000100:00100000:3.0:1746140892.650852:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 798 00000100:00100000:3.0:1746140892.650860:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+20:1982:x1830960574007296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.650874:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.651032:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbf17 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2662 expref: 20 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.651059:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.651063:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.651277:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+19:1982:x1830960574007296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 416us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.651287:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 798 00000100:00100000:0.0:1746140892.654428:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.654472:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.654480:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574007552 00000100:00100000:2.0:1746140892.654489:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574007552 00000100:00100000:1.0:1746140892.654539:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574007808 00000100:00100000:1.0:1746140892.654543:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574007808 00000100:00100000:2.0:1746140892.654548:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4821 00000100:00100000:2.0:1746140892.654556:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aca7b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+19:536:x1830960574007552:12345-192.168.204.16@tcp:35:multiop.0 00002000:00100000:1.0:1746140892.654574:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4300800->4886527) req@ffff88009abba680 x1830960574007808/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.654583:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abba680 with x1830960574007808 ext(4300800->4886527) 00002000:00010000:1.0:1746140892.654587:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abba680 00000100:00100000:1.0:1746140892.654599:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9056 00000100:00100000:1.0:1746140892.654604:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960574007808:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140892.654731:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aca7b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+20:536:x1830960574007552:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 175us (309us total) trans 8589945251 rc 0/0 00000100:00100000:2.0:1746140892.654737:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4821 00000100:00100000:1.0:1746140892.659708:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1985:x1830960574007808:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5090us (5222us total) trans 0 rc 585728/585728 00000100:00100000:1.0:1746140892.659720:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9056 00002000:00100000:1.0:1746140892.659731:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (4300800->4886527) req@ffff88009abba680 x1830960574007808/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 585728/585728 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.659740:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abba680 with x1830960574007808 ext(4300800->4886527) 00002000:00010000:1.0:1746140892.659745:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abba680 00000100:00100000:0.0:1746140892.664775:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.665009:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574008064 00000100:00100000:3.0:1746140892.665018:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574008064 00000100:00100000:3.0:1746140892.665073:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4822 00000100:00100000:3.0:1746140892.665080:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+20:532:x1830960574008064:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746140892.665384:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+21:532:x1830960574008064:12345-192.168.204.16@tcp:35:cat.0 Request processed in 304us (613us total) trans 8589945252 rc 0/0 00000100:00100000:3.0:1746140892.665391:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4822 00000100:00100000:0.0:1746140892.669930:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.670347:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574008192 00000100:00100000:2.0:1746140892.670356:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574008192 00000100:00100000:2.0:1746140892.670509:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17641 00000100:00100000:2.0:1746140892.670517:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:534:x1830960574008192:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140892.670536:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.670553:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2669 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.670584:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 7 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.670591:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 17 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.670601:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.670602:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.670605:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1212416->1753087] (req 1212416->1753087) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 17 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.670633:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 17 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.670643:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 17 pid: 9872 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.670654:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576161536:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.670754:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 7 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.670763:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 7 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.670774:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576161664:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.670796:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.672196:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576161536:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.672206:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576161664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.672233:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1212416->1753087] (req 1212416->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 17 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.672250:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a2800, rc 0) 00000100:00100000:2.0:1746140892.672289:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:534:x1830960574008192:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1772us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.672296:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17641 00000100:00100000:0.0:1746140892.673423:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.673481:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574008320 00000100:00100000:3.0:1746140892.673487:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574008320 00010000:00010000:3.0:1746140892.673512:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 17 pid: 9872 timeout: 971 lvb_type: 1 00000100:00100000:3.0:1746140892.673546:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9149 00000100:00100000:3.0:1746140892.673553:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960574008320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.673564:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.673587:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 17 pid: 9872 timeout: 971 lvb_type: 1 00010000:00010000:3.0:1746140892.673597:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 17 pid: 9872 timeout: 971 lvb_type: 1 00010000:00010000:3.0:1746140892.673616:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8b800/0x8156357b7fdbbe22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2600 expref: 17 pid: 9872 timeout: 971 lvb_type: 1 00010000:00010000:3.0:1746140892.673631:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140892.674191:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.674204:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960574008320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 650us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.674278:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9149 00000100:00100000:3.0:1746140892.674408:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574008448 00000100:00100000:3.0:1746140892.674411:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574008448 00010000:00010000:3.0:1746140892.674423:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 8 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.674449:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9150 00000100:00100000:3.0:1746140892.674455:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1984:x1830960574008448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.674462:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.674472:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 8 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.674480:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 8 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.674569:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351a3200/0x8156357b7fdbbe0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25eb expref: 8 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.674577:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.674578:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.674584:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 15 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.674592:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 15 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.674617:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 15 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140892.674628:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576161792:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140892.675152:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800907bbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140892.676155:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576161792:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140892.676173:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.676203:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960574008448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1747us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.676212:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9150 00000100:00100000:0.0:1746140892.679543:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.679699:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574008704 00000100:00100000:1.0:1746140892.679707:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574008704 00002000:00100000:1.0:1746140892.679746:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1212416->1216511) req@ffff88009fc34700 x1830960574008704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.679755:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34700 with x1830960574008704 ext(1212416->1216511) 00002000:00010000:1.0:1746140892.679761:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34700 00000100:00100000:1.0:1746140892.680533:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9057 00000100:00100000:1.0:1746140892.680546:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960574008704:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140892.680722:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1982:x1830960574008704:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 180us (1184us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.680728:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9057 00002000:00100000:1.0:1746140892.680734:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1212416->1216511) req@ffff88009fc34700 x1830960574008704/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.680741:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34700 with x1830960574008704 ext(1212416->1216511) 00002000:00010000:1.0:1746140892.680744:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34700 00000100:00100000:0.0:1746140892.682765:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.682897:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574008960 00000100:00100000:3.0:1746140892.682904:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574008960 00000100:00100000:3.0:1746140892.682966:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10906 00000100:00100000:3.0:1746140892.682974:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+280:542:x1830960574008960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140892.682994:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.683011:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbbf2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2670 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.683099:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683114:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683123:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683133:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683138:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683142:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683230:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbbf41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683238:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbbf41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683244:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbbf41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140892.683251:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.683358:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683365:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683370:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683379:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.683382:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683388:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683397:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.683399:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.683403:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683407:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbf33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683430:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683435:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683438:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683443:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.683445:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683449:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683455:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152600) 00010000:00010000:3.0:1746140892.683456:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.683459:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683463:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbf3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.683494:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb400/0x8156357b7fdbbf2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2670 expref: 283 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.683505:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbbf41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2670 expref: 282 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.683510:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.683512:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140892.683514:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb800, rc 0) 00000100:00100000:3.0:1746140892.684184:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:542:x1830960574008960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1209us (1421us total) trans 8589945253 rc 0/0 00000100:00100000:3.0:1746140892.684191:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10906 00000100:00100000:0.0:1746140892.685628:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.685684:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574009216 00000100:00100000:1.0:1746140892.685691:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574009216 00002000:00100000:1.0:1746140892.685723:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1748992->1753087) req@ffff88009fc34380 x1830960574009216/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.685732:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34380 with x1830960574009216 ext(1748992->1753087) 00002000:00010000:1.0:1746140892.685736:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34380 00000100:00100000:1.0:1746140892.685808:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9058 00000100:00100000:1.0:1746140892.685815:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960574009216:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140892.685950:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960574009216:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 136us (323us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.685967:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9058 00002000:00100000:1.0:1746140892.685972:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1748992->1753087) req@ffff88009fc34380 x1830960574009216/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.685979:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc34380 with x1830960574009216 ext(1748992->1753087) 00002000:00010000:1.0:1746140892.685981:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc34380 00000100:00100000:0.0:1746140892.686425:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.686465:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.686537:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574009600 00000100:00100000:3.0:1746140892.686541:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574009600 00000100:00100000:3.0:1746140892.686565:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4823 00000100:00100000:2.0:1746140892.686566:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574009472 00000100:00100000:3.0:1746140892.686570:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:542:x1830960574009600:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140892.686570:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574009472 00000100:00100000:2.0:1746140892.686606:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 799 00000100:00100000:2.0:1746140892.686611:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:1983:x1830960574009472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.686621:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.686639:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbbf41 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2670 expref: 283 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.686660:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.686664:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.686684:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:1983:x1830960574009472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.686689:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 799 00000100:00100000:3.0:1746140892.686974:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:542:x1830960574009600:12345-192.168.204.16@tcp:35:cat.0 Request processed in 402us (549us total) trans 8589945254 rc 0/0 00000100:00100000:3.0:1746140892.686979:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4823 00000100:00100000:0.0:1746140892.688378:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.688421:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.688474:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574009728 00000100:00100000:1.0:1746140892.688475:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574009856 00000100:00100000:2.0:1746140892.688480:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574009728 00000100:00100000:1.0:1746140892.688480:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574009856 00000100:00100000:1.0:1746140892.688521:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17642 00000100:00100000:1.0:1746140892.688528:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960574009856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140892.688541:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140892.688584:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17643 00000100:00100000:2.0:1746140892.688590:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960574009728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.688597:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.688609:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbf4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2677 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.688653:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576161920:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140892.688708:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a267e expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.688723:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.688725:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.688733:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 27 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.688746:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 27 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.688755:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f190200, rc 0) 00000100:00100000:1.0:1746140892.688795:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960574009856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 268us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.688801:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17642 00000100:00100000:2.0:1746140892.688816:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7d80 going to sleep for 11 seconds 00002000:00010000:2.0:1746140892.691001:0:4782:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime: 1746140892 -> 1746140893 00000100:00100000:2.0:1746140892.691021:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576161920:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140892.691045:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbf4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2677 expref: 17 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.691054:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbbf4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2677 expref: 17 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.691063:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fdc00, rc 0) 00000100:00100000:2.0:1746140892.691102:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1984:x1830960574009728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2511us (2727us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140892.691108:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17643 00010000:00010000:2.0:1746140892.693439:0:1273:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140892.698097:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.698199:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574010112 00000100:00100000:1.0:1746140892.698208:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574010112 00002000:00100000:1.0:1746140892.698247:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a513d500 x1830960574010112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 504/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.698257:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d500 with x1830960574010112 ext(1048576->2097151) 00002000:00010000:1.0:1746140892.698262:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513d500 00000100:00100000:1.0:1746140892.698288:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9059 00000100:00100000:1.0:1746140892.698293:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960574010112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.703208:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960574010112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4903us (5109us total) trans 0 rc 507904/507904 00000100:00100000:1.0:1746140892.703219:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9059 00002000:00100000:1.0:1746140892.703230:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a513d500 x1830960574010112/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 504/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 507904/507904 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.703239:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a513d500 with x1830960574010112 ext(1048576->2097151) 00002000:00010000:1.0:1746140892.703245:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a513d500 00000100:00100000:0.0:1746140892.707216:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.707485:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574010240 00000100:00100000:2.0:1746140892.707494:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574010240 00000100:00100000:2.0:1746140892.707537:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17644 00000100:00100000:2.0:1746140892.707544:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:542:x1830960574010240:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140892.707562:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.707579:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2685 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.707606:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 6 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.707619:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.707621:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746140892.707624:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 17 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.707649:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 6 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.707660:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 6 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.707670:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576162048:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.707755:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.710426:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576162048:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.710426:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140892.710457:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 17 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.710474:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fda00, rc 0) 00000100:00100000:1.0:1746140892.710501:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574010368 00000100:00100000:1.0:1746140892.710508:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574010368 00000100:00100000:2.0:1746140892.710529:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:542:x1830960574010240:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2985us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.710538:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17644 00002000:00100000:1.0:1746140892.710545:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3354624->4300799) req@ffff880135699c00 x1830960574010368/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 504/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.710555:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699c00 with x1830960574010368 ext(3354624->4300799) 00010000:00010000:1.0:1746140892.710561:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 7 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.710574:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 7 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.710580:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135699c00 00000100:00100000:1.0:1746140892.710606:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1888 00000100:00100000:1.0:1746140892.710613:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+7:1984:x1830960574010368:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746140892.713175:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960574010368:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2551us (2738us total) trans 21474841571 rc 0/0 00000100:00100000:1.0:1746140892.713187:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1888 00002000:00100000:1.0:1746140892.713197:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3354624->4300799) req@ffff880135699c00 x1830960574010368/t21474841571(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 504/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.713208:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135699c00 with x1830960574010368 ext(3354624->4300799) 00010000:00010000:1.0:1746140892.713217:0:32429:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 9 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.713232:0:32429:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 9 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:1.0:1746140892.713238:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135699c00 00000100:00100000:0.0:1746140892.717146:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.717355:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574010496 00000100:00100000:2.0:1746140892.717364:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574010496 00010000:00010000:2.0:1746140892.717395:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 9 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.717434:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9151 00000100:00100000:2.0:1746140892.717440:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1982:x1830960574010496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.717454:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.717480:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 9 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.717492:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 9 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.717515:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f191000/0x8156357b7fdbbea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4300799) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2638 expref: 9 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.717536:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.717539:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.717546:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 16 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.717554:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 16 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.717585:0:9847:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 16 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.717596:0:9847:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576162176:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140892.717671:0:9847:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.720003:0:9847:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9847:1830960576162176:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140892.720021:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.720066:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1982:x1830960574010496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2625us (2931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.720075:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9151 00000100:00100000:0.0:1746140892.728083:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.728116:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.728149:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574011008 00000100:00100000:0.0:1746140892.728155:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.728158:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574011008 00002000:00100000:1.0:1746140892.728199:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88013569a680 x1830960574011008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.728209:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569a680 with x1830960574011008 ext(3145728->4194303) 00002000:00010000:1.0:1746140892.728215:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569a680 00000100:00100000:1.0:1746140892.728230:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574010752 00000100:00100000:1.0:1746140892.728232:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574010752 00002000:00100000:1.0:1746140892.728242:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b892300 x1830960574010752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.728248:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892300 with x1830960574010752 ext(2097152->3145727) 00002000:00010000:1.0:1746140892.728251:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b892300 00000100:00100000:1.0:1746140892.728266:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574011136 00000100:00100000:1.0:1746140892.728269:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574011136 00002000:00100000:1.0:1746140892.728283:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009b891180 x1830960574011136/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.728289:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891180 with x1830960574011136 ext(3145728->4194303) 00002000:00010000:1.0:1746140892.728291:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b891180 00000100:00100000:2.0:1746140892.728343:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9060 00000100:00100000:2.0:1746140892.728360:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1985:x1830960574011008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.728417:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9061 00000100:00100000:0.0:1746140892.728424:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9062 00000100:00100000:1.0:1746140892.728426:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960574010752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140892.728437:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960574011136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140892.737139:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960574011136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8698us (8972us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140892.737151:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9062 00002000:00100000:2.0:1746140892.737163:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009b891180 x1830960574011136/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.737172:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891180 with x1830960574011136 ext(3145728->4194303) 00002000:00010000:2.0:1746140892.737177:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b891180 00000100:00100000:2.0:1746140892.738534:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960574011008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10166us (10445us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140892.738544:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9060 00002000:00100000:2.0:1746140892.738553:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88013569a680 x1830960574011008/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.738563:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013569a680 with x1830960574011008 ext(3145728->4194303) 00002000:00010000:2.0:1746140892.738569:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013569a680 00000100:00100000:1.0:1746140892.740433:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1984:x1830960574010752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11999us (12306us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.740449:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9061 00002000:00100000:1.0:1746140892.740458:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88009b892300 x1830960574010752/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.740466:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b892300 with x1830960574010752 ext(2097152->3145727) 00002000:00010000:1.0:1746140892.740471:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b892300 00000100:00100000:0.0:1746140892.747896:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.747994:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574011520 00000100:00100000:1.0:1746140892.748004:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574011520 00002000:00100000:1.0:1746140892.748049:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009b891880 x1830960574011520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.748069:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891880 with x1830960574011520 ext(4194304->4886527) 00002000:00010000:1.0:1746140892.748075:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891880 00000100:00100000:1.0:1746140892.748107:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9063 00000100:00100000:1.0:1746140892.748114:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1984:x1830960574011520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.754074:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1984:x1830960574011520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5950us (6179us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746140892.754085:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9063 00002000:00100000:1.0:1746140892.754096:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff88009b891880 x1830960574011520/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.754106:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b891880 with x1830960574011520 ext(4194304->4886527) 00002000:00010000:1.0:1746140892.754112:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b891880 00000100:00100000:0.0:1746140892.768598:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.768680:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574011776 00000100:00100000:3.0:1746140892.768691:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574011776 00000100:00100000:3.0:1746140892.768739:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10907 00000100:00100000:3.0:1746140892.768745:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+21:546:x1830960574011776:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140892.768767:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.768785:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbbf64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a268c expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.768904:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.768917:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.768926:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.768939:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.768944:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.768949:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769069:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769078:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769084:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140892.769093:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.769190:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769200:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769206:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769211:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.769215:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769222:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769232:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.769234:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.769238:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769243:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb600/0x8156357b7fdbbf6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769272:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769277:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769282:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769286:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fac00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.769288:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769302:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769338:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152100) 00010000:00010000:3.0:1746140892.769340:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.769342:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769351:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fac00/0x8156357b7fdbbf72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.769388:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbbf64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a268c expref: 24 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.769399:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a268c expref: 23 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.769405:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.769406:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140892.769408:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fa800, rc 0) 00000100:00100000:3.0:1746140892.769474:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:546:x1830960574011776:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 729us (886us total) trans 8589945255 rc 0/0 00000100:00100000:3.0:1746140892.769481:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10907 00000100:00100000:0.0:1746140892.772902:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.772947:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574011904 00000100:00100000:2.0:1746140892.772965:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574011904 00000100:00100000:2.0:1746140892.773027:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 800 00000100:00100000:2.0:1746140892.773095:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+23:1984:x1830960574011904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.773110:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.773133:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf79 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a268c expref: 23 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.773163:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.773171:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.773212:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9944e31-822a-4286-b0f5-4880be82b6d9+22:1984:x1830960574011904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.773218:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 800 00000100:00100000:0.0:1746140892.801297:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.801464:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574012160 00000100:00100000:3.0:1746140892.801475:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574012160 00000100:00100000:3.0:1746140892.801533:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10908 00000100:00100000:3.0:1746140892.801542:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:548:x1830960574012160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746140892.801566:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.801585:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbbf87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2693 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.801695:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801708:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801718:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801730:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801735:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801740:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801841:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbbf9c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801850:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbbf9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801856:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbbf9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140892.801865:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.801948:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801965:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801971:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801976:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.801980:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801986:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.801995:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.801998:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.802001:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802006:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb000/0x8156357b7fdbbf8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802033:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802038:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802043:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802046:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa800 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.802049:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802053:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802062:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152400) 00010000:00010000:3.0:1746140892.802064:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.802066:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802069:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa800/0x8156357b7fdbbf95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.802104:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fae00/0x8156357b7fdbbf87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2693 expref: 285 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.802114:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbbf9c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2693 expref: 284 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.802120:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.802122:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140892.802124:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbe00, rc 0) 00000100:00100000:3.0:1746140892.802183:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:548:x1830960574012160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 642us (897us total) trans 8589945256 rc 0/0 00000100:00100000:3.0:1746140892.802189:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10908 00000100:00100000:0.0:1746140892.804480:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.804521:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574012288 00000100:00100000:2.0:1746140892.804528:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574012288 00000100:00100000:0.0:1746140892.804547:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.804636:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574012544 00000100:00100000:3.0:1746140892.804640:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574012544 00000100:00100000:3.0:1746140892.804657:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4824 00000100:00100000:3.0:1746140892.804661:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:548:x1830960574012544:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746140892.804795:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+286:548:x1830960574012544:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 134us (248us total) trans 8589945257 rc 0/0 00000100:00100000:3.0:1746140892.804799:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4824 00000100:00100000:2.0:1746140892.804863:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 801 00000100:00100000:2.0:1746140892.804870:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1982:x1830960574012288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.804881:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.804900:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbe00/0x8156357b7fdbbf9c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2693 expref: 285 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.804916:0:9847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.804920:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.804936:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:1982:x1830960574012288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.804942:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 801 00000100:00100000:0.0:1746140892.816524:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.816621:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574012672 00000100:00100000:2.0:1746140892.816630:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574012672 00000100:00100000:2.0:1746140892.816685:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17645 00000100:00100000:2.0:1746140892.816693:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:546:x1830960574012672:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140892.816710:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.816726:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a269a expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.816755:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 14 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.816763:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 26 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.816769:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.816771:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.816774:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3715072->4194303] (req 3715072->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 14 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.816803:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 26 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.816814:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 26 pid: 8458 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.816825:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576162304:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.816935:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 14 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.816944:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.816971:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576162432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.816990:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.818123:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576162304:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.818134:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576162432:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.818160:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [3715072->4194303] (req 3715072->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 14 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.818174:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fde00, rc 0) 00000100:00100000:2.0:1746140892.818211:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:546:x1830960574012672:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1518us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.818219:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17645 00000100:00100000:0.0:1746140892.819925:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.820033:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574012800 00000100:00100000:1.0:1746140892.820041:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574012800 00010000:00010000:1.0:1746140892.820072:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 27 pid: 8458 timeout: 971 lvb_type: 1 00000100:00100000:1.0:1746140892.820108:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9152 00000100:00100000:1.0:1746140892.820118:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960574012800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140892.820129:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140892.820149:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 27 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.820158:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 27 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.820178:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbf56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a267e expref: 27 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.820205:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140892.820240:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574012800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 126us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.820247:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9152 00000100:00100000:0.0:1746140892.820461:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.820571:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574012928 00000100:00100000:2.0:1746140892.820576:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574012928 00010000:00010000:2.0:1746140892.820593:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.820621:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9153 00000100:00100000:2.0:1746140892.820627:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960574012928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.820633:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.820642:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.820650:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.820662:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbbed8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2654 expref: 14 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.820682:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.820685:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.820691:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 13 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.820699:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 13 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.820790:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 13 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.820802:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576162560:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140892.820874:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.821778:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576162560:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140892.821791:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.821830:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960574012928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1202us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.821837:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9153 00000100:00100000:0.0:1746140892.821940:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.821979:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574013184 00000100:00100000:2.0:1746140892.821984:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574013184 00002000:00100000:2.0:1746140892.822009:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3715072->3719167) req@ffff88009b890a80 x1830960574013184/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.822023:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890a80 with x1830960574013184 ext(3715072->3719167) 00002000:00010000:2.0:1746140892.822027:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b890a80 00000100:00100000:2.0:1746140892.822042:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9064 00000100:00100000:2.0:1746140892.822048:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960574013184:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746140892.822283:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960574013184:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 234us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746140892.822289:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9064 00002000:00100000:2.0:1746140892.822294:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a9:0x0] (3715072->3719167) req@ffff88009b890a80 x1830960574013184/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.822301:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b890a80 with x1830960574013184 ext(3715072->3719167) 00002000:00010000:2.0:1746140892.822327:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b890a80 00000100:00100000:0.0:1746140892.822341:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.822360:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574013312 00000100:00100000:2.0:1746140892.822363:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574013312 00000100:00100000:2.0:1746140892.822388:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17646 00000100:00100000:2.0:1746140892.822393:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:548:x1830960574013312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140892.822401:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.822517:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26a1 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.822537:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 12 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.822545:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 27 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.822556:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.822557:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.822560:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1306624->1699839] (req 1306624->1699839) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 27 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.822579:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 27 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.822589:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 27 pid: 4782 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.822598:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576162688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.822703:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 12 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.822710:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 12 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.822785:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576162816:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.822804:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.823858:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576162688:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.823868:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576162816:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.823934:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [1306624->1699839] (req 1306624->1699839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 27 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.823962:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fc600, rc 0) 00000100:00100000:2.0:1746140892.824001:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:548:x1830960574013312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1606us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.824008:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17646 00000100:00100000:0.0:1746140892.825496:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.825556:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574013440 00000100:00100000:2.0:1746140892.825564:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574013440 00010000:00010000:2.0:1746140892.825600:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 27 pid: 4782 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.825643:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9154 00000100:00100000:2.0:1746140892.825650:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960574013440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.825664:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.825683:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 27 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.825693:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 27 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.825714:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351a3000/0x8156357b7fdbbe14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25f2 expref: 27 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.825730:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.825778:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960574013440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.825785:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9154 00000100:00100000:0.0:1746140892.826349:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.826417:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574013568 00000100:00100000:2.0:1746140892.826424:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574013568 00010000:00010000:2.0:1746140892.826453:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 13 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.826491:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9155 00000100:00100000:2.0:1746140892.826497:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960574013568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.826507:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.826523:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 13 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.826534:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 13 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.826552:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092664200/0x8156357b7fdbbdf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25dd expref: 13 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.826568:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.826570:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.826576:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 25 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.826585:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 25 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.826615:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 25 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.826631:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576162944:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140892.826749:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.826777:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.826824:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574013696 00000100:00100000:2.0:1746140892.826828:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574013696 00000100:00100000:2.0:1746140892.826851:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17647 00000100:00100000:2.0:1746140892.826857:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:546:x1830960574013696:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746140892.826870:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.826881:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26a8 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.826899:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 16 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.826904:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.826905:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.826908:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [4194304->4358143] (req 4194304->4358143) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 9 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.826922:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 16 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.826930:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 16 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.826937:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576163072:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.826981:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7300 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.827781:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.827862:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576162944:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140892.827879:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.827904:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960574013568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1407us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.827906:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574013952 00000100:00100000:3.0:1746140892.827910:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4782:1830960576163072:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.827910:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574013952 00000100:00100000:2.0:1746140892.827911:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9155 00010000:00010000:3.0:1746140892.827939:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [4194304->4358143] (req 4194304->4358143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 9 pid: 4782 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746140892.827939:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1306624->1310719) req@ffff88012bf12d80 x1830960574013952/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.827958:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf12d80 with x1830960574013952 ext(1306624->1310719) 00002000:00010000:1.0:1746140892.827962:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf12d80 00010000:00010000:3.0:1746140892.827979:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fd200, rc 0) 00000100:00100000:1.0:1746140892.827987:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9065 00000100:00100000:1.0:1746140892.827993:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574013952:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140892.828138:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:546:x1830960574013696:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1279us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.828146:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17647 00000100:00100000:1.0:1746140892.828264:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574013952:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 271us (484us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.828269:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9065 00002000:00100000:1.0:1746140892.828274:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1306624->1310719) req@ffff88012bf12d80 x1830960574013952/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.828281:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf12d80 with x1830960574013952 ext(1306624->1310719) 00002000:00010000:1.0:1746140892.828284:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf12d80 00000100:00100000:0.0:1746140892.830013:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.830065:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574014080 00000100:00100000:2.0:1746140892.830071:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574014080 00010000:00010000:2.0:1746140892.830094:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 17 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.830125:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9156 00000100:00100000:2.0:1746140892.830130:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1983:x1830960574014080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.830139:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.830158:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 17 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.830168:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 17 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.830184:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbbf5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2685 expref: 17 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.830194:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.830196:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.830200:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 8 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.830210:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 8 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.830231:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 8 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.830243:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576163200:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140892.830325:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.832001:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.832059:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574014336 00000100:00100000:1.0:1746140892.832065:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574014336 00000100:00100000:2.0:1746140892.832088:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7111:1830960576163200:192.168.204.16@tcp:105: 00002000:00100000:1.0:1746140892.832095:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1695744->1699839) req@ffff88012bf12300 x1830960574014336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.832103:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf12300 with x1830960574014336 ext(1695744->1699839) 00010000:00010000:2.0:1746140892.832104:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746140892.832108:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf12300 00000100:00100000:2.0:1746140892.832130:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960574014080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2000us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.832134:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9066 00000100:00100000:2.0:1746140892.832137:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9156 00000100:00100000:1.0:1746140892.832141:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574014336:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746140892.832672:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574014336:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 531us (674us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746140892.832679:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9066 00002000:00100000:1.0:1746140892.832684:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a8:0x0] (1695744->1699839) req@ffff88012bf12300 x1830960574014336/t0(0) o3->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.832691:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf12300 with x1830960574014336 ext(1695744->1699839) 00002000:00010000:1.0:1746140892.832694:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf12300 00000100:00100000:0.0:1746140892.833200:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.833261:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574014592 00000100:00100000:1.0:1746140892.833264:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574014592 00002000:00100000:1.0:1746140892.833280:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (4354048->4358143) req@ffff88012bf11880 x1830960574014592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.833287:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11880 with x1830960574014592 ext(4354048->4358143) 00002000:00010000:1.0:1746140892.833290:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf11880 00000100:00100000:3.0:1746140892.833368:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9067 00000100:00100000:3.0:1746140892.833384:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960574014592:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746140892.833547:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960574014592:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 168us (346us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746140892.833554:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9067 00002000:00100000:3.0:1746140892.833560:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4354048->4358143) req@ffff88012bf11880 x1830960574014592/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.833570:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11880 with x1830960574014592 ext(4354048->4358143) 00002000:00010000:3.0:1746140892.833575:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bf11880 00000100:00100000:0.0:1746140892.835692:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.835790:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574014848 00000100:00100000:2.0:1746140892.835797:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574014848 00000100:00100000:2.0:1746140892.835898:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4825 00000100:00100000:2.0:1746140892.835906:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+22:546:x1830960574014848:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746140892.836192:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+23:546:x1830960574014848:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 287us (505us total) trans 8589945258 rc 0/0 00000100:00100000:2.0:1746140892.836199:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4825 00000100:00100000:0.0:1746140892.882427:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.882530:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574015104 00000100:00100000:3.0:1746140892.882539:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574015104 00000100:00100000:3.0:1746140892.882593:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10909 00000100:00100000:3.0:1746140892.882600:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+23:554:x1830960574015104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140892.882622:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.882639:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbbfbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26af expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.882761:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.882777:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.882786:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.882797:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.882803:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.882811:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.882915:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbfd4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.882924:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.882929:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140892.882937:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.883034:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883040:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883050:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883055:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.883059:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883065:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883076:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.883078:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.883082:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883086:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa400/0x8156357b7fdbbfc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883273:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883280:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883284:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883288:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fa000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.883290:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883295:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883371:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152100) 00010000:00010000:3.0:1746140892.883374:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.883376:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883381:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fa000/0x8156357b7fdbbfcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.883416:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb800/0x8156357b7fdbbfbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26af expref: 26 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.883431:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbfd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26af expref: 25 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.883438:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.883440:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746140892.883442:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fb200, rc 0) 00000100:00100000:3.0:1746140892.883497:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+25:554:x1830960574015104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 898us (1082us total) trans 8589945259 rc 0/0 00000100:00100000:3.0:1746140892.883504:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10909 00000100:00100000:0.0:1746140892.885377:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.885432:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574015232 00000100:00100000:3.0:1746140892.885440:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574015232 00000100:00100000:0.0:1746140892.885450:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.885481:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574015360 00000100:00100000:3.0:1746140892.885483:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574015360 00000100:00100000:0.0:1746140892.885484:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.885495:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574015488 00000100:00100000:3.0:1746140892.885497:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574015488 00000100:00100000:3.0:1746140892.885509:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17648 00000100:00100000:0.0:1746140892.885509:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.885515:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960574015232:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140892.885519:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17649 00000100:00100000:2.0:1746140892.885526:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960574015360:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746140892.885527:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574015616 00010000:00010000:3.0:1746140892.885529:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140892.885530:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574015616 00010000:00010000:2.0:1746140892.885534:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.885544:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbfe2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26b6 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.885546:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc800/0x8156357b7fdbbfe9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26bd expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.885555:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 802 00000100:00100000:0.0:1746140892.885560:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1983:x1830960574015616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.885567:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140892.885581:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fb200/0x8156357b7fdbbfd4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26af expref: 25 pid: 14741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140892.885587:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576163328:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140892.885587:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576163456:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746140892.885597:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140892.885600:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140892.885632:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1983:x1830960574015616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.885636:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17650 00000100:00100000:0.0:1746140892.885638:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 802 00000100:00100000:1.0:1746140892.885649:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960574015488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140892.885662:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140892.885666:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140892.885674:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752180 going to sleep for 11 seconds 00010000:00010000:1.0:1746140892.885675:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f190600/0x8156357b7fdbbff0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26c4 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.885714:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576163584:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140892.885782:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4d80 going to sleep for 11 seconds 00002000:00010000:2.0:1746140892.887219:0:32377:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime: 1746140892 -> 1746140893 00002000:00010000:2.0:1746140892.887226:0:32377:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime: 1746140892 -> 1746140893 00002000:00010000:2.0:1746140892.887228:0:32377:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime: 1746140892 -> 1746140893 00002000:00010000:3.0:1746140892.887230:0:4782:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime: 1746140892 -> 1746140893 00002000:00010000:3.0:1746140892.887234:0:4782:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime: 1746140892 -> 1746140893 00002000:00010000:3.0:1746140892.887236:0:4782:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime: 1746140892 -> 1746140893 00000100:00100000:2.0:1746140892.887247:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32377:1830960576163456:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746140892.887249:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576163328:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746140892.887269:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbfe2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26b6 expref: 15 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.887270:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc800/0x8156357b7fdbbfe9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26bd expref: 10 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.887281:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fbc00/0x8156357b7fdbbfe2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26b6 expref: 15 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.887281:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc800/0x8156357b7fdbbfe9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26bd expref: 10 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.887290:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50fbc00, rc 0) 00010000:00010000:2.0:1746140892.887318:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fc800, rc 0) 00000100:00100000:3.0:1746140892.887342:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960574015232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1826us (1969us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140892.887348:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1985:x1830960574015360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1822us (1897us total) trans 0 rc 301/301 00000100:00100000:3.0:1746140892.887350:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17648 00000100:00100000:2.0:1746140892.887354:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17649 00000100:00100000:1.0:1746140892.887384:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576163584:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140892.887400:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f190600/0x8156357b7fdbbff0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26c4 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.887410:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f190600/0x8156357b7fdbbff0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26c4 expref: 13 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.887428:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f190600, rc 0) 00000100:00100000:1.0:1746140892.887450:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960574015488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1806us (1965us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140892.887456:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17650 00000100:00100000:0.0:1746140892.892298:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.892406:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574015744 00000100:00100000:1.0:1746140892.892419:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574015744 00000100:00100000:1.0:1746140892.892483:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17651 00000100:00100000:1.0:1746140892.892492:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:554:x1830960574015744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140892.892508:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.892526:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26cb expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.892555:0:8458:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 25 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.892561:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140892.892563:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140892.892566:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 13 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.892596:0:8458:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 25 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.892611:0:8458:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 25 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.892622:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576163712:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.892723:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.893713:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8458:1830960576163712:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.893737:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 13 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.893749:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f190200, rc 0) 00000100:00100000:1.0:1746140892.893794:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:554:x1830960574015744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1303us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.893801:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17651 00000100:00100000:0.0:1746140892.894201:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.894252:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574015872 00000100:00100000:3.0:1746140892.894257:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574015872 00002000:00100000:3.0:1746140892.894286:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1306624->1699839) req@ffff88012bf11180 x1830960574015872/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.894295:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11180 with x1830960574015872 ext(1306624->1699839) 00010000:00010000:3.0:1746140892.894300:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 26 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.894342:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 26 pid: 4782 timeout: 971 lvb_type: 0 00002000:00010000:3.0:1746140892.894347:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bf11180 00000100:00100000:3.0:1746140892.894374:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1889 00000100:00100000:3.0:1746140892.894380:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1984:x1830960574015872:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746140892.898660:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960574015872:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4273us (4452us total) trans 17179874270 rc 0/0 00000100:00100000:3.0:1746140892.898671:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1889 00002000:00100000:3.0:1746140892.898681:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1306624->1699839) req@ffff88012bf11180 x1830960574015872/t17179874270(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.898688:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11180 with x1830960574015872 ext(1306624->1699839) 00010000:00010000:3.0:1746140892.898697:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 28 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.898709:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 28 pid: 4782 timeout: 971 lvb_type: 0 00002000:00010000:3.0:1746140892.898715:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bf11180 00000100:00100000:0.0:1746140892.899288:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.899346:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574016000 00000100:00100000:3.0:1746140892.899353:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574016000 00000100:00100000:3.0:1746140892.899396:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10910 00000100:00100000:3.0:1746140892.899403:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:555:x1830960574016000:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140892.899474:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.899489:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbbffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26d2 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.899538:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.899548:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.899557:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.899568:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.899573:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.899578:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.899658:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.899668:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 283 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.899674:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.899700:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 283 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.899713:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 283 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.899723:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576163840:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140892.899809:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752180 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.900243:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.900330:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574016128 00000100:00100000:2.0:1746140892.900336:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574016128 00010000:00010000:2.0:1746140892.900362:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 28 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.900405:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9157 00000100:00100000:2.0:1746140892.900413:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1982:x1830960574016128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.900430:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.900450:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 28 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.900461:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 28 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.900484:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fc600/0x8156357b7fdbbfb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1699839) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a1 expref: 28 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.900510:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.900512:0:7111:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.900519:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.900526:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.900602:0:7111:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.900621:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576163968:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140892.900677:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.900801:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.900803:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576163840:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140892.900818:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140892.900867:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574016384 00000100:00100000:2.0:1746140892.900872:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574016384 00000100:00100000:2.0:1746140892.900900:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4826 00000100:00100000:2.0:1746140892.900905:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:7723:x1830960574016384:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746140892.901081:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:7723:x1830960574016384:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 174us (280us total) trans 8589945260 rc 0/0 00000100:00100000:2.0:1746140892.901090:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4826 00000100:00100000:2.0:1746140892.902127:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7111:1830960576163968:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140892.902142:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.902183:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1982:x1830960574016128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1771us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.902190:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9157 00000100:00100000:0.0:1746140892.902703:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.902771:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574016512 00000100:00100000:2.0:1746140892.902776:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574016512 00010000:00010000:2.0:1746140892.902794:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 285 pid: 27790 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.902811:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9158 00000100:00100000:2.0:1746140892.902816:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1984:x1830960574016512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.902823:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.902828:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 285 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.902838:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 285 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.902855:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134953e00/0x8156357b7fdbbe7d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a261c expref: 285 pid: 27790 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.902867:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.902872:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.902880:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.902886:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.902913:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.902937:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:1984:x1830960574016512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.902942:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9158 00010000:00010000:3.0:1746140892.903010:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903018:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140892.903058:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140892.903062:0:14741:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140892.903077:0:14741:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903087:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903096:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903102:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903107:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903112:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc82000 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.903116:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903122:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903130:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140892.903132:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.903135:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903139:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82000/0x8156357b7fdbc005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903174:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903183:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903188:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903192:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc83600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140892.903195:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903200:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903207:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d152c00) 00010000:00010000:3.0:1746140892.903209:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140892.903212:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903216:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc00c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.903245:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbbffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.903257:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 9 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.903263:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.903265:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140892.903267:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83400, rc 0) 00000100:00100000:3.0:1746140892.903299:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:555:x1830960574016000:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3897us (4017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.903330:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10910 00000100:00100000:0.0:1746140892.903798:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.903867:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574016768 00000100:00100000:3.0:1746140892.903872:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574016768 00002000:00100000:3.0:1746140892.903897:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012bf11c00 x1830960574016768/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.903906:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11c00 with x1830960574016768 ext(1048576->2097151) 00002000:00010000:3.0:1746140892.903910:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf11c00 00000100:00100000:3.0:1746140892.903937:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9068 00000100:00100000:3.0:1746140892.903947:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960574016768:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140892.904474:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.904495:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.904556:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574016896 00000100:00100000:1.0:1746140892.904560:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574016896 00000100:00100000:1.0:1746140892.904576:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574017024 00000100:00100000:1.0:1746140892.904578:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574017024 00000100:00100000:1.0:1746140892.904591:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17652 00000100:00100000:1.0:1746140892.904595:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960574016896:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140892.904603:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.904613:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26d9 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.904628:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.904631:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.904636:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 7 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.904647:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 7 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.904654:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ac5e00, rc 0) 00000100:00100000:1.0:1746140892.904675:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960574016896:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.904679:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17652 00000100:00100000:1.0:1746140892.904690:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17653 00000100:00100000:1.0:1746140892.904694:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960574017024:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746140892.904700:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.904707:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdbc021 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26e0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.904738:0:8458:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099494380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576164096:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746140892.904777:0:8458:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.905020:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.905051:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.905821:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574017152 00000100:00100000:2.0:1746140892.905826:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574017152 00000100:00100000:2.0:1746140892.905861:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574017280 00000100:00100000:2.0:1746140892.905864:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574017280 00000100:00100000:2.0:1746140892.905885:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17654 00000100:00100000:2.0:1746140892.905891:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960574017152:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140892.905900:0:4186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.905909:0:4186:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc800/0x8156357b7fdbc028 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26e7 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.905926:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17655 00000100:00100000:2.0:1746140892.905937:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576164224:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746140892.905937:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960574017280:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746140892.905943:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140892.905961:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc02f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26ee expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.905983:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576164352:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746140892.905989:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.906002:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.906270:0:8458:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099494380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8458:1830960576164096:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140892.906291:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdbc021 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26e0 expref: 9 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.906330:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac5a00/0x8156357b7fdbc021 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26e0 expref: 9 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.906347:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ac5a00, rc 0) 00000100:00100000:1.0:1746140892.906369:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960574017024:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1673us (1872us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140892.906375:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17653 00000100:00100000:2.0:1746140892.909337:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4186:1830960576164224:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746140892.909370:0:4186:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc800/0x8156357b7fdbc028 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26e7 expref: 7 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.909390:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc800/0x8156357b7fdbc028 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26e7 expref: 7 pid: 4186 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.909400:0:4186:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fc800, rc 0) 00000100:00100000:2.0:1746140892.909439:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960574017152:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3547us (4419us total) trans 0 rc 301/301 00000100:00100000:2.0:1746140892.909447:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17654 00000100:00100000:1.0:1746140892.909455:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9872:1830960576164352:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746140892.909476:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc02f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26ee expref: 8 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.909487:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc02f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26ee expref: 8 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.909494:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2e9a00, rc 0) 00000100:00100000:1.0:1746140892.909516:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960574017280:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3585us (4464us total) trans 0 rc 301/301 00000100:00100000:1.0:1746140892.909521:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17655 00000100:00100000:3.0:1746140892.909909:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960574016768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5962us (6107us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.909921:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9068 00002000:00100000:3.0:1746140892.909930:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3a8:0x0] (1048576->2097151) req@ffff88012bf11c00 x1830960574016768/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.909939:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bf11c00 with x1830960574016768 ext(1048576->2097151) 00002000:00010000:3.0:1746140892.909944:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bf11c00 00000100:00100000:0.0:1746140892.910540:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.910579:0:14740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574017408 00000100:00100000:2.0:1746140892.910586:0:14740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574017408 00000100:00100000:2.0:1746140892.910620:0:14740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 222 00000100:00100000:2.0:1746140892.910626:0:14740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d247991d-e844-4b62-b954-6487bd25e6e9+15:1984:x1830960574017408:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746140892.910665:0:14740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d247991d-e844-4b62-b954-6487bd25e6e9+15:1984:x1830960574017408:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 40us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.910671:0:14740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 222 00000100:00100000:0.0:1746140892.912227:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.912344:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574017664 00000100:00100000:3.0:1746140892.912352:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574017664 00000100:00100000:3.0:1746140892.912395:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10911 00000100:00100000:3.0:1746140892.912401:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:555:x1830960574017664:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140892.912415:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.912435:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbc036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26f5 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.912529:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.912542:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.912549:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.912577:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.912587:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 10 pid: 14741 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.912603:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576164480:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.912610:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.912670:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574017792 00000100:00100000:1.0:1746140892.912675:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574017792 00000100:00100000:1.0:1746140892.912708:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17656 00000100:00100000:1.0:1746140892.912713:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+9:554:x1830960574017792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140892.912722:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.912732:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a26fc expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.912751:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 15 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.912758:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140892.912760:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746140892.912762:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 10 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.912777:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 15 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.912784:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 15 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.912792:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576164608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140892.912831:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752180 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.912831:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140892.914442:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576164480:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.914459:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140892.914463:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:1.0:1746140892.914531:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576164608:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.914535:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574017920 00000100:00100000:2.0:1746140892.914540:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574017920 00010000:00010000:1.0:1746140892.914551:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 10 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.914563:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092664c00, rc 0) 00010000:00010000:2.0:1746140892.914564:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 11 pid: 14741 timeout: 971 lvb_type: 0 00000100:00100000:2.0:1746140892.914599:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9159 00000100:00100000:1.0:1746140892.914599:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9944e31-822a-4286-b0f5-4880be82b6d9+10:554:x1830960574017792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1884us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.914605:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+11:1984:x1830960574017920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140892.914605:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17656 00010000:00010000:2.0:1746140892.914616:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.914621:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 11 pid: 14741 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.914634:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 11 pid: 14741 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.914807:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83400/0x8156357b7fdbc013 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d2 expref: 11 pid: 14741 timeout: 971 lvb_type: 0 00000100:00100000:0.0:1746140892.914828:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140892.914833:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.914837:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.914846:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.914852:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.914883:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140892.914939:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140892.914939:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28b972ba-4133-49d1-b679-ce80456803d9+10:1984:x1830960574017920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 324us (470us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140892.914946:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140892.914960:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9159 00000004:00200000:3.0:1746140892.914975:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.915140:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50fbc00/0x8156357b7fdbc036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26f5 expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.915166:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26f5 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.915172:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.915175:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746140892.915177:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83600, rc 0) 00000100:00100000:3.0:1746140892.915202:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:555:x1830960574017664:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2802us (2983us total) trans 8589945261 rc 0/0 00000100:00100000:3.0:1746140892.915208:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10911 00000100:00100000:3.0:1746140892.915235:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574018048 00000100:00100000:3.0:1746140892.915240:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574018048 00002000:00100000:3.0:1746140892.915265:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1212416->1753087) req@ffff88012b181c00 x1830960574018048/t0(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.915273:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181c00 with x1830960574018048 ext(1212416->1753087) 00010000:00010000:3.0:1746140892.915280:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 16 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.915290:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 16 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:3.0:1746140892.915296:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b181c00 00000100:00100000:3.0:1746140892.915340:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1890 00000100:00100000:3.0:1746140892.915347:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960574018048:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746140892.917211:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.917328:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574018304 00000100:00100000:3.0:1746140892.917337:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574018304 00000100:00100000:3.0:1746140892.917389:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10912 00000100:00100000:3.0:1746140892.917397:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+10:555:x1830960574018304:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746140892.917417:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.917421:0:14741:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746140892.917444:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc83600/0x8156357b7fdbc03d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26f5 expref: 10 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.917459:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.917464:0:14741:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140892.917473:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82800/0x8156357b7fdbc052 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2703 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.917568:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc059 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.917581:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc059 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.917589:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc059 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000004:00200000:3.0:1746140892.917599:0:14741:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:3.0:1746140892.917710:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82800/0x8156357b7fdbc052 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2703 expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.917721:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc059 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2703 expref: 11 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.917728:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.917730:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746140892.917732:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82a00, rc 0) 00000100:00100000:3.0:1746140892.917775:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:555:x1830960574018304:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 379us (572us total) trans 8589945262 rc 0/0 00000100:00100000:3.0:1746140892.917782:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10912 00000100:00100000:1.0:1746140892.919843:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.919901:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574018432 00000100:00100000:2.0:1746140892.919913:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574018432 00000100:00100000:2.0:1746140892.919983:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10913 00000100:00100000:2.0:1746140892.919991:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+11:555:x1830960574018432:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746140892.920011:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.920028:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fce00/0x8156357b7fdbc067 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a270a expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.920079:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fce00/0x8156357b7fdbc067 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a270a expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.920091:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fce00/0x8156357b7fdbc067 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a270a expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.920106:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.920109:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140892.920112:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fce00, rc 0) 00000100:00100000:2.0:1746140892.920173:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:555:x1830960574018432:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 183us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.920179:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10913 00000100:00100000:3.0:1746140892.921399:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1983:x1830960574018048:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6048us (6567us total) trans 21474841572 rc 0/0 00000100:00100000:3.0:1746140892.921409:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1890 00002000:00100000:3.0:1746140892.921419:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a2:0x0] (1212416->1753087) req@ffff88012b181c00 x1830960574018048/t21474841572(0) o4->64a7ece3-6daa-4cf2-9f70-0208ad105443@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.921429:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b181c00 with x1830960574018048 ext(1212416->1753087) 00010000:00010000:3.0:1746140892.921439:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 18 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.921454:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 18 pid: 9872 timeout: 971 lvb_type: 0 00002000:00010000:3.0:1746140892.921460:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b181c00 00000100:00100000:0.0:1746140892.921586:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.921605:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574018560 00000100:00100000:0.0:1746140892.921606:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.921614:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574018560 00000100:00100000:0.0:1746140892.921633:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.921658:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.922071:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574018688 00000100:00100000:3.0:1746140892.922077:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574018816 00000100:00100000:2.0:1746140892.922079:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574018944 00000100:00100000:1.0:1746140892.922081:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574018688 00000100:00100000:3.0:1746140892.922082:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574018816 00000100:00100000:2.0:1746140892.922084:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574018944 00000100:00100000:0.0:1746140892.922094:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.922105:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574019072 00000100:00100000:3.0:1746140892.922107:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574019072 00000100:00100000:1.0:1746140892.922130:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17657 00000100:00100000:2.0:1746140892.922136:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17658 00000100:00100000:1.0:1746140892.922138:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960574018560:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746140892.922143:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17659 00000100:00100000:2.0:1746140892.922147:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960574018816:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746140892.922149:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960574018688:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:0.0:1746140892.922149:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17660 00000100:00100000:0.0:1746140892.922159:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960574018944:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746140892.922174:0:4186:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.922174:0:9872:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922181:0:32377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.922181:0:24958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.922190:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.922190:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 17 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.922192:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746140892.922194:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 26 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.922196:0:24958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.922197:0:4186:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.922197:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.922201:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 8 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.922201:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746140892.922202:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.922203:0:4186:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.922203:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 9 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.922204:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.922205:0:4186:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.922208:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.922209:0:32377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 12 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.922209:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.922211:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922214:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.922215:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.922218:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.922232:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 8 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.922237:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 9 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.922238:0:24958:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 9 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922242:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 12 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.922242:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 8 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.922244:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 9 pid: 32377 timeout: 971 lvb_type: 1 00010000:00010000:3.0:1746140892.922251:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 12 pid: 4782 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.922253:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576164864:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.922254:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099494380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576164992:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140892.922254:0:24958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140892.922262:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576165120:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.922276:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17661 00000100:00100000:0.0:1746140892.922281:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1984:x1830960574019072:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746140892.922295:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.922332:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 9 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.922338:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140892.922339:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746140892.922341:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922348:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 8 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140892.922352:0:4186:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.922354:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 8 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140892.922355:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 9 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922356:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 8 pid: 4785 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.922362:0:4186:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.922362:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 9 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.922363:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 8 pid: 8460 timeout: 971 lvb_type: 1 00000100:00100000:3.0:1746140892.922364:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576165248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.922370:0:4186:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576165376:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.922371:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576165632:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.922372:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576165504:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140892.922392:0:32377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 26 pid: 4782 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140892.922397:0:4186:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7900 going to sleep for 11 seconds 00010000:00010000:3.0:1746140892.922401:0:32377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 26 pid: 4782 timeout: 971 lvb_type: 1 00000100:00100000:0.0:1746140892.922401:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744540 going to sleep for 11 seconds 00000100:00100000:3.0:1746140892.922409:0:32377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576165760:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.922414:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 17 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.922422:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 17 pid: 9872 timeout: 971 lvb_type: 1 00000100:00100000:3.0:1746140892.922426:0:32377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c752180 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.922429:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f518e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576165888:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.922440:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.922445:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140892.922465:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574019200 00000100:00100000:3.0:1746140892.922468:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574019200 00000100:00100000:3.0:1746140892.922499:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17662 00000100:00100000:3.0:1746140892.922504:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+9:1984:x1830960574019200:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746140892.922521:0:32376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922531:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922538:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 26 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922545:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 12 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922550:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746140892.922551:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746140892.922553:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922567:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 12 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922576:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.922589:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576166016:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140892.922632:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 26 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922640:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 26 pid: 8460 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.922648:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576166144:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140892.922670:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.922677:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:3.0:1746140892.922685:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576166272:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140892.922701:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140892.924486:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576164864:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.927706:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099494380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576164992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.927801:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.927833:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.927866:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.927913:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.927924:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576165120:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.927934:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574019328 00000100:00100000:1.0:1746140892.927940:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574019328 00010000:00010000:1.0:1746140892.927987:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 10 pid: 8458 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.927995:0:4186:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4186:1830960576165376:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140892.928011:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574019456 00000100:00100000:1.0:1746140892.928014:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574019456 00010000:00010000:2.0:1746140892.928021:0:4186:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.928025:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 18 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.928038:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574019584 00000100:00100000:1.0:1746140892.928040:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574019584 00000100:00100000:2.0:1746140892.928047:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574019712 00010000:00010000:1.0:1746140892.928048:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 11 pid: 4785 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.928052:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574019712 00000100:00100000:1.0:1746140892.928060:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9160 00000100:00100000:1.0:1746140892.928066:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+11:1985:x1830960574019328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.928074:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 10 pid: 32377 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.928078:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140892.928097:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9161 00010000:00010000:1.0:1746140892.928098:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 11 pid: 8458 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.928104:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1983:x1830960574019456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140892.928107:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 11 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.928116:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140892.928129:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ac5e00/0x8156357b7fdbc01a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26d9 expref: 11 pid: 8458 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.928140:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 18 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.928148:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140892.928151:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 18 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.928172:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351a2800/0x8156357b7fdbbf25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1212416->1753087) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2669 expref: 18 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.928182:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+10:1985:x1830960574019328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 115us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.928188:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9160 00010000:00010000:2.0:1746140892.928191:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.928193:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.928199:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 10 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.928203:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9162 00010000:00010000:2.0:1746140892.928207:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 10 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.928214:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9163 00000100:00100000:0.0:1746140892.928216:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+9:1983:x1830960574019584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140892.928220:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1984:x1830960574019712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.928224:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140892.928228:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576165248:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140892.928228:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.928234:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 10 pid: 9872 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140892.928236:0:8473:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2079 -> 2081 00002000:00010000:1.0:1746140892.928238:0:22044:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746140892.928240:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 9 pid: 4785 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.928243:0:7109:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 10 pid: 9872 timeout: 972 lvb_type: 0 00010000:00010000:1.0:1746140892.928243:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 10 pid: 32377 timeout: 971 lvb_type: 1 00010000:00010000:0.0:1746140892.928248:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 9 pid: 4785 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.928251:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 10 pid: 32377 timeout: 971 lvb_type: 1 00010000:00010000:0.0:1746140892.928259:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4d000/0x8156357b7fdbbd65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2574 expref: 9 pid: 4785 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.928260:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576166400:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746140892.928263:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fcb4600/0x8156357b7fdbbc2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24b7 expref: 10 pid: 32377 timeout: 971 lvb_type: 1 00010000:00010000:0.0:1746140892.928272:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140892.928273:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140892.928287:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960574019712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.928292:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9163 00000100:00100000:0.0:1746140892.928301:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28b972ba-4133-49d1-b679-ce80456803d9+8:1983:x1830960574019584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.928328:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9162 00000100:00100000:1.0:1746140892.928351:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.928368:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12255:1830960576165632:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140892.928382:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.928569:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2ab7900 going to sleep for 11 seconds 00000100:00100000:3.0:1746140892.928639:0:21688:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574019840 00000100:00100000:3.0:1746140892.928643:0:21688:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574019840 00000100:00100000:1.0:1746140892.928664:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746140892.928675:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4358143) req@ffff88009f7ab480 x1830960574019840/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140892.928683:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574019968 00002000:00100000:3.0:1746140892.928684:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ab480 with x1830960574019840 ext(4194304->4358143) 00000100:00100000:2.0:1746140892.928686:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574019968 00000100:00100000:1.0:1746140892.928686:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140892.928689:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 9 pid: 4782 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.928698:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 9 pid: 4782 timeout: 972 lvb_type: 0 00002000:00010000:3.0:1746140892.928704:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7ab480 00010000:00010000:2.0:1746140892.928706:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 13 pid: 4782 timeout: 971 lvb_type: 1 00000100:00100000:3.0:1746140892.928716:0:21688:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1891 00000100:00100000:2.0:1746140892.928718:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574020096 00000100:00100000:2.0:1746140892.928720:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574020096 00000100:00100000:3.0:1746140892.928726:0:21688:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1984:x1830960574019840:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:2.0:1746140892.928728:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 14 pid: 8458 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.928738:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576165504:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.928745:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9164 00000100:00100000:2.0:1746140892.928749:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1982:x1830960574019968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.928756:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.928763:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 14 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.928770:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 14 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.928781:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256e800/0x8156357b7fdbbc31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24be expref: 14 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.928789:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.928804:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1982:x1830960574019968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.928811:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9164 00000100:00100000:2.0:1746140892.928820:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9165 00000100:00100000:2.0:1746140892.928824:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a490a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960574020096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.928829:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.928911:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.928920:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.928930:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f190200/0x8156357b7fdbbff7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26cb expref: 12 pid: 8458 timeout: 971 lvb_type: 0 00010000:00010000:2.0:1746140892.928937:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.928939:0:7110:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.928941:0:7110:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.928959:0:7110:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.928975:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.929066:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576166144:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140892.929082:0:32377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:32377:1830960576165760:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.929098:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a490a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960574020096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 272us (410us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140892.929101:0:32377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.929103:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9165 00010000:00010000:2.0:1746140892.929118:0:4186:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.929125:0:4186:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.929144:0:4186:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.929150:0:4186:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.929157:0:4186:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.929163:0:4186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d2fd000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140892.929167:0:4186:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.929173:0:4186:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.929181:0:4186:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.929186:0:4186:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fd000/0x8156357b7fdbc06e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4186 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.929343:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f518e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576165888:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140892.929363:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.929367:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960574018816:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7221us (7733us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140892.929370:0:9872:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.929374:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17658 00000100:00100000:0.0:1746140892.929374:0:7110:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574020224 00000100:00100000:0.0:1746140892.929376:0:7110:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574020224 00010000:00010000:0.0:1746140892.929390:0:7110:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 9 pid: 8460 timeout: 971 lvb_type: 1 00000100:00100000:1.0:1746140892.929401:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.929402:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9166 00000100:00100000:0.0:1746140892.929407:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+9:1982:x1830960574020224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140892.929409:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574020480 00000100:00100000:2.0:1746140892.929411:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574020480 00010000:00010000:0.0:1746140892.929414:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140892.929417:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140892.929421:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 27 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:0.0:1746140892.929424:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 9 pid: 8460 timeout: 971 lvb_type: 1 00000100:00100000:1.0:1746140892.929428:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574020736 00000100:00100000:1.0:1746140892.929431:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574020736 00010000:00010000:0.0:1746140892.929431:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 9 pid: 8460 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.929440:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9167 00010000:00010000:0.0:1746140892.929441:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936f0600/0x8156357b7fdbbd50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a256d expref: 9 pid: 8460 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.929444:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 18 pid: 9872 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.929445:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1983:x1830960574020480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.929450:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140892.929451:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746140892.929458:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9168 00010000:00010000:2.0:1746140892.929459:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 27 pid: 8460 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.929463:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1982:x1830960574020736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140892.929465:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28b972ba-4133-49d1-b679-ce80456803d9+8:1982:x1830960574020224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (104us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140892.929466:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 27 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.929471:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140892.929474:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9166 00010000:00010000:2.0:1746140892.929476:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee3c400/0x8156357b7fdbbdff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25d6 expref: 27 pid: 8460 timeout: 971 lvb_type: 0 00010000:00010000:1.0:1746140892.929482:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 18 pid: 9872 timeout: 971 lvb_type: 1 00010000:00010000:2.0:1746140892.929484:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140892.929490:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 18 pid: 9872 timeout: 971 lvb_type: 1 00000100:00100000:2.0:1746140892.929496:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1983:x1830960574020480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.929501:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9167 00010000:00010000:1.0:1746140892.929503:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a8de00/0x8156357b7fdbbbb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a247f expref: 18 pid: 9872 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.929513:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.929514:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.929518:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.929518:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140892.929524:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.929532:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574020608 00000100:00100000:2.0:1746140892.929535:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574020608 00000100:00100000:0.0:1746140892.929539:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140892.929540:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746140892.929549:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3715072->4194303) req@ffff88009f782300 x1830960574020608/t0(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.929556:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f782300 with x1830960574020608 ext(3715072->4194303) 00010000:00010000:2.0:1746140892.929561:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 11 pid: 4782 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.929561:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1982:x1830960574020736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.929567:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9168 00010000:00010000:2.0:1746140892.929568:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 11 pid: 4782 timeout: 972 lvb_type: 0 00002000:00010000:2.0:1746140892.929573:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f782300 00000100:00100000:1.0:1746140892.929578:0:9847:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574020352 00000100:00100000:1.0:1746140892.929580:0:9847:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574020352 00000100:00100000:2.0:1746140892.929584:0:21694:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1892 00000100:00100000:0.0:1746140892.929584:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.929588:0:21694:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960574020608:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746140892.929590:0:9847:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 26 pid: 4782 timeout: 971 lvb_type: 1 00000100:00100000:0.0:1746140892.929595:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574020864 00000100:00100000:0.0:1746140892.929597:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574020864 00000100:00100000:1.0:1746140892.929606:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9169 00010000:00010000:0.0:1746140892.929607:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00000100:00100000:1.0:1746140892.929610:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574020352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140892.929616:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140892.929621:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9170 00010000:00010000:1.0:1746140892.929625:0:9847:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 26 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.929633:0:9847:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 26 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.929643:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e4da00/0x8156357b7fdbbbba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2486 expref: 26 pid: 4782 timeout: 971 lvb_type: 1 00010000:00010000:1.0:1746140892.929651:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.929652:0:9847:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.929654:0:9847:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929660:0:9847:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929670:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140892.929684:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960574020352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.929737:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576166016:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140892.929745:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576166272:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140892.929760:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.929763:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960574020864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140892.929771:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.929774:0:32377:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.929777:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.929780:0:32377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.929785:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.929791:0:32377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.929795:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351a2000/0x8156357b7fdbbed1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a264d expref: 12 pid: 9872 timeout: 971 lvb_type: 0 00010000:00010000:3.0:1746140892.929797:0:32377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.929802:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140892.929803:0:32377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.929808:0:32377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50fb400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140892.929811:0:32377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.929816:0:32377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.929816:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960574020864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (232us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140892.929824:0:32377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.929834:0:32377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50fb400/0x8156357b7fdbc07c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.929841:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9169 00010000:00010000:1.0:1746140892.929857:0:9872:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929863:0:9872:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140892.929867:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960574018688:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7719us (8261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.929873:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17659 00010000:00010000:1.0:1746140892.929878:0:9872:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929884:0:9872:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929891:0:9872:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929896:0:9872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094617600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140892.929899:0:9872:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929905:0:9872:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929913:0:9872:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.929918:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094617600/0x8156357b7fdbc075 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.929918:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9170 00000100:00100000:1.0:1746140892.930017:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:28b972ba-4133-49d1-b679-ce80456803d9+7:1984:x1830960574018560:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 7880us (8432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.930025:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17657 00000100:00100000:2.0:1746140892.930861:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7109:1830960576166400:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140892.930873:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.930905:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1983:x1830960574019456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2801us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.930911:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9161 00000100:00100000:0.0:1746140892.932365:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.932446:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574021120 00000100:00100000:2.0:1746140892.932453:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574021120 00002000:00100000:2.0:1746140892.932485:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a51cd500 x1830960574021120/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.932494:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cd500 with x1830960574021120 ext(1048576->2097151) 00010000:00010000:2.0:1746140892.932501:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 11 pid: 9872 timeout: 972 lvb_type: 0 00010000:00010000:2.0:1746140892.932518:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 11 pid: 9872 timeout: 972 lvb_type: 0 00002000:00010000:2.0:1746140892.932525:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cd500 00000100:00100000:2.0:1746140892.932544:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1893 00000100:00100000:2.0:1746140892.932549:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1985:x1830960574021120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.933282:0:21688:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960574019840:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4558us (4928us total) trans 21474841573 rc 0/0 00000100:00100000:3.0:1746140892.933290:0:21688:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1891 00002000:00100000:3.0:1746140892.933297:0:21688:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4358143) req@ffff88009f7ab480 x1830960574019840/t21474841573(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.933323:0:21688:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7ab480 with x1830960574019840 ext(4194304->4358143) 00010000:00010000:3.0:1746140892.933331:0:21688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 13 pid: 4782 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.933339:0:21688:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 13 pid: 4782 timeout: 972 lvb_type: 0 00002000:00010000:3.0:1746140892.933345:0:21688:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7ab480 00000100:00100000:0.0:1746140892.935837:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.937340:0:21694:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960574020608:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7740us (7810us total) trans 17179874271 rc 0/0 00000100:00100000:2.0:1746140892.937353:0:21694:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1892 00002000:00100000:2.0:1746140892.937365:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3a9:0x0] (3715072->4194303) req@ffff88009f782300 x1830960574020608/t17179874271(0) o4->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/448 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.937374:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f782300 with x1830960574020608 ext(3715072->4194303) 00010000:00010000:2.0:1746140892.937383:0:21694:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 972 lvb_type: 0 00010000:00010000:2.0:1746140892.937395:0:21694:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 972 lvb_type: 0 00002000:00010000:2.0:1746140892.937401:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f782300 00000100:00100000:3.0:1746140892.937451:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574021248 00000100:00100000:3.0:1746140892.937487:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574021248 00010000:00010000:3.0:1746140892.937521:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 13 pid: 4782 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140892.937550:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9171 00000100:00100000:3.0:1746140892.937557:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960574021248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.937569:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.937590:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 13 pid: 4782 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.937600:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 13 pid: 4782 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.937620:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fd200/0x8156357b7fdbbfb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4358143) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26a8 expref: 13 pid: 4782 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.937635:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.937637:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.937641:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.937654:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.937709:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.937757:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960574021248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 200us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.937763:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9171 00010000:00010000:0.0:1746140892.937810:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.937819:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.937839:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.937852:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.937859:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.937864:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2e9c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140892.937868:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.937875:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.937884:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.937890:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9c00/0x8156357b7fdbc08a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.937938:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28b972ba-4133-49d1-b679-ce80456803d9+6:1984:x1830960574019072:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 15657us (15845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.937946:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17661 00000100:00100000:2.0:1746140892.938908:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a9944e31-822a-4286-b0f5-4880be82b6d9+10:1985:x1830960574021120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6353us (6542us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140892.938917:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1893 00002000:00100000:2.0:1746140892.938923:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a2:0x0] (1048576->2097151) req@ffff8800a51cd500 x1830960574021120/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.938933:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51cd500 with x1830960574021120 ext(1048576->2097151) 00010000:00010000:2.0:1746140892.939361:0:21692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 10 pid: 9872 timeout: 972 lvb_type: 0 00010000:00010000:2.0:1746140892.939375:0:21692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 10 pid: 9872 timeout: 972 lvb_type: 0 00002000:00010000:2.0:1746140892.939381:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51cd500 00000100:00100000:0.0:1746140892.940360:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.940412:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574021376 00000100:00100000:3.0:1746140892.940420:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574021376 00010000:00010000:3.0:1746140892.940450:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140892.940481:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9172 00000100:00100000:3.0:1746140892.940488:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4909850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960574021376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.940500:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.940520:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.940530:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.940548:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d2fde00/0x8156357b7fdbbfaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3715072->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a269a expref: 12 pid: 4782 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.940560:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.940562:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.940565:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.940572:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.940604:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.940640:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4909850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960574021376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.940646:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9172 00010000:00010000:0.0:1746140892.940651:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.940660:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.940680:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.940686:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.940693:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.940698:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a53ada00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140892.940702:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.940708:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.940723:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.940729:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a53ada00/0x8156357b7fdbc091 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.940785:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960574019200:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 18279us (18343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.940792:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17662 00000100:00100000:0.0:1746140892.944501:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.944538:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.944570:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.944584:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.944672:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574021504 00000100:00100000:2.0:1746140892.944683:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574021504 00000100:00100000:3.0:1746140892.944693:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574021632 00000100:00100000:1.0:1746140892.944693:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574021888 00000100:00100000:3.0:1746140892.944700:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574021632 00000100:00100000:1.0:1746140892.944700:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574021888 00000100:00100000:2.0:1746140892.944731:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574021760 00000100:00100000:2.0:1746140892.944734:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574021760 00000100:00100000:0.0:1746140892.944747:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.944874:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.944890:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574022016 00000100:00100000:1.0:1746140892.944894:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574022016 00000100:00100000:3.0:1746140892.944897:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17663 00000100:00100000:3.0:1746140892.944904:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960574021504:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746140892.944918:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17664 00010000:00010000:3.0:1746140892.944921:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140892.944927:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960574021888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140892.944938:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdbc098 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2711 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.944940:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574022144 00010000:00010000:2.0:1746140892.944943:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746140892.944943:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574022144 00010000:00010000:2.0:1746140892.944965:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc600/0x8156357b7fdbc09f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2726 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140892.944977:0:32377:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x821 00010000:00010000:2.0:1746140892.944987:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.944992:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.944993:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.944998:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc600/0x8156357b7fdbc09f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2726 expref: 14 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.945002:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdbc098 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2711 expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140892.945003:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17665 00010000:00010000:2.0:1746140892.945010:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fc600/0x8156357b7fdbc09f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2726 expref: 14 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746140892.945010:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960574021632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140892.945016:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdbc098 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2711 expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140892.945019:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140892.945025:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fc600, rc 0) 00010000:00010000:3.0:1746140892.945026:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41b4000, rc 0) 00010000:00010000:1.0:1746140892.945030:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4943600/0x8156357b7fdbc0a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2718 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140892.945046:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x821 00010000:00010000:1.0:1746140892.945056:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.945057:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140892.945062:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4943600/0x8156357b7fdbc0a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2718 expref: 14 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140892.945070:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960574021504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 166us (579us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140892.945073:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4943600/0x8156357b7fdbc0a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2718 expref: 14 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140892.945076:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17663 00000100:00100000:2.0:1746140892.945076:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960574021888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 150us (503us total) trans 0 rc 301/301 00010000:00010000:1.0:1746140892.945081:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4943600, rc 0) 00000100:00100000:2.0:1746140892.945083:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17664 00000100:00100000:3.0:1746140892.945093:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17666 00000100:00100000:3.0:1746140892.945098:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960574021760:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746140892.945102:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960574021632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 93us (564us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140892.945103:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140892.945104:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17667 00000100:00100000:1.0:1746140892.945109:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17665 00000100:00100000:2.0:1746140892.945111:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960574022016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140892.945112:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a41b4600/0x8156357b7fdbc0ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a271f expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.945118:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746140892.945122:0:32377:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fedd, atime: 0x6813fedc, ctime: 0x6813fedd, blocks: 0x821 00010000:00010000:2.0:1746140892.945126:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbc0b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a272d expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.945128:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.945130:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.945134:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a41b4600/0x8156357b7fdbc0ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a271f expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.945142:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a41b4600/0x8156357b7fdbc0ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a271f expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746140892.945145:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x158d 00010000:00010000:3.0:1746140892.945148:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41b4600, rc 0) 00010000:00010000:2.0:1746140892.945153:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.945154:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.945160:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbc0b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a272d expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140892.945161:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960574021760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.945166:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17666 00010000:00010000:2.0:1746140892.945172:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbc0b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a272d expref: 12 pid: 32376 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746140892.945176:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17668 00010000:00010000:2.0:1746140892.945179:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fdc00, rc 0) 00000100:00100000:3.0:1746140892.945181:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1984:x1830960574022144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746140892.945185:0:32377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140892.945192:0:32377:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a41b4e00/0x8156357b7fdbc0bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2734 expref: -99 pid: 32377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140892.945196:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960574022016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.945202:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17667 00002000:00010000:3.0:1746140892.945203:0:32377:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x1029 00010000:00010000:3.0:1746140892.945209:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.945210:0:32377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140892.945214:0:32377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a41b4e00/0x8156357b7fdbc0bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2734 expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.945223:0:32377:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a41b4e00/0x8156357b7fdbc0bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2734 expref: 14 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140892.945230:0:32377:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41b4e00, rc 0) 00000100:00100000:3.0:1746140892.945245:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960574022144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.945250:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17668 00000100:00100000:0.0:1746140892.945277:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.945329:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574022272 00000100:00100000:2.0:1746140892.945333:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574022272 00010000:00010000:2.0:1746140892.945347:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 12 pid: 9872 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.945370:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9173 00000100:00100000:2.0:1746140892.945375:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1982:x1830960574022272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.945384:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.945394:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 12 pid: 9872 timeout: 972 lvb_type: 0 00010000:00010000:2.0:1746140892.945409:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 12 pid: 9872 timeout: 972 lvb_type: 0 00010000:00010000:2.0:1746140892.945422:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092664c00/0x8156357b7fdbc044 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a26fc expref: 12 pid: 9872 timeout: 972 lvb_type: 0 00010000:00010000:2.0:1746140892.945434:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.945435:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140892.945438:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.945446:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.945474:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140892.945500:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1982:x1830960574022272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 125us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.945505:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9173 00010000:00010000:0.0:1746140892.945649:0:24958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.945659:0:24958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.945681:0:24958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.945693:0:24958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.945700:0:24958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.945706:0:24958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2e9a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:0.0:1746140892.945710:0:24958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.945717:0:24958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.945729:0:24958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.945735:0:24958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2e9a00/0x8156357b7fdbc083 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140892.946431:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:28b972ba-4133-49d1-b679-ce80456803d9+5:1984:x1830960574018944:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 23629us (24126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.946441:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17660 00000100:00100000:0.0:1746140892.947739:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.947817:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574022528 00000100:00100000:2.0:1746140892.947827:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574022528 00000100:00100000:2.0:1746140892.947888:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10914 00000100:00100000:2.0:1746140892.947896:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+12:555:x1830960574022528:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:2.0:1746140892.947937:0:14741:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140892.947972:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fce00/0x8156357b7fdbc067 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a270a expref: 12 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.947989:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.947993:0:14741:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140892.948018:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.948029:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 23 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948035:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 23 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948041:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 283 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948047:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 283 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948052:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 23 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948058:0:14741:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 283 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948069:0:14741:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.948096:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 283 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948107:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 283 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.948124:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576166528:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.948222:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 23 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948231:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 23 pid: 14785 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.948238:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576166656:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.948261:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 283 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948268:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 283 pid: 14785 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.948274:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576166784:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.948294:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 283 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948342:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 283 pid: 14741 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.948349:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576166912:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.948385:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 23 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948506:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 23 pid: 14741 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.948513:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576167040:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.948538:0:14741:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 23 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140892.948544:0:14741:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 23 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.948550:0:14741:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576167168:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.948565:0:14741:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4bcc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746140892.950109:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.950139:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.950157:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.950167:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574022656 00000100:00100000:3.0:1746140892.950168:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574022784 00000100:00100000:3.0:1746140892.950173:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574022784 00000100:00100000:2.0:1746140892.950173:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574022656 00000100:00100000:0.0:1746140892.950190:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140892.950199:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 284 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.950200:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 24 pid: 14785 timeout: 972 lvb_type: 0 00000100:00100000:0.0:1746140892.950215:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.950230:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574023168 00000100:00100000:2.0:1746140892.950232:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574023168 00000100:00100000:3.0:1746140892.950235:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574023296 00000100:00100000:3.0:1746140892.950238:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574023296 00000100:00100000:0.0:1746140892.950241:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9174 00010000:00010000:2.0:1746140892.950242:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 285 pid: 14741 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.950248:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 25 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:1.0:1746140892.950251:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9175 00000100:00100000:0.0:1746140892.950254:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1982:x1830960574022656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140892.950256:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9176 00000100:00100000:2.0:1746140892.950260:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1984:x1830960574023168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746140892.950261:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960574022784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140892.950265:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140892.950265:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746140892.950266:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9177 00010000:00010000:2.0:1746140892.950269:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 285 pid: 14741 timeout: 972 lvb_type: 0 00010000:00010000:0.0:1746140892.950269:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 285 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140892.950271:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1985:x1830960574023296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140892.950272:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.950277:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140892.950277:0:7110:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 25 pid: 14785 timeout: 972 lvb_type: 0 00010000:00010000:2.0:1746140892.950279:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 285 pid: 14741 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.950282:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 25 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:0.0:1746140892.950286:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 285 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:1.0:1746140892.950295:0:7110:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 25 pid: 14785 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.950326:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 25 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:2.0:1746140892.950342:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140892.950346:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.950353:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140892.950364:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140892.950366:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:0.0:1746140892.950371:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140892.950372:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140892.950375:0:7110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140892.950379:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746140892.950380:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00000100:00100000:2.0:1746140892.950380:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1984:x1830960574023168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.950381:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:1982:x1830960574022656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (277us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140892.950383:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140892.950385:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9176 00000100:00100000:0.0:1746140892.950388:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9174 00010000:00010000:3.0:1746140892.950392:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140892.950394:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+25:1982:x1830960574022784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 137us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.950398:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9175 00000100:00100000:2.0:1746140892.950405:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574023040 00000100:00100000:2.0:1746140892.950408:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574023040 00000100:00100000:3.0:1746140892.950409:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960574023296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 138us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.950414:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9177 00000100:00100000:2.0:1746140892.950423:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4827 00000100:00100000:2.0:1746140892.950426:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae1b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+284:27093:x1830960574023040:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746140892.950469:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.950500:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574023424 00000100:00100000:3.0:1746140892.950504:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574023424 00010000:00010000:3.0:1746140892.950514:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 24 pid: 14741 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140892.950530:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9178 00000100:00100000:3.0:1746140892.950534:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960574023424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.950540:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.950543:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 24 pid: 14741 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.950550:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 24 pid: 14741 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.950565:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.950568:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.950573:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.950588:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+24:1985:x1830960574023424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140892.950589:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae1b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+285:27093:x1830960574023040:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 161us (430us total) trans 8589945263 rc 0/0 00000100:00100000:3.0:1746140892.950593:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9178 00000100:00100000:2.0:1746140892.950595:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4827 00010000:00010000:2.0:1746140892.950642:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351a3800/0x8156357b7fdbbef4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a265b expref: 284 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.950649:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576166528:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.950655:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5f2c00/0x8156357b7fdbbdb9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a25ac expref: 23 pid: 14785 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.950659:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576166656:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140892.950664:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576166784:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.950667:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f200/0x8156357b7fdbbc8c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24f6 expref: 283 pid: 14741 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.950671:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b181880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576166912:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.950675:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009071b600/0x8156357b7fdbbc85 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24ef expref: 22 pid: 14741 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.950680:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576167040:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.950683:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e79800/0x8156357b7fdbbc7e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a24e8 expref: 21 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140892.950688:0:14741:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14741:1830960576167168:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140892.950708:0:14741:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140892.953459:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.953542:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574023552 00000100:00100000:3.0:1746140892.953555:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574023552 00010000:00010000:3.0:1746140892.953585:0:7111:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 283 pid: 14785 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140892.953616:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9179 00000100:00100000:3.0:1746140892.953623:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4909c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+283:1982:x1830960574023552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140892.953637:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140892.953642:0:7111:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 283 pid: 14785 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.953653:0:7111:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 283 pid: 14785 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.953673:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b8dea00/0x8156357b7fdbbd81 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2597 expref: 283 pid: 14785 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140892.953686:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.953691:0:7111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.953700:0:7111:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.953707:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.953733:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140892.953771:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4909c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+282:1982:x1830960574023552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 148us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.953778:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9179 00010000:00010000:2.0:1746140892.953902:0:14741:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140892.953917:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140892.954517:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.954558:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.955144:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.955168:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.955486:0:21694:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574023808 00000100:00100000:2.0:1746140892.955496:0:21694:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574023808 00002000:00100000:2.0:1746140892.955543:0:21694:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88012d082d80 x1830960574023808/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746140892.955547:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574024064 00002000:00100000:2.0:1746140892.955552:0:21694:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082d80 with x1830960574023808 ext(2097152->3145727) 00000100:00100000:3.0:1746140892.955553:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574024064 00002000:00010000:2.0:1746140892.955558:0:21694:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d082d80 00002000:00100000:3.0:1746140892.955582:0:21692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012d081f80 x1830960574024064/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746140892.955582:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574024320 00000100:00100000:2.0:1746140892.955585:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574024320 00002000:00100000:3.0:1746140892.955591:0:21692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d081f80 with x1830960574024064 ext(3145728->4194303) 00002000:00010000:3.0:1746140892.955595:0:21692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d081f80 00002000:00100000:2.0:1746140892.955599:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012d083b80 x1830960574024320/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.955606:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d083b80 with x1830960574024320 ext(2097152->3145727) 00002000:00010000:2.0:1746140892.955609:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d083b80 00000100:00100000:2.0:1746140892.955617:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574024448 00000100:00100000:2.0:1746140892.955619:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574024448 00000100:00100000:3.0:1746140892.955621:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9069 00000100:00100000:3.0:1746140892.955627:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960574023808:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746140892.955629:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880093131500 x1830960574024448/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.955635:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131500 with x1830960574024448 ext(3145728->4194303) 00002000:00010000:2.0:1746140892.955637:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093131500 00000100:00100000:2.0:1746140892.955651:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9070 00000100:00100000:2.0:1746140892.955659:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1984:x1830960574024064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746140892.955776:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9071 00000100:00100000:1.0:1746140892.955782:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9072 00000100:00100000:0.0:1746140892.955789:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960574024320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.955790:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960574024448:12345-192.168.204.16@tcp:3:cat.0 00000040:00080000:2.0:1746140892.956291:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3566, 88 off302480 00000004:00080000:2.0:1746140892.956298:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872031992660ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956364:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3580, 88 off303896 00000004:00080000:2.0:1746140892.956368:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872032063459ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140892.956379:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3581, 88 off303984 00000004:00080000:2.0:1746140892.956382:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872032077310ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140892.956389:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3567, 88 off302568 00000004:00080000:2.0:1746140892.956391:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872032086440ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956397:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3568, 88 off302656 00000004:00080000:2.0:1746140892.956399:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872032093837ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956404:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3582, 88 off304072 00000004:00080000:2.0:1746140892.956406:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872032101580ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140892.956413:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3583, 88 off304160 00000004:00080000:2.0:1746140892.956415:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872032110652ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140892.956423:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3584, 88 off304248 00000004:00080000:2.0:1746140892.956426:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872032121150ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140892.956435:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3569, 88 off302744 00000004:00080000:2.0:1746140892.956437:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872032132662ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956443:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3585, 88 off304336 00000004:00080000:2.0:1746140892.956445:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872032139825ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140892.956449:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3570, 88 off302832 00000004:00080000:2.0:1746140892.956451:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872032146369ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956456:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3586, 88 off304424 00000004:00080000:2.0:1746140892.956458:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872032153397ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140892.956463:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3571, 88 off302920 00000004:00080000:2.0:1746140892.956466:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872032161765ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956472:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3572, 88 off303008 00000004:00080000:2.0:1746140892.956474:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872032169182ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956505:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3574, 88 off303192 00000004:00080000:2.0:1746140892.956508:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872032203245ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956514:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3575, 88 off303280 00000004:00080000:2.0:1746140892.956517:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872032211975ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140892.956523:0:14741:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3587, 88 off304512 00000004:00080000:2.0:1746140892.956525:0:14741:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872032220152ns, next at 809142599738ns, rc = 0 00000100:00100000:3.0:1746140892.965884:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+13:1985:x1830960574023808:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10247us (11357us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.965901:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9069 00002000:00100000:3.0:1746140892.965912:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (2097152->3145727) req@ffff88012d082d80 x1830960574023808/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.965920:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d082d80 with x1830960574023808 ext(2097152->3145727) 00002000:00010000:3.0:1746140892.965925:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d082d80 00000100:00100000:0.0:1746140892.967742:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960574024064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12076us (13175us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746140892.967753:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9070 00002000:00100000:0.0:1746140892.967762:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88012d081f80 x1830960574024064/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140892.967772:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d081f80 with x1830960574024064 ext(3145728->4194303) 00002000:00010000:0.0:1746140892.967777:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d081f80 00000100:00100000:1.0:1746140892.968118:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1985:x1830960574024320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12334us (12972us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.968125:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9071 00002000:00100000:1.0:1746140892.968131:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88012d083b80 x1830960574024320/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.968138:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d083b80 with x1830960574024320 ext(2097152->3145727) 00002000:00010000:1.0:1746140892.968141:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d083b80 00000100:00100000:2.0:1746140892.968834:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1984:x1830960574024448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13043us (13663us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140892.968841:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9072 00002000:00100000:2.0:1746140892.968847:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff880093131500 x1830960574024448/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.968854:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093131500 with x1830960574024448 ext(3145728->4194303) 00002000:00010000:2.0:1746140892.968857:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093131500 00000100:00100000:0.0:1746140892.969890:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140892.970119:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574024704 00000100:00100000:1.0:1746140892.970127:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574024704 00000100:00100000:1.0:1746140892.970177:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10915 00000100:00100000:1.0:1746140892.970184:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+21:554:x1830960574024704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746140892.970203:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140892.970221:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a273b expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.970279:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140892.970289:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a273b expref: 22 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.970327:0:27790:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:1.0:1746140892.970340:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a273b expref: 22 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.970352:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:1.0:1746140892.970356:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140892.970359:0:27790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a273b expref: 22 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140892.970366:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4942400, rc 0) 00000100:00100000:1.0:1746140892.970403:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+22:554:x1830960574024704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 217us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140892.970409:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10915 00000001:00080000:0.0:1746140892.974834:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945245 is committed 00000001:00080000:0.0:1746140892.974845:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945237 is committed 00000001:00080000:0.0:1746140892.974848:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945229 is committed 00000001:00080000:0.0:1746140892.974854:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945242 is committed 00000001:00080000:0.0:1746140892.974856:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945264 is committed 00000004:00080000:0.0:1746140892.974859:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2828 committed 00000004:00080000:0.0:1746140892.974867:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2819 committed 00000004:00080000:0.0:1746140892.974871:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2818 committed 00000004:00080000:0.0:1746140892.974872:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2817 committed 00000004:00080000:0.0:1746140892.974873:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2816 committed 00000004:00010000:2.0:1746140892.974874:0:14741:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b890e00 reply state ffff880093de4800 transno 8589945264 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00000004:00080000:0.0:1746140892.974874:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2827 committed 00000004:00080000:0.0:1746140892.974876:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2815 committed 00000004:00080000:0.0:1746140892.974877:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2826 committed 00000004:00080000:0.0:1746140892.974878:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2814 committed 00000004:00080000:0.0:1746140892.974879:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2825 committed 00000004:00080000:0.0:1746140892.974880:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2824 committed 00000004:00080000:0.0:1746140892.974880:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2823 committed 00000004:00080000:0.0:1746140892.974881:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2813 committed 00000004:00080000:0.0:1746140892.974882:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2812 committed 00000004:00080000:0.0:1746140892.974883:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2822 committed 00000004:00080000:0.0:1746140892.974885:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2821 committed 00000100:00100000:2.0:1746140892.974886:0:14741:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1746140892.974887:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2811 committed 00000001:00080000:0.0:1746140892.974894:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945263 is committed 00000001:00080000:0.0:1746140892.974898:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945258 is committed 00000001:00080000:0.0:1746140892.974944:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945259 is committed 00000100:00100000:1.0:1746140892.974995:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576167296:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746140892.975009:0:14741:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746140892.975021:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:555:x1830960574022528:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 27124us (27283us total) trans 8589945264 rc 0/0 00000100:00100000:2.0:1746140892.975028:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10914 00010000:00010000:3.0:1746140892.975033:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.975043:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14741 initiator: MDT0 00000100:00100000:1.0:1746140892.975048:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746140892.975052:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.975057:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d2fd800 already unused, calling callback (ffffffffa1368690) 00000100:00100000:0.0:1746140892.975058:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576167552:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746140892.975062:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.975070:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14741 initiator: MDT0 00000100:00100000:0.0:1746140892.975077:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140892.975079:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576167808:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746140892.975087:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00000100:00100000:0.0:1746140892.975089:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576168064:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746140892.975091:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140892.975096:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a273b expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.975097:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746140892.975106:0:3297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a273b expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.975116:0:3297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a273b expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140892.975136:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f51a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576167424:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746140892.975142:0:3297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a273b expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140892.975151:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3297:1830960576169344:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746140892.975158:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140892.975171:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576167936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140892.975185:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140892.975186:0:3297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746140892.975194:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576168448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140892.975198:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576167296 00000100:00100000:2.0:1746140892.975199:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576167552 00000100:00100000:3.0:1746140892.975203:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576167296 00000100:00100000:2.0:1746140892.975204:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576167552 00000100:00100000:1.0:1746140892.975208:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140892.975218:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576168960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140892.975219:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576167808 00000100:00100000:0.0:1746140892.975222:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576167808 00000100:00100000:1.0:1746140892.975230:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140892.975239:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576167424 00000100:00100000:2.0:1746140892.975239:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576167936 00000100:00100000:2.0:1746140892.975241:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576167936 00000100:00100000:3.0:1746140892.975242:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576167424 00000100:00100000:0.0:1746140892.975244:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576168448 00000100:00100000:1.0:1746140892.975245:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746140892.975245:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576168448 00000100:00100000:1.0:1746140892.975249:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576168320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140892.975254:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576168960 00000100:00100000:2.0:1746140892.975256:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576168960 00000100:00100000:1.0:1746140892.975262:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140892.975263:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17669 00000100:00100000:0.0:1746140892.975267:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17670 00000100:00100000:3.0:1746140892.975269:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3310:x1830960576167296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140892.975269:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576168832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140892.975270:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576168320 00000100:00100000:0.0:1746140892.975271:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3312:x1830960576167552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140892.975272:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576168320 00000100:00100000:1.0:1746140892.975280:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140892.975282:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17671 00000100:00100000:3.0:1746140892.975284:0:32377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576168832 00000100:00100000:3.0:1746140892.975287:0:32377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576168832 00000100:00100000:2.0:1746140892.975287:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3310:x1830960576167808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140892.975293:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576167680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140892.975297:0:32377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17672 00000100:00100000:3.0:1746140892.975301:0:32377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+9:3311:x1830960576167936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140892.975325:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140892.975333:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576168192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140892.975334:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576167680 00000100:00100000:2.0:1746140892.975337:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576167680 00000100:00100000:1.0:1746140892.975346:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140892.975346:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17673 00000100:00100000:2.0:1746140892.975351:0:4186:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576168192 00000100:00100000:1.0:1746140892.975352:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576168704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140892.975352:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3311:x1830960576167424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140892.975353:0:4186:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576168192 00000100:00100000:2.0:1746140892.975361:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17674 00000100:00100000:1.0:1746140892.975363:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140892.975366:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3311:x1830960576168448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140892.975369:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576169216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140892.975381:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140892.975396:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576168704 00000100:00100000:1.0:1746140892.975399:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576168704 00000100:00100000:1.0:1746140892.975410:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576169216 00000100:00100000:1.0:1746140892.975412:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576169216 00000100:00100000:1.0:1746140892.975419:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17675 00000100:00100000:1.0:1746140892.975423:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3311:x1830960576168960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140892.975450:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17676 00002000:00010000:0.0:1746140892.975453:0:8459:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140892.975456:0:8459:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00000100:00100000:3.0:1746140892.975457:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3311:x1830960576168320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140892.975458:0:8459:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140892 -> 1746140892 00002000:00010000:0.0:1746140892.975460:0:8459:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140892.975462:0:8459:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140892.975486:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3311:x1830960576167424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (327us total) trans 17179874273 rc 0/0 00000100:00100000:2.0:1746140892.975491:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3311:x1830960576168448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (280us total) trans 21474841574 rc 0/0 00000100:00100000:0.0:1746140892.975491:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17673 00000100:00100000:2.0:1746140892.975497:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17674 00000100:00100000:0.0:1746140892.975502:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17677 00000100:00100000:0.0:1746140892.975507:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3311:x1830960576168832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140892.975508:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17678 00000100:00100000:2.0:1746140892.975513:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3313:x1830960576167680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140892.975533:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3311:x1830960576168960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (301us total) trans 21474841575 rc 0/0 00000100:00100000:1.0:1746140892.975539:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17675 00000100:00100000:1.0:1746140892.975550:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17679 00000100:00100000:1.0:1746140892.975554:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3313:x1830960576168192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140892.975591:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3311:x1830960576168832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (309us total) trans 21474841576 rc 0/0 00000100:00100000:0.0:1746140892.975596:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17677 00002000:00010000:3.0:1746140892.975597:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746140892.975600:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140891 -> 1746140891 00002000:00010000:3.0:1746140892.975602:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140891 -> 1746140891 00002000:00010000:3.0:1746140892.975604:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140891 -> 1746140891 00002000:00010000:3.0:1746140892.975606:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140892.975606:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17680 00000100:00100000:2.0:1746140892.975621:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3313:x1830960576167680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (294us total) trans 17179874274 rc 0/0 00000100:00100000:2.0:1746140892.975626:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17678 00000100:00100000:3.0:1746140892.975630:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3311:x1830960576168320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (366us total) trans 21474841577 rc 0/0 00000100:00100000:2.0:1746140892.975635:0:4186:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17681 00000100:00100000:3.0:1746140892.975637:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17676 00000100:00100000:2.0:1746140892.975639:0:4186:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3313:x1830960576169216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140892.975642:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3313:x1830960576168192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (293us total) trans 17179874275 rc 0/0 00000100:00100000:1.0:1746140892.975647:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17679 00000100:00100000:0.0:1746140892.975705:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3313:x1830960576168704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140892.975711:0:4186:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3313:x1830960576169216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (328us total) trans 21474841578 rc 0/0 00000100:00100000:1.0:1746140892.975711:0:3313:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874263 gen 2 00000100:00100000:2.0:1746140892.975715:0:4186:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17681 00000004:00080000:1.0:1746140892.975715:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d2b100, transno 17179874146 00000004:00080000:1.0:1746140892.975720:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f173100, transno 17179874147 00000004:00080000:1.0:1746140892.975723:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d28e00, transno 17179874148 00000004:00080000:1.0:1746140892.975725:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f173480, transno 17179874149 00000004:00080000:1.0:1746140892.975728:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d28000, transno 17179874150 00000004:00080000:1.0:1746140892.975730:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eeabb80, transno 17179874151 00000004:00080000:1.0:1746140892.975732:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f172a00, transno 17179874152 00000004:00080000:1.0:1746140892.975735:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d29f80, transno 17179874153 00000004:00080000:1.0:1746140892.975741:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f098000, transno 17179874154 00000004:00080000:1.0:1746140892.975744:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f098380, transno 17179874155 00000004:00080000:1.0:1746140892.975746:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f098e00, transno 17179874156 00002000:00010000:3.0:1746140892.975747:0:8460:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746140892.975749:0:8460:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140891 -> 1746140891 00000004:00080000:1.0:1746140892.975749:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f099180, transno 17179874157 00000004:00080000:1.0:1746140892.975750:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f098700, transno 17179874158 00002000:00010000:3.0:1746140892.975751:0:8460:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140891 -> 1746140891 00000004:00080000:1.0:1746140892.975752:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f099500, transno 17179874159 00002000:00010000:3.0:1746140892.975753:0:8460:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140891 -> 1746140891 00002000:00010000:3.0:1746140892.975754:0:8460:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:1.0:1746140892.975756:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f098a80, transno 17179874160 00000004:00080000:1.0:1746140892.975758:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f099880, transno 17179874161 00000004:00080000:1.0:1746140892.975760:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7dc00, transno 17179874163 00000004:00080000:1.0:1746140892.975763:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7ca80, transno 17179874164 00000004:00080000:1.0:1746140892.975765:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7d500, transno 17179874165 00000004:00080000:1.0:1746140892.975767:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7c000, transno 17179874166 00000004:00080000:1.0:1746140892.975769:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7d180, transno 17179874167 00000004:00080000:1.0:1746140892.975771:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7d880, transno 17179874168 00000100:00100000:3.0:1746140892.975773:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3310:x1830960576167296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 505us (726us total) trans 17179874276 rc 0/0 00000004:00080000:1.0:1746140892.975774:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7ce00, transno 17179874169 00000004:00080000:1.0:1746140892.975776:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7df80, transno 17179874170 00000100:00100000:3.0:1746140892.975778:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17669 00000004:00080000:1.0:1746140892.975779:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc08380, transno 17179874171 00000004:00080000:1.0:1746140892.975781:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093132300, transno 17179874172 00000004:00080000:1.0:1746140892.975783:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abbaa00, transno 17179874173 00000004:00080000:1.0:1746140892.975786:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abba300, transno 17179874174 00000004:00080000:1.0:1746140892.975788:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc09c00, transno 17179874175 00000004:00080000:1.0:1746140892.975790:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abbad80, transno 17179874176 00000004:00080000:1.0:1746140892.975792:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc09500, transno 17179874177 00000004:00080000:1.0:1746140892.975795:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abb8700, transno 17179874178 00000004:00080000:1.0:1746140892.975798:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cc380, transno 17179874193 00000004:00080000:1.0:1746140892.975800:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cd880, transno 17179874194 00000004:00080000:1.0:1746140892.975802:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cc000, transno 17179874195 00000004:00080000:1.0:1746140892.975807:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d2a300, transno 17179874196 00000004:00080000:1.0:1746140892.975809:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ce300, transno 17179874197 00000004:00080000:1.0:1746140892.975811:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cc700, transno 17179874198 00000004:00080000:1.0:1746140892.975813:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ce680, transno 17179874199 00000004:00080000:1.0:1746140892.975815:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51cea00, transno 17179874200 00000004:00080000:1.0:1746140892.975818:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b2680, transno 17179874201 00000004:00080000:1.0:1746140892.975820:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bc700, transno 17179874202 00000004:00080000:1.0:1746140892.975822:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b0000, transno 17179874203 00000004:00080000:1.0:1746140892.975824:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1edf80, transno 17179874204 00000004:00080000:1.0:1746140892.975827:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b1180, transno 17179874205 00000004:00080000:1.0:1746140892.975829:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b1500, transno 17179874206 00000004:00080000:1.0:1746140892.975831:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1eed80, transno 17179874207 00000004:00080000:1.0:1746140892.975833:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801359b2d80, transno 17179874208 00000100:00100000:2.0:1746140892.975834:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3310:x1830960576167808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 546us (735us total) trans 17179874277 rc 0/0 00000004:00080000:1.0:1746140892.975835:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7aa300, transno 17179874209 00000004:00080000:1.0:1746140892.975838:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a8000, transno 17179874210 00000100:00100000:2.0:1746140892.975839:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17671 00000004:00080000:1.0:1746140892.975839:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a8380, transno 17179874211 00000004:00080000:1.0:1746140892.975841:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a9180, transno 17179874212 00000004:00080000:1.0:1746140892.975843:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a9500, transno 17179874213 00000100:00100000:3.0:1746140892.975844:0:32377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3311:x1830960576167936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 542us (658us total) trans 17179874272 rc 0/0 00000004:00080000:1.0:1746140892.975845:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a8700, transno 17179874214 00000004:00080000:1.0:1746140892.975847:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7a8a80, transno 17179874215 00000100:00100000:0.0:1746140892.975848:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3313:x1830960576168704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 237us (483us total) trans 21474841579 rc 0/0 00000100:00100000:3.0:1746140892.975850:0:32377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17672 00000004:00080000:1.0:1746140892.975850:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f7abb80, transno 17179874216 00000004:00080000:1.0:1746140892.975852:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6df80, transno 17179874219 00000004:00080000:1.0:1746140892.975854:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6d500, transno 17179874220 00000100:00100000:0.0:1746140892.975854:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17680 00000004:00080000:1.0:1746140892.975856:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6d180, transno 17179874221 00000004:00080000:1.0:1746140892.975858:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6ce00, transno 17179874222 00000004:00080000:1.0:1746140892.975860:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6f100, transno 17179874223 00000004:00080000:1.0:1746140892.975863:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092613800, transno 17179874224 00000004:00080000:1.0:1746140892.975865:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092610380, transno 17179874225 00000004:00080000:1.0:1746140892.975867:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6f800, transno 17179874226 00000004:00080000:1.0:1746140892.975870:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55e3100, transno 17179874227 00000004:00080000:1.0:1746140892.975872:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55e0000, transno 17179874228 00000004:00080000:1.0:1746140892.975874:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0c380, transno 17179874229 00000004:00080000:1.0:1746140892.975875:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0ea00, transno 17179874230 00000004:00080000:1.0:1746140892.975877:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55e0380, transno 17179874231 00000004:00080000:1.0:1746140892.975878:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55e0e00, transno 17179874232 00000004:00080000:1.0:1746140892.975880:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55e1c00, transno 17179874233 00000004:00080000:1.0:1746140892.975882:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e0c700, transno 17179874234 00000004:00080000:1.0:1746140892.975884:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c2d80, transno 17179874235 00000004:00080000:1.0:1746140892.975886:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c1f80, transno 17179874236 00000004:00080000:1.0:1746140892.975889:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c3b80, transno 17179874237 00000004:00080000:1.0:1746140892.975892:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f078000, transno 17179874238 00000004:00080000:1.0:1746140892.975894:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c3100, transno 17179874239 00000004:00080000:1.0:1746140892.975897:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c0a80, transno 17179874240 00000004:00080000:1.0:1746140892.975899:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c3480, transno 17179874241 00000004:00080000:1.0:1746140892.975901:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f078e00, transno 17179874242 00002000:00010000:2.0:1746140892.975902:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746140892.975903:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746140892.975904:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00000004:00080000:1.0:1746140892.975904:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b756d80, transno 17179874248 00000004:00080000:1.0:1746140892.975906:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b757100, transno 17179874249 00002000:00010000:2.0:1746140892.975907:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140892.975908:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140893 -> 1746140893 00000004:00080000:1.0:1746140892.975908:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b754a80, transno 17179874250 00002000:00010000:2.0:1746140892.975911:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000004:00080000:1.0:1746140892.975911:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b755f80, transno 17179874251 00000004:00080000:1.0:1746140892.975914:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b755500, transno 17179874252 00000004:00080000:1.0:1746140892.975916:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b757b80, transno 17179874253 00000100:00100000:0.0:1746140892.975916:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576168576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140892.975919:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b755880, transno 17179874254 00000004:00080000:1.0:1746140892.975921:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b757480, transno 17179874255 00000004:00080000:1.0:1746140892.975923:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc35c00, transno 17179874256 00000004:00080000:1.0:1746140892.975925:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc35500, transno 17179874257 00000004:00080000:1.0:1746140892.975927:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094450a80, transno 17179874258 00000100:00100000:2.0:1746140892.975928:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3312:x1830960576167552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 657us (850us total) trans 17179874278 rc 0/0 00000004:00080000:1.0:1746140892.975930:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094452a00, transno 17179874259 00000100:00100000:2.0:1746140892.975932:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17670 00000004:00080000:1.0:1746140892.975933:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094453100, transno 17179874260 00000100:00100000:0.0:1746140892.975934:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746140892.975935:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094451880, transno 17179874261 00000004:00080000:1.0:1746140892.975937:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc36d80, transno 17179874262 00000004:00080000:1.0:1746140892.975939:0:3313:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc35f80, transno 17179874263 00000100:00100000:2.0:1746140892.975940:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576168064 00000100:00100000:2.0:1746140892.975942:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576168064 00000100:00100000:0.0:1746140892.975944:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576169088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140892.975945:0:3313:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880099494380 x1830960576167680/t17179874274(17179874274) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746140908 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746140892.975964:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099494380/2, rc 0, transno 17179874274 00000100:00100000:1.0:1746140892.975968:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576167680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140892.975969:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576168576 00000100:00100000:2.0:1746140892.975971:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576168576 00000100:00100000:0.0:1746140892.975975:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140892.975977:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17682 00000100:00100000:3.0:1746140892.975983:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3312:x1830960576168064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140892.975984:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576169088 00000100:00100000:2.0:1746140892.975985:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576169088 00000004:00080000:0.0:1746140892.975993:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f519180/2, rc 0, transno 17179874278 00000100:00100000:2.0:1746140892.975995:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17683 00000100:00100000:0.0:1746140892.975997:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576167552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140892.975999:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3312:x1830960576168576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140892.976010:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17684 00000100:00100000:0.0:1746140892.976016:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3312:x1830960576169088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140892.976064:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960576168064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (160us total) trans 17179874279 rc 0/0 00000100:00100000:3.0:1746140892.976068:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17682 00002000:00010000:2.0:1746140892.976072:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:2.0:1746140892.976075:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140892.976077:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140892.976079:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140892.976081:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5517 -> 5517 00000100:00100000:2.0:1746140892.976100:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960576168576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (165us total) trans 21474841580 rc 0/0 00000100:00100000:2.0:1746140892.976105:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17683 00000100:00100000:2.0:1746140892.976161:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.976176:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3312:x1830960576169088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (199us total) trans 21474841581 rc 0/0 00000100:00100000:3.0:1746140892.976177:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574024832 00000100:00100000:3.0:1746140892.976179:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574024832 00000100:00100000:0.0:1746140892.976181:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17684 00000100:00100000:3.0:1746140892.976201:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10916 00000004:00080000:0.0:1746140892.976203:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abbb800/2, rc 0, transno 17179874279 00000100:00100000:3.0:1746140892.976205:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:555:x1830960574024832:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746140892.976206:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576168064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140892.976214:0:3312:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841568 gen 2 00010000:00010000:3.0:1746140892.976217:0:14741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:0.0:1746140892.976217:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a513d180, transno 21474841430 00000100:00100000:2.0:1746140892.976224:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3297:1830960576169344:192.168.204.16@tcp:105: 00000004:00080000:0.0:1746140892.976224:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea8a80, transno 21474841431 00010000:00010000:3.0:1746140892.976227:0:14741:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2a00/0x8156357b7fdbc0d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2742 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746140892.976227:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6e300, transno 21474841432 00000004:00080000:0.0:1746140892.976229:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b1b0e00, transno 21474841433 00000004:00080000:0.0:1746140892.976231:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b1b0700, transno 21474841434 00000004:00080000:0.0:1746140892.976233:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b1b1500, transno 21474841435 00010000:00010000:2.0:1746140892.976236:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14741 initiator: MDT0 00000004:00080000:0.0:1746140892.976236:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6c380, transno 21474841436 00010000:00010000:2.0:1746140892.976243:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fd800/0x8156357b7fdbc0c2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14741 initiator: MDT0 00010000:00010000:3.0:1746140892.976264:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2a00/0x8156357b7fdbc0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2742 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.976274:0:14741:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2a00/0x8156357b7fdbc0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2742 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140892.976293:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:3.0:1746140892.976296:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746140892.976298:0:14741:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363f2a00, rc 0) 00000100:00100000:3.0:1746140892.976334:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:555:x1830960574024832:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 127us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.976339:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10916 00000004:00080000:0.0:1746140892.976397:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099497800, transno 21474841437 00000004:00080000:0.0:1746140892.976401:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6fb80, transno 21474841438 00000004:00080000:0.0:1746140892.976404:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f099c00, transno 21474841439 00000004:00080000:0.0:1746140892.976406:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f09aa00, transno 21474841440 00000004:00080000:0.0:1746140892.976408:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f09ad80, transno 21474841441 00000004:00080000:0.0:1746140892.976410:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f09a300, transno 21474841442 00000004:00080000:0.0:1746140892.976412:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f09b100, transno 21474841443 00000004:00080000:0.0:1746140892.976414:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f09a680, transno 21474841444 00000004:00080000:0.0:1746140892.976416:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f09b480, transno 21474841445 00000004:00080000:0.0:1746140892.976419:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f099f80, transno 21474841446 00000004:00080000:0.0:1746140892.976421:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1edc00, transno 21474841447 00000004:00080000:0.0:1746140892.976423:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7e300, transno 21474841451 00000004:00080000:0.0:1746140892.976425:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7fb80, transno 21474841452 00000004:00080000:0.0:1746140892.976427:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7f480, transno 21474841453 00000004:00080000:0.0:1746140892.976429:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7e680, transno 21474841454 00000004:00080000:0.0:1746140892.976430:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7f800, transno 21474841455 00000004:00080000:0.0:1746140892.976432:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7ea00, transno 21474841456 00000004:00080000:1.0:1746140892.976434:0:14789:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 96 done 00000004:00080000:0.0:1746140892.976434:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7f100, transno 21474841457 00000004:00080000:0.0:1746140892.976436:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7ed80, transno 21474841458 00000004:00080000:0.0:1746140892.976438:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948f9c00, transno 21474841459 00000004:00080000:0.0:1746140892.976440:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f783480, transno 21474841460 00000004:00080000:0.0:1746140892.976442:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f780a80, transno 21474841461 00000004:00080000:0.0:1746140892.976445:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f780e00, transno 21474841462 00000004:00080000:0.0:1746140892.976447:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece1500, transno 21474841463 00000100:00100000:2.0:1746140892.976448:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00080000:0.0:1746140892.976451:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece3b80, transno 21474841464 00000004:00080000:1.0:1746140892.976452:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abb8a80/2, rc 0, transno 17179874277 00000004:00080000:0.0:1746140892.976453:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f783b80, transno 21474841465 00000004:00080000:0.0:1746140892.976455:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ece2680, transno 21474841466 00000100:00100000:1.0:1746140892.976456:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576167808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140892.976458:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f781f80, transno 21474841467 00000004:00080000:0.0:1746140892.976460:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f2c0700, transno 21474841468 00000004:00080000:0.0:1746140892.976462:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d28700, transno 21474841485 00000004:00080000:0.0:1746140892.976464:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d29880, transno 21474841486 00000004:00080000:1.0:1746140892.976465:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f518e00/2, rc 0, transno 17179874276 00000004:00080000:0.0:1746140892.976467:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bf480, transno 21474841487 00000100:00100000:1.0:1746140892.976468:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576167296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746140892.976470:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7c380, transno 21474841488 00000004:00080000:0.0:1746140892.976472:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354be680, transno 21474841489 00000004:00080000:0.0:1746140892.976474:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe7c700, transno 21474841490 00000004:00080000:0.0:1746140892.976476:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d2b800, transno 21474841491 00000004:00080000:0.0:1746140892.976478:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bd180, transno 21474841492 00000004:00080000:0.0:1746140892.976481:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801354bed80, transno 21474841493 00000004:00080000:0.0:1746140892.976483:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ee300, transno 21474841494 00000004:00080000:0.0:1746140892.976485:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1efb80, transno 21474841495 00000004:00080000:0.0:1746140892.976488:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ed880, transno 21474841496 00000004:00080000:0.0:1746140892.976490:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ec380, transno 21474841497 00000004:00080000:0.0:1746140892.976493:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ed500, transno 21474841498 00000004:00080000:0.0:1746140892.976495:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ec000, transno 21474841499 00000004:00080000:0.0:1746140892.976497:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1eca80, transno 21474841500 00000004:00080000:0.0:1746140892.976499:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ee680, transno 21474841501 00000004:00080000:0.0:1746140892.976501:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ec700, transno 21474841502 00000004:00080000:0.0:1746140892.976503:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ed180, transno 21474841503 00000004:00080000:0.0:1746140892.976506:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07a300, transno 21474841504 00000004:00080000:0.0:1746140892.976508:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f078a80, transno 21474841505 00000004:00080000:0.0:1746140892.976510:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ef100, transno 21474841506 00000004:00080000:0.0:1746140892.976513:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f078700, transno 21474841507 00000100:00100000:3.0:1746140892.976515:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574024960 00000004:00080000:0.0:1746140892.976515:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07aa00, transno 21474841508 00000004:00080000:0.0:1746140892.976518:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ef800, transno 21474841509 00000004:00080000:0.0:1746140892.976521:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f07b100, transno 21474841510 00000100:00100000:3.0:1746140892.976522:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574024960 00000004:00080000:0.0:1746140892.976523:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1ef480, transno 21474841511 00000004:00080000:0.0:1746140892.976525:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093131880, transno 21474841513 00000004:00080000:0.0:1746140892.976527:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093132d80, transno 21474841514 00000004:00080000:0.0:1746140892.976530:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092613480, transno 21474841515 00000004:00080000:0.0:1746140892.976532:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093132a00, transno 21474841516 00000004:00080000:0.0:1746140892.976534:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093133100, transno 21474841517 00000004:00080000:0.0:1746140892.976536:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093133b80, transno 21474841518 00000004:00080000:0.0:1746140892.976539:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d080380, transno 21474841519 00000004:00080000:0.0:1746140892.976541:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092610e00, transno 21474841520 00000004:00080000:0.0:1746140892.976543:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093130700, transno 21474841521 00000100:00100000:3.0:1746140892.976544:0:21104:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4828 00000004:00080000:0.0:1746140892.976546:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eeaad80, transno 21474841522 00000004:00080000:0.0:1746140892.976548:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea8700, transno 21474841523 00000100:00100000:3.0:1746140892.976549:0:21104:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:554:x1830960574024960:12345-192.168.204.16@tcp:49:cat.0 00000004:00080000:0.0:1746140892.976550:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea9f80, transno 21474841524 00000004:00080000:0.0:1746140892.976552:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eeaa300, transno 21474841525 00000004:00080000:0.0:1746140892.976554:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eeab480, transno 21474841526 00000004:00080000:0.0:1746140892.976556:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eeaaa00, transno 21474841527 00000004:00080000:0.0:1746140892.976558:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea8e00, transno 21474841528 00000004:00080000:0.0:1746140892.976560:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eea8380, transno 21474841529 00000004:00080000:0.0:1746140892.976562:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c1880, transno 21474841530 00000004:00080000:0.0:1746140892.976565:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adc380, transno 21474841531 00000004:00080000:0.0:1746140892.976567:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55e1500, transno 21474841532 00000004:00080000:0.0:1746140892.976570:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094add180, transno 21474841533 00000004:00080000:0.0:1746140892.976572:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adc700, transno 21474841534 00000004:00080000:0.0:1746140892.976574:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adc000, transno 21474841535 00000004:00080000:0.0:1746140892.976576:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adca80, transno 21474841536 00000004:00080000:0.0:1746140892.976579:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55e1180, transno 21474841537 00000004:00080000:0.0:1746140892.976581:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094adf100, transno 21474841538 00000004:00080000:0.0:1746140892.976584:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab6ed80, transno 21474841539 00000004:00080000:0.0:1746140892.976586:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06aa00, transno 21474841551 00000004:00080000:0.0:1746140892.976589:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b069880, transno 21474841552 00000004:00080000:0.0:1746140892.976592:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba7b80, transno 21474841553 00000004:00080000:0.0:1746140892.976594:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b069180, transno 21474841554 00000004:00080000:0.0:1746140892.976596:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a513df80, transno 21474841555 00000004:00080000:0.0:1746140892.976599:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a513ce00, transno 21474841556 00000004:00080000:0.0:1746140892.976601:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d081880, transno 21474841557 00000004:00080000:0.0:1746140892.976603:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06b800, transno 21474841558 00000004:00080000:0.0:1746140892.976606:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a513c700, transno 21474841559 00000004:00080000:0.0:1746140892.976608:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba6a00, transno 21474841560 00000004:00080000:0.0:1746140892.976611:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06ad80, transno 21474841561 00000004:00080000:0.0:1746140892.976613:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094450000, transno 21474841562 00000004:00080000:0.0:1746140892.976615:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba4700, transno 21474841563 00000004:00080000:0.0:1746140892.976617:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094af4e00, transno 21474841564 00000004:00080000:0.0:1746140892.976619:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba7800, transno 21474841565 00000004:00080000:0.0:1746140892.976622:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b06b480, transno 21474841566 00000004:00080000:0.0:1746140892.976624:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ba4a80, transno 21474841567 00000004:00080000:0.0:1746140892.976626:0:3312:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc0a680, transno 21474841568 00000100:00100000:0.0:1746140892.976631:0:3312:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880135699180 x1830960576168576/t21474841580(21474841580) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746140908 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746140892.976639:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135699180/2, rc 0, transno 21474841580 00000004:00080000:1.0:1746140892.976641:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093132680/2, rc 0, transno 21474841577 00000100:00100000:0.0:1746140892.976642:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576168576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140892.976645:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576168320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140892.976654:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094addf80/2, rc 0, transno 21474841581 00000004:00080000:1.0:1746140892.976656:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ade680/2, rc 0, transno 21474841576 00000100:00100000:0.0:1746140892.976657:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576169088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140892.976659:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576168832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140892.976665:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f51a300/2, rc 0, transno 17179874273 00000100:00100000:1.0:1746140892.976668:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f51a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576167424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140892.976674:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abb9500/2, rc 0, transno 17179874272 00000100:00100000:1.0:1746140892.976676:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576167936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140892.976681:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093133800/2, rc 0, transno 21474841574 00000100:00100000:1.0:1746140892.976683:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576168448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140892.976687:0:3311:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094add500/2, rc 0, transno 21474841575 00000100:00100000:1.0:1746140892.976689:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576168960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140892.976700:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abb9f80/2, rc 0, transno 17179874275 00000100:00100000:1.0:1746140892.976702:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576168192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140892.976707:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094adf480/2, rc 0, transno 21474841579 00000100:00100000:1.0:1746140892.976709:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576168704:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140892.976715:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094add880/2, rc 0, transno 21474841578 00000100:00100000:1.0:1746140892.976718:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576169216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746140892.976839:0:21104:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+7:554:x1830960574024960:12345-192.168.204.16@tcp:49:cat.0 Request processed in 288us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140892.976851:0:21104:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4828 00000004:00080000:0.0:1746140892.977102:0:14783:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 108 done 00000100:00100000:1.0:1746140892.977169:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576169472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140892.977189:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140892.977203:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576169472 00000100:00100000:0.0:1746140892.977206:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576169472 00000100:00100000:0.0:1746140892.977221:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17685 00000100:00100000:0.0:1746140892.977224:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3310:x1830960576169472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140892.977345:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3310:x1830960576169472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (154us total) trans 21474841582 rc 0/0 00000100:00100000:0.0:1746140892.977351:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17685 00000004:00080000:1.0:1746140892.977495:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b756d80/2, rc 0, transno 21474841582 00000100:00100000:1.0:1746140892.977500:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576169472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140892.980182:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.980255:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574025088 00000100:00100000:3.0:1746140892.980263:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574025088 00000100:00100000:0.0:1746140892.980333:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 803 00000100:00100000:0.0:1746140892.980346:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+8:555:x1830960574025088:12345-192.168.204.16@tcp:103:mirror_io.0 00010000:00010000:0.0:1746140892.980359:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140892.980383:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc059 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2703 expref: 8 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140892.980401:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140892.980404:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140892.980447:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:28b972ba-4133-49d1-b679-ce80456803d9+7:555:x1830960574025088:12345-192.168.204.16@tcp:103:mirror_io.0 Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140892.980453:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 803 00000100:00100000:0.0:1746140892.981479:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140892.981562:0:21104:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574025344 00000100:00100000:3.0:1746140892.981574:0:21104:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574025344 00000100:00100000:2.0:1746140892.981691:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4829 00000100:00100000:2.0:1746140892.981701:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+7:555:x1830960574025344:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140892.981933:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:555:x1830960574025344:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 234us (456us total) trans 8589945265 rc 0/0 00000100:00100000:2.0:1746140892.981940:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4829 00000100:00100000:0.0:1746140892.982884:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.982930:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574025600 00000100:00100000:2.0:1746140892.982936:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574025600 00000100:00100000:2.0:1746140892.982983:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4830 00000100:00100000:2.0:1746140892.982989:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+8:555:x1830960574025600:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746140892.983087:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28b972ba-4133-49d1-b679-ce80456803d9+9:555:x1830960574025600:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 98us (204us total) trans 8589945266 rc 0/0 00000100:00100000:2.0:1746140892.983091:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4830 00000100:00100000:0.0:1746140892.986620:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.986663:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140892.986704:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140892.986716:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574025856 00000100:00100000:0.0:1746140892.986723:0:8464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574026112 00000100:00100000:2.0:1746140892.986726:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574025856 00000100:00100000:0.0:1746140892.986726:0:8464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574026112 00000100:00100000:1.0:1746140892.986757:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574026368 00000100:00100000:1.0:1746140892.986761:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574026368 00002000:00100000:2.0:1746140892.986768:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b755500 x1830960574025856/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746140892.986768:0:8464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009b757b80 x1830960574026112/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.986778:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755500 with x1830960574025856 ext(2097152->3145727) 00002000:00100000:0.0:1746140892.986778:0:8464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b757b80 with x1830960574026112 ext(3145728->4194303) 00002000:00100000:1.0:1746140892.986782:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009b755880 x1830960574026368/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/0 e 0 to 0 dl 1746140903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746140892.986784:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b755500 00002000:00010000:0.0:1746140892.986784:0:8464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b757b80 00002000:00100000:1.0:1746140892.986790:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755880 with x1830960574026368 ext(3145728->4194303) 00002000:00010000:1.0:1746140892.986794:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b755880 00000100:00100000:2.0:1746140892.986825:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9073 00000100:00100000:1.0:1746140892.986831:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9074 00000100:00100000:2.0:1746140892.986833:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1984:x1830960574026112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746140892.986837:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+15:1985:x1830960574025856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746140892.986844:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9075 00000100:00100000:3.0:1746140892.986852:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960574026368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140892.994874:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:a9944e31-822a-4286-b0f5-4880be82b6d9+16:1984:x1830960574026112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8030us (8202us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140892.994888:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9073 00002000:00100000:2.0:1746140892.994901:0:32429:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x3a9:0x0] (3145728->4194303) req@ffff88009b757b80 x1830960574026112/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140892.994913:0:32429:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b757b80 with x1830960574026112 ext(3145728->4194303) 00002000:00010000:2.0:1746140892.994919:0:32429:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b757b80 00000100:00100000:3.0:1746140892.997621:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1984:x1830960574026368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10762us (10907us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140892.997631:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9075 00002000:00100000:3.0:1746140892.997643:0:8463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3a3:0x0] (3145728->4194303) req@ffff88009b755880 x1830960574026368/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746140892.997651:0:8463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755880 with x1830960574026368 ext(3145728->4194303) 00002000:00010000:3.0:1746140892.997656:0:8463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b755880 00000100:00100000:1.0:1746140892.997685:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1985:x1830960574025856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10848us (11075us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140892.997692:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9074 00002000:00100000:1.0:1746140892.997697:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3a9:0x0] (2097152->3145727) req@ffff88009b755500 x1830960574025856/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:308/0 lens 488/440 e 0 to 0 dl 1746140903 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140892.997703:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b755500 with x1830960574025856 ext(2097152->3145727) 00002000:00010000:1.0:1746140892.997707:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b755500 00000100:00100000:0.0:1746140893.002681:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.002794:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574026496 00000100:00100000:2.0:1746140893.002805:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574026496 00000100:00100000:2.0:1746140893.002859:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17686 00000100:00100000:2.0:1746140893.002866:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+11:1983:x1830960574026496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746140893.002884:0:4785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140893.002903:0:4785:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351a2000/0x8156357b7fdbc0d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2749 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140893.002928:0:4785:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x81f 00010000:00010000:2.0:1746140893.002960:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.002962:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.002970:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a2000/0x8156357b7fdbc0d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2749 expref: 12 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.002986:0:4785:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351a2000/0x8156357b7fdbc0d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2749 expref: 12 pid: 4785 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.002996:0:4785:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a2000, rc 0) 00000100:00100000:2.0:1746140893.003059:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1983:x1830960574026496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 193us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.003066:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17686 00000100:00100000:0.0:1746140893.006020:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.006094:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574026752 00000100:00100000:1.0:1746140893.006102:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574026752 00002000:00100000:1.0:1746140893.006145:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880099497800 x1830960574026752/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:309/0 lens 488/0 e 0 to 0 dl 1746140904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746140893.006154:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497800 with x1830960574026752 ext(4194304->4886527) 00002000:00010000:1.0:1746140893.006160:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497800 00000100:00100000:1.0:1746140893.006191:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9076 00000100:00100000:1.0:1746140893.006198:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960574026752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746140893.011144:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1985:x1830960574026752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4933us (5125us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746140893.011162:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9076 00002000:00100000:2.0:1746140893.011174:0:21376:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3a3:0x0] (4194304->4886527) req@ffff880099497800 x1830960574026752/t0(0) o3->a9944e31-822a-4286-b0f5-4880be82b6d9@192.168.204.16@tcp:309/0 lens 488/440 e 0 to 0 dl 1746140904 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746140893.011184:0:21376:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099497800 with x1830960574026752 ext(4194304->4886527) 00002000:00010000:2.0:1746140893.011190:0:21376:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099497800 00000100:00100000:0.0:1746140893.018576:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.018685:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574027008 00000100:00100000:2.0:1746140893.018695:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574027008 00000100:00100000:2.0:1746140893.018747:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4831 00000100:00100000:2.0:1746140893.018755:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+7:554:x1830960574027008:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746140893.019448:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a9944e31-822a-4286-b0f5-4880be82b6d9+8:554:x1830960574027008:12345-192.168.204.16@tcp:35:cat.0 Request processed in 681us (872us total) trans 8589945267 rc 0/0 00000100:00100000:2.0:1746140893.019462:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4831 00000100:00100000:0.0:1746140893.445106:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.445218:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574027264 00000100:00100000:2.0:1746140893.445228:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574027264 00000100:00100000:0.0:1746140893.445302:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.445349:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574027136 00000100:00100000:2.0:1746140893.445352:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574027136 00000100:00100000:0.0:1746140893.445363:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.445368:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574027392 00000100:00100000:2.0:1746140893.445370:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574027392 00000100:00100000:2.0:1746140893.445384:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 804 00000100:00100000:2.0:1746140893.445390:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d247991d-e844-4b62-b954-6487bd25e6e9+17:1982:x1830960574027264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140893.445403:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140893.445422:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012eacaa00/0x8156357b7fdaefa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ae6d expref: 17 pid: 14740 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.445429:0:9847:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 805 00010000:00010000:2.0:1746140893.445444:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140893.445445:0:9847:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d247991d-e844-4b62-b954-6487bd25e6e9+16:1984:x1830960574027136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140893.445460:0:9847:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140893.445479:0:9847:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f6e2a00/0x8156357b7fdaefa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ae43 expref: 16 pid: 14739 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.445490:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d247991d-e844-4b62-b954-6487bd25e6e9+15:1982:x1830960574027264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.445498:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 804 00010000:00010000:1.0:1746140893.445505:0:9847:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140893.445515:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 806 00000100:00100000:2.0:1746140893.445520:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d247991d-e844-4b62-b954-6487bd25e6e9+14:1982:x1830960574027392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140893.445526:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140893.445534:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012eaca400/0x8156357b7fdaefb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ae74 expref: 14 pid: 14740 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.445542:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140893.445544:0:9847:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d247991d-e844-4b62-b954-6487bd25e6e9+13:1984:x1830960574027136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.445551:0:9847:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 805 00000100:00100000:2.0:1746140893.445558:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d247991d-e844-4b62-b954-6487bd25e6e9+13:1982:x1830960574027392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 38us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.445564:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 806 00000100:00100000:0.0:1746140893.445670:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.445690:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574027904 00000100:00100000:2.0:1746140893.445694:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574027904 00000100:00100000:2.0:1746140893.445982:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17687 00000100:00100000:2.0:1746140893.445989:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+14:1981:x1830960574027904:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:2.0:1746140893.446012:0:20960:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x8156357b7fdaefbe 00000020:00010000:2.0:1746140893.446019:0:20960:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f04b000: total 0 00000100:00080000:2.0:1746140893.446022:0:20960:0:(import.c:66:import_set_state_nolock()) ffff88009f04c800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1746140893.446056:0:1272:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f04b000: total 0 00000001:00000004:2.0:1746140893.446062:0:20960:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874279 00010000:00010000:0.0:1746140893.446088:0:1272:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f04b000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1746140893.446127:0:1272:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4943600/0x8156357b7fdbc0a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2718 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140893.446172:0:1272:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a41b4e00/0x8156357b7fdbc0bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2734 expref: 12 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140893.446193:0:1272:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a41b4600/0x8156357b7fdbc0ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a271f expref: 11 pid: 32377 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140893.446203:0:1272:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f04b000, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746140893.446211:0:1272:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746140893.446213:0:1272:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746140893.446214:0:1272:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1746140893.446346:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746140893.446435:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1981:x1830960574027904:12345-192.168.204.16@tcp:9:umount.0 Request processed in 447us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.446441:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17687 00000100:00100000:0.0:1746140893.454707:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.454814:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574028416 00000100:00100000:2.0:1746140893.454824:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574028416 00000100:00100000:2.0:1746140893.454865:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17688 00000100:00100000:2.0:1746140893.454872:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+12:1981:x1830960574028416:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:2.0:1746140893.454902:0:20960:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x8156357b7fdaefc5 00000020:00010000:2.0:1746140893.454909:0:20960:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012da67800: total 0 00000100:00080000:2.0:1746140893.454913:0:20960:0:(import.c:66:import_set_state_nolock()) ffff88012da62800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746140893.454974:0:20960:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841582 00000020:00010000:1.0:1746140893.455036:0:7112:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012da67800: total 0 00010000:00010000:1.0:1746140893.455040:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746140893.455071:0:7112:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012da67800, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1746140893.455117:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351a2000/0x8156357b7fdbc0d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2749 expref: 12 pid: 4785 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140893.455169:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9944e31-822a-4286-b0f5-4880be82b6d9+9:1981:x1830960574028416:12345-192.168.204.16@tcp:9:umount.0 Request processed in 297us (471us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140893.455169:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a41b4000/0x8156357b7fdbc098 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2711 expref: 9 pid: 32377 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746140893.455175:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17688 00010000:00010000:1.0:1746140893.455189:0:7112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbc0b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a272d expref: 7 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.455200:0:7112:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012da67800, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1746140893.455209:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746140893.455210:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746140893.455212:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140893.460117:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140893.460218:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574028800 00000100:00100000:3.0:1746140893.460227:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574028800 00000100:00100000:3.0:1746140893.460269:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10917 00000100:00100000:3.0:1746140893.460275:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+8:1981:x1830960574028800:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:3.0:1746140893.460327:0:27790:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x8156357b7fdaefb7 00000020:00010000:3.0:1746140893.460334:0:27790:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f04a800: total 0 00000100:00080000:3.0:1746140893.460338:0:27790:0:(import.c:66:import_set_state_nolock()) ffff88009f04f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746140893.460363:0:27790:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945267 00000020:00010000:2.0:1746140893.460397:0:7113:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f04a800: total 0 00010000:00010000:2.0:1746140893.460439:0:7113:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f04a800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746140893.460471:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:2.0:1746140893.460474:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746140893.460482:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b23200/0x8156357b7fdaf043 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829af0e expref: 7 pid: 14785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.460513:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:2.0:1746140893.460515:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140893.460519:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc0c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a273b expref: 6 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.460534:0:7113:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f04a800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746140893.460544:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746140893.460546:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746140893.460547:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746140893.460665:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a9944e31-822a-4286-b0f5-4880be82b6d9+4:1981:x1830960574028800:12345-192.168.204.16@tcp:39:umount.0 Request processed in 389us (558us total) trans 8589945268 rc 0/0 00000100:00100000:3.0:1746140893.460671:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10917 00000100:00100000:0.0:1746140893.693150:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.693192:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.693286:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.693361:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574028928 00000100:00100000:0.0:1746140893.693371:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574028928 00000100:00100000:0.0:1746140893.693436:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574029056 00000100:00100000:0.0:1746140893.693439:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574029056 00000100:00100000:0.0:1746140893.693452:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574029184 00000100:00100000:0.0:1746140893.693453:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574029184 00000100:00100000:0.0:1746140893.693470:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 807 00000100:00100000:1.0:1746140893.693557:0:7110:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 808 00000100:00100000:1.0:1746140893.693567:0:7110:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d247991d-e844-4b62-b954-6487bd25e6e9+14:1984:x1830960574029056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746140893.693580:0:7110:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140893.693598:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f669200/0x8156357b7fdaefcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829ae9e expref: 14 pid: 14740 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.693619:0:7110:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140893.693662:0:7110:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d247991d-e844-4b62-b954-6487bd25e6e9+13:1984:x1830960574029056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.693667:0:7110:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 808 00000100:00100000:0.0:1746140893.693671:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d247991d-e844-4b62-b954-6487bd25e6e9+13:1984:x1830960574028928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746140893.693675:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 809 00010000:00010000:0.0:1746140893.693680:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746140893.693685:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4909450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d247991d-e844-4b62-b954-6487bd25e6e9+12:1985:x1830960574029184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140893.693689:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f6e2c00/0x8156357b7fdaefd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829aec8 expref: 12 pid: 14739 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.693693:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140893.693702:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f190c00/0x8156357b7fdaefda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829aecf expref: 11 pid: 14739 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.693707:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140893.693715:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140893.693728:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d247991d-e844-4b62-b954-6487bd25e6e9+10:1984:x1830960574028928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 247us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.693734:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4909450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d247991d-e844-4b62-b954-6487bd25e6e9+10:1985:x1830960574029184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140893.693734:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 807 00000100:00100000:2.0:1746140893.693739:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 809 00000100:00100000:0.0:1746140893.694165:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.694279:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574029312 00000100:00100000:2.0:1746140893.694283:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574029312 00000100:00080000:3.0:1746140893.694332:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746140893.694356:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17689 00000100:00100000:2.0:1746140893.694362:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+5:1981:x1830960574029312:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:2.0:1746140893.694384:0:4785:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x8156357b7fdaefef 00000100:00080000:2.0:1746140893.694391:0:4785:0:(import.c:66:import_set_state_nolock()) ffff88009ef5a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746140893.694430:0:4785:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874279 00010000:00010000:3.0:1746140893.694477:0:1273:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746140893.694577:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+2:1981:x1830960574029312:12345-192.168.204.16@tcp:9:umount.0 Request processed in 215us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.694584:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17689 00010000:00010000:2.0:1746140893.695581:0:1272:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140893.697447:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.697497:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574029440 00000100:00100000:2.0:1746140893.697504:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574029440 00000100:00080000:3.0:1746140893.697564:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746140893.697630:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17690 00000100:00100000:2.0:1746140893.697638:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+5:1981:x1830960574029440:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:2.0:1746140893.697666:0:4785:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x8156357b7fdaefe8 00000100:00080000:2.0:1746140893.697673:0:4785:0:(import.c:66:import_set_state_nolock()) ffff88009f04d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746140893.697720:0:4785:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841582 00000100:00100000:2.0:1746140893.697880:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:28b972ba-4133-49d1-b679-ce80456803d9+2:1981:x1830960574029440:12345-192.168.204.16@tcp:9:umount.0 Request processed in 243us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.697887:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17690 00010000:00010000:1.0:1746140893.697963:0:7112:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140893.701988:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.702083:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574029824 00000100:00100000:2.0:1746140893.702093:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574029824 00000100:00100000:2.0:1746140893.702149:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10918 00000100:00100000:2.0:1746140893.702155:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+9:1981:x1830960574029824:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:2.0:1746140893.702186:0:14741:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x8156357b7fdaefe1 00000020:00010000:2.0:1746140893.702192:0:14741:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009ef5d000: total 0 00000100:00080000:2.0:1746140893.702195:0:14741:0:(import.c:66:import_set_state_nolock()) ffff88009ef5b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746140893.702219:0:14741:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945268 00000020:00010000:0.0:1746140893.702409:0:7113:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009ef5d000: total 0 00010000:00010000:0.0:1746140893.702452:0:7113:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009ef5d000, canceled 0 locks, left on hash table 2. 00000100:00100000:2.0:1746140893.702467:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28b972ba-4133-49d1-b679-ce80456803d9+8:1981:x1830960574029824:12345-192.168.204.16@tcp:39:umount.0 Request processed in 311us (492us total) trans 8589945269 rc 0/0 00000100:00100000:2.0:1746140893.702473:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10918 00010000:00010000:0.0:1746140893.702481:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:0.0:1746140893.702484:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746140893.702491:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x8156357b7fdaeffd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e829aef9 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.702516:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880090293f00) 00010000:00010000:0.0:1746140893.702519:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746140893.702523:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2a00/0x8156357b7fdbc0d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2742 expref: 6 pid: 14741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.702545:0:7113:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009ef5d000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746140893.702554:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746140893.702556:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746140893.702558:0:7113:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746140893.727245:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140893.727330:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574029952 00000100:00100000:3.0:1746140893.727340:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574029952 00000100:00100000:3.0:1746140893.727398:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10919 00000100:00100000:3.0:1746140893.727405:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:599:x1830960574029952:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140893.727428:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140893.727448:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2a00/0x8156357b7fdbc0de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2750 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.727515:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727528:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727537:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727551:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727557:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727567:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727686:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727693:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727699:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:3.0:1746140893.727727:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:3.0:1746140893.727731:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746140893.727745:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727752:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727757:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727761:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727765:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727768:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801363f2c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140893.727771:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727775:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727782:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e3b0b00) 00010000:00010000:3.0:1746140893.727784:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140893.727787:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727790:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2c00/0x8156357b7fdbc0e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727817:0:27790:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727820:0:27790:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727823:0:27790:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727825:0:27790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed43600 already unused, calling callback (ffffffffa1368690) 00010000:00010000:3.0:1746140893.727826:0:27790:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727829:0:27790:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727832:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093871300) 00010000:00010000:3.0:1746140893.727833:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746140893.727834:0:27790:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727836:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43600/0x8156357b7fdbc0ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.727859:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f2a00/0x8156357b7fdbc0de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.727870:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 267 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.727876:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:3.0:1746140893.727878:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746140893.727880:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43400, rc 0) 00000100:00100000:3.0:1746140893.727949:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:599:x1830960574029952:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 543us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.727955:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10919 00000100:00100000:0.0:1746140893.732449:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.732589:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.732684:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.732712:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.732726:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.732749:0:24958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574030080 00000100:00100000:2.0:1746140893.732754:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574030208 00000100:00100000:2.0:1746140893.732757:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574030208 00000100:00100000:0.0:1746140893.732757:0:24958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574030080 00000100:00100000:3.0:1746140893.732763:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574030336 00000100:00100000:3.0:1746140893.732774:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574030336 00000100:00100000:2.0:1746140893.732806:0:8460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574030464 00000100:00100000:2.0:1746140893.732808:0:8460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574030464 00000100:00100000:3.0:1746140893.733015:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574030592 00000100:00100000:2.0:1746140893.733020:0:8460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17691 00000100:00100000:2.0:1746140893.733028:0:8460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574030208:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:0.0:1746140893.733028:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17692 00000100:00100000:0.0:1746140893.733034:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574030336:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746140893.733047:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17693 00010000:00010000:0.0:1746140893.733050:0:24958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140893.733051:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960574030464:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140893.733055:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140893.733067:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a276c expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.733067:0:24958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2765 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140893.733087:0:8458:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x81f 00002000:00010000:0.0:1746140893.733087:0:24958:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fedd, atime: 0x6813fedc, ctime: 0x6813fedd, blocks: 0x821 00010000:00010000:2.0:1746140893.733101:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.733101:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.733103:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.733103:0:24958:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.733111:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 18 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140893.733111:0:24958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 27 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.733124:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 18 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140893.733124:0:24958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 27 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.733134:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a3e00, rc 0) 00010000:00010000:0.0:1746140893.733135:0:24958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a476ea00, rc 0) 00000100:00100000:2.0:1746140893.733168:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1985:x1830960574030464:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 116us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.733174:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17693 00000100:00100000:1.0:1746140893.733184:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17694 00000100:00100000:1.0:1746140893.733190:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+17:1985:x1830960574030080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140893.733191:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.733195:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140893.733198:0:8460:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a275e expref: -99 pid: 8460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.733203:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2757 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140893.733209:0:8460:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x821 00002000:00010000:1.0:1746140893.733214:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x821 00010000:00010000:2.0:1746140893.733215:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.733216:0:8460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.733219:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.733220:0:8460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.733220:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.733224:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 18 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.733229:0:8460:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.733231:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 18 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.733235:0:8460:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351a2a00, rc 0) 00010000:00010000:1.0:1746140893.733237:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82a00, rc 0) 00000100:00100000:2.0:1746140893.733263:0:8460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960574030208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 237us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140893.733263:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960574030336:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 231us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.733268:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574030592 00000100:00100000:2.0:1746140893.733268:0:8460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17691 00000100:00100000:0.0:1746140893.733270:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17692 00000100:00100000:3.0:1746140893.733369:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17695 00000100:00100000:3.0:1746140893.733378:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960574030592:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140893.733393:0:4782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140893.733409:0:4782:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2773 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140893.733428:0:4782:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x158d 00010000:00010000:3.0:1746140893.733442:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140893.733443:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960574030080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 253us (1001us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140893.733444:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140893.733448:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17694 00010000:00010000:3.0:1746140893.733451:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 20 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.733463:0:4782:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 19 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.733472:0:4782:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43a00, rc 0) 00000100:00100000:3.0:1746140893.733508:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960574030592:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 131us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.733513:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17695 00000100:00080000:2.0:1746140893.733573:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746140893.733577:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746140893.733595:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.733669:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574030720 00000100:00100000:1.0:1746140893.733673:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574030720 00000100:00100000:1.0:1746140893.733690:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17696 00000100:00100000:1.0:1746140893.733695:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960574030720:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.733701:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.733709:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a277a expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140893.733719:0:20960:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x1029 00010000:00010000:1.0:1746140893.733726:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.733727:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.733731:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.733739:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 28 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.733745:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc83400, rc 0) 00000100:00100000:1.0:1746140893.733761:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960574030720:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 66us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.733766:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17696 00000100:00100000:0.0:1746140893.735651:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140893.736005:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574030976 00000100:00100000:3.0:1746140893.736013:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574030976 00000100:00100000:3.0:1746140893.736064:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10920 00000100:00100000:3.0:1746140893.736070:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:599:x1830960574030976:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140893.736087:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140893.736103:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdbc124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2781 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.736180:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.736191:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.736197:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.736223:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.736233:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 268 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140893.736248:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576169600:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140893.736356:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746140893.737686:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576169600:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140893.737705:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140893.739414:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140893.739909:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574031104 00000100:00100000:3.0:1746140893.739917:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574031104 00010000:00010000:3.0:1746140893.739964:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 269 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140893.740000:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9180 00000100:00100000:3.0:1746140893.740007:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1984:x1830960574031104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140893.740019:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140893.740024:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 269 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.740033:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 269 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.740053:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed43400/0x8156357b7fdbc0f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2750 expref: 269 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.740614:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:3.0:1746140893.740619:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.740630:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.740636:0:8473:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.740669:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140893.740697:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.740703:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140893.740716:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:1984:x1830960574031104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 708us (1306us total) trans 0 rc 0/0 00000004:00200000:2.0:1746140893.740719:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000100:00100000:3.0:1746140893.740721:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9180 00010000:00010000:2.0:1746140893.740838:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42a00/0x8156357b7fdbc124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 269 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.740869:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.740875:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:2.0:1746140893.740877:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746140893.740879:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42800, rc 0) 00000100:00100000:2.0:1746140893.740902:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:599:x1830960574030976:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4832us (5257us total) trans 8589945270 rc 0/0 00000100:00100000:2.0:1746140893.740908:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10920 00000100:00100000:0.0:1746140893.743208:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.743257:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574031232 00000100:00100000:2.0:1746140893.743265:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574031232 00000100:00100000:2.0:1746140893.743340:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10921 00000100:00100000:2.0:1746140893.743348:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:599:x1830960574031232:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746140893.743367:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140893.743383:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbc139 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2788 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.743445:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.743508:0:27790:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 269 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.743516:0:27790:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.743542:0:27790:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 269 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.743552:0:27790:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 269 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140893.743563:0:27790:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576169728:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140893.743977:0:27790:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140893.746618:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.746666:0:27790:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:27790:1830960576169728:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746140893.746687:0:27790:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140893.747016:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574031360 00000100:00100000:3.0:1746140893.747022:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574031360 00010000:00010000:3.0:1746140893.747046:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 270 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140893.747075:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9181 00000100:00100000:3.0:1746140893.747083:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b06b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:1985:x1830960574031360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140893.747096:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140893.747102:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 270 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.747111:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 270 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.747128:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed42800/0x8156357b7fdbc12b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2781 expref: 270 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.747187:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:3.0:1746140893.747193:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.747200:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.747206:0:8473:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27790 initiator: MDT0 00010000:00010000:3.0:1746140893.747235:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140893.747282:0:27790:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140893.747288:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:3.0:1746140893.747343:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:1985:x1830960574031360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 260us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.747349:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9181 00000004:00200000:0.0:1746140893.747364:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:0.0:1746140893.747368:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746140893.747411:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:0.0:1746140893.747436:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fdc00/0x8156357b7fdbc139 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2788 expref: 269 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.747460:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2788 expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.747466:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:0.0:1746140893.747469:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746140893.747471:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d2fda00, rc 0) 00000100:00100000:0.0:1746140893.747493:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:599:x1830960574031232:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4147us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140893.747499:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10921 00000100:00100000:0.0:1746140893.749791:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.749953:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574031616 00000100:00100000:1.0:1746140893.749961:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574031616 00000100:00100000:1.0:1746140893.749997:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10922 00000100:00100000:1.0:1746140893.750004:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:599:x1830960574031616:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.750023:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.750037:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82c00/0x8156357b7fdbc147 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a278f expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.750108:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82400/0x8156357b7fdbc14e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140893.750118:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82400/0x8156357b7fdbc14e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140893.750127:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82400/0x8156357b7fdbc14e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:1.0:1746140893.750135:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00010000:00010000:1.0:1746140893.750230:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82c00/0x8156357b7fdbc147 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a278f expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.750247:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82400/0x8156357b7fdbc14e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a278f expref: 270 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.750253:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:1.0:1746140893.750256:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746140893.750258:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc82400, rc 0) 00000100:00100000:1.0:1746140893.750291:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:599:x1830960574031616:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 287us (506us total) trans 8589945271 rc 0/0 00000100:00100000:1.0:1746140893.750296:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10922 00000100:00100000:0.0:1746140893.753404:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.753440:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.753480:0:4785:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574031872 00000100:00100000:2.0:1746140893.753491:0:4785:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574031872 00000100:00100000:1.0:1746140893.753492:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574032128 00000100:00100000:1.0:1746140893.753497:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574032128 00000100:00100000:1.0:1746140893.753543:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17697 00000100:00100000:2.0:1746140893.753548:0:4785:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17698 00000100:00100000:1.0:1746140893.753551:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960574032128:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:2.0:1746140893.753558:0:4785:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960574031872:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:0.0:1746140893.753574:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140893.753586:0:4785:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.753586:0:8459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.753602:0:8459:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.753603:0:4785:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.753609:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.753611:0:8459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.753613:0:8459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.753614:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.753615:0:4785:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.753617:0:4785:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.753638:0:4785:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 28 pid: 8460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.753638:0:8459:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 19 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.753648:0:4785:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 28 pid: 8460 timeout: 972 lvb_type: 1 00000100:00100000:2.0:1746140893.753660:0:4785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576169856:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140893.753693:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.753719:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.753748:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.753769:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574032384 00000100:00100000:0.0:1746140893.753776:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574032384 00000100:00100000:0.0:1746140893.753820:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574031744 00000100:00100000:0.0:1746140893.753823:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574031744 00010000:00010000:1.0:1746140893.753826:0:8459:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 20 pid: 8458 timeout: 972 lvb_type: 1 00000100:00100000:0.0:1746140893.753834:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574032000 00000100:00100000:0.0:1746140893.753835:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574032000 00000100:00100000:1.0:1746140893.753845:0:8459:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576169984:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140893.753845:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574032256 00000100:00100000:0.0:1746140893.753846:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574032256 00000100:00100000:0.0:1746140893.753863:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17699 00000100:00100000:0.0:1746140893.753870:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960574032384:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746140893.753905:0:32376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.753913:0:8459:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873e40 going to sleep for 11 seconds 00010000:00010000:0.0:1746140893.753921:0:32376:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 30 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140893.753928:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.753929:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746140893.753945:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17700 00010000:00010000:0.0:1746140893.753946:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.753952:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960574031744:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:3.0:1746140893.753961:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17701 00000100:00100000:3.0:1746140893.753968:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960574032000:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746140893.753969:0:9872:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.753972:0:32376:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 30 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.753978:0:9872:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 21 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.753982:0:4782:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.753982:0:32376:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 30 pid: 20960 timeout: 972 lvb_type: 1 00010000:00010000:1.0:1746140893.753988:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.753989:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.753990:0:4782:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.753991:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.753994:0:32376:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576170112:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140893.753996:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.753997:0:4782:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.753998:0:4782:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.754005:0:9872:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 21 pid: 20960 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.754010:0:4782:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 30 pid: 24958 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.754012:0:9872:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 21 pid: 20960 timeout: 972 lvb_type: 1 00010000:00010000:3.0:1746140893.754017:0:4782:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 30 pid: 24958 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.754020:0:9872:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576170240:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746140893.754025:0:4782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576170368:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140893.754036:0:4785:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746140893.754037:0:32376:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746140893.754054:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17702 00000100:00100000:1.0:1746140893.754058:0:9872:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746140893.754061:0:4782:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746140893.754061:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960574032256:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746140893.754077:0:4784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.754086:0:4784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 21 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.754091:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.754092:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.754094:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.754110:0:4784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 21 pid: 4782 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.754117:0:4784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 21 pid: 4782 timeout: 972 lvb_type: 1 00000100:00100000:2.0:1746140893.754124:0:4784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576170496:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140893.754144:0:4784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744600 going to sleep for 11 seconds 00000100:00100000:0.0:1746140893.756725:0:32376:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f172a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:32376:1830960576170112:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140893.756749:0:32376:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.756787:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.756799:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.756810:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.756825:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574032896 00000100:00100000:0.0:1746140893.756830:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574032896 00010000:00010000:0.0:1746140893.756856:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 31 pid: 24958 timeout: 972 lvb_type: 1 00000100:00100000:3.0:1746140893.756871:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574032640 00000100:00100000:3.0:1746140893.756876:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574032640 00000100:00100000:0.0:1746140893.756876:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574033024 00000100:00100000:0.0:1746140893.756878:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574033024 00010000:00010000:0.0:1746140893.756887:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 23 pid: 4782 timeout: 972 lvb_type: 1 00010000:00010000:3.0:1746140893.756893:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 23 pid: 20960 timeout: 972 lvb_type: 1 00000100:00100000:0.0:1746140893.756906:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9182 00000100:00100000:3.0:1746140893.756981:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9183 00000100:00100000:3.0:1746140893.756987:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960574033024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140893.756999:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140893.757007:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960574032896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140893.757024:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 23 pid: 4782 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.757024:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140893.757033:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 23 pid: 4782 timeout: 972 lvb_type: 1 00000100:00100000:2.0:1746140893.757050:0:4784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4784:1830960576170496:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140893.757050:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 31 pid: 24958 timeout: 972 lvb_type: 1 00010000:00010000:3.0:1746140893.757053:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed43a00/0x8156357b7fdbc116 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2773 expref: 23 pid: 4782 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.757063:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 31 pid: 24958 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.757066:0:4784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757067:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.757069:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.757073:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757084:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.757085:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.757089:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757097:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757112:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746140893.757158:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1983:x1830960574032896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 173us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140893.757165:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9182 00000100:00100000:0.0:1746140893.757191:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9184 00000100:00100000:0.0:1746140893.757196:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960574032640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140893.757201:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757202:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140893.757214:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 22 pid: 20960 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.757223:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 22 pid: 20960 timeout: 972 lvb_type: 1 00010000:00010000:3.0:1746140893.757225:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140893.757226:0:4784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757232:0:4784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757233:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.757234:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.757237:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757243:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757249:0:4784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757250:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140893.757254:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960574033024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 267us (442us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140893.757255:0:4784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140893.757260:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9183 00010000:00010000:2.0:1746140893.757261:0:4784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.757266:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960574032640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (466us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140893.757267:0:4784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256f200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140893.757271:0:4784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.757271:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9184 00010000:00010000:2.0:1746140893.757277:0:4784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757285:0:4784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757290:0:4784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009256f200/0x8156357b7fdbc17f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757295:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a476ea00/0x8156357b7fdbc0fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2765 expref: 30 pid: 24958 timeout: 972 lvb_type: 1 00000100:00100000:3.0:1746140893.757327:0:4782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4782:1830960576170368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140893.757338:0:4782:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757345:0:4782:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757350:0:4782:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.757351:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960574032256:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 3290us (3602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140893.757356:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140893.757357:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc82a00/0x8156357b7fdbc10f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2757 expref: 20 pid: 20960 timeout: 972 lvb_type: 1 00000100:00100000:2.0:1746140893.757360:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17702 00010000:00010000:3.0:1746140893.757368:0:4782:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.757372:0:9872:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9872:1830960576170240:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746140893.757374:0:4782:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757378:0:4782:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.757386:0:4785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4785:1830960576169856:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140893.757387:0:9872:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757388:0:4782:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed42200 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140893.757390:0:4782:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757393:0:9872:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757395:0:4782:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757397:0:4785:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757398:0:9872:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.757402:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746140893.757404:0:4782:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757410:0:4782:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42200/0x8156357b7fdbc178 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4782 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.757414:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574032512 00000100:00100000:0.0:1746140893.757419:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574032512 00010000:00010000:0.0:1746140893.757433:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 30 pid: 8460 timeout: 972 lvb_type: 1 00000100:00100000:3.0:1746140893.757444:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960574032000:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 3477us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140893.757447:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574032768 00000100:00100000:0.0:1746140893.757448:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574032768 00000100:00100000:3.0:1746140893.757449:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17701 00010000:00010000:0.0:1746140893.757456:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 19 pid: 8458 timeout: 972 lvb_type: 1 00000100:00100000:0.0:1746140893.757480:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9185 00000100:00100000:0.0:1746140893.757485:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960574032512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140893.757491:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140893.757500:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 29 pid: 8460 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.757507:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 29 pid: 8460 timeout: 972 lvb_type: 1 00010000:00010000:1.0:1746140893.757508:0:9872:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757515:0:9872:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757518:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351a2a00/0x8156357b7fdbc108 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a275e expref: 29 pid: 8460 timeout: 972 lvb_type: 1 00000100:00100000:3.0:1746140893.757520:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746140893.757521:0:9872:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757526:0:9872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4942400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140893.757528:0:9872:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757534:0:9872:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140893.757536:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574033152 00010000:00010000:0.0:1746140893.757537:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.757538:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140893.757539:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574033152 00010000:00010000:0.0:1746140893.757541:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757543:0:9872:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757548:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757549:0:9872:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4942400/0x8156357b7fdbc171 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757551:0:8473:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 29 pid: 20960 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.757559:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140893.757566:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9186 00000100:00100000:3.0:1746140893.757571:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4909050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960574032768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746140893.757574:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960574032512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (219us total) trans 0 rc 0/0 00010000:00010000:3.0:1746140893.757579:0:8473:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746140893.757579:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9185 00010000:00010000:3.0:1746140893.757589:0:8473:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 19 pid: 8458 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.757591:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960574031744:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 3639us (3998us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140893.757591:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9187 00000100:00100000:0.0:1746140893.757596:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960574033152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140893.757597:0:8473:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 19 pid: 8458 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.757597:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17700 00010000:00010000:0.0:1746140893.757602:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140893.757608:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.757609:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.757610:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 28 pid: 20960 timeout: 972 lvb_type: 1 00010000:00010000:3.0:1746140893.757611:0:8473:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757617:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757617:0:4785:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757619:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 28 pid: 20960 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.757624:0:4785:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757625:0:8473:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746140893.757630:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc83400/0x8156357b7fdbc11d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a277a expref: 28 pid: 20960 timeout: 972 lvb_type: 1 00010000:00010000:1.0:1746140893.757633:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351a3e00/0x8156357b7fdbc101 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a276c expref: 18 pid: 8458 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.757639:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746140893.757640:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4909050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1985:x1830960574032768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (236us total) trans 0 rc 0/0 00010000:00010000:0.0:1746140893.757640:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.757642:0:4785:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.757642:0:8459:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8459:1830960576169984:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746140893.757642:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140893.757645:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9186 00010000:00010000:2.0:1746140893.757648:0:4785:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757648:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757653:0:4785:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757653:0:8459:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757658:0:4785:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e2c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140893.757659:0:8459:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757660:0:4785:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.757660:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140893.757664:0:8459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757666:0:4785:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.757674:0:4785:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757676:0:8459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.757678:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1985:x1830960574033152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (159us total) trans 0 rc 0/0 00010000:00010000:2.0:1746140893.757680:0:4785:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e2c00/0x8156357b7fdbc163 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757681:0:8459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.757685:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9187 00010000:00010000:1.0:1746140893.757687:0:8459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757692:0:8459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc82e00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140893.757694:0:8459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757698:0:32376:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.757699:0:8459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757704:0:32376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.757708:0:4785:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:64a7ece3-6daa-4cf2-9f70-0208ad105443+26:1985:x1830960574031872:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 4153us (4315us total) trans 0 rc 0/0 00010000:00010000:1.0:1746140893.757712:0:8459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.757713:0:4785:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17698 00010000:00010000:1.0:1746140893.757717:0:8459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc82e00/0x8156357b7fdbc15c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757718:0:32376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757723:0:32376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757733:0:32376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757738:0:32376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a476f000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140893.757740:0:32376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757745:0:32376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.757747:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+16:1985:x1830960574032128:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 4197us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.757752:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17697 00010000:00010000:3.0:1746140893.757753:0:32376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.757758:0:32376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a476f000/0x8156357b7fdbc16a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140893.757789:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1985:x1830960574032384:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 3919us (4214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.757794:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17699 00000100:00100000:0.0:1746140893.759782:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.759968:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574033408 00000100:00100000:2.0:1746140893.759976:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574033408 00000100:00100000:2.0:1746140893.760023:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10923 00000100:00100000:2.0:1746140893.760030:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:599:x1830960574033408:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746140893.760074:0:14741:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140893.760095:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d2fda00/0x8156357b7fdbc140 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2788 expref: 270 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.760110:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:2.0:1746140893.760114:0:14741:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140893.760135:0:14741:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760145:0:14741:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760153:0:14741:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760184:0:14741:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760189:0:14741:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760194:0:14741:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760200:0:14741:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9ac400 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140893.760202:0:14741:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760208:0:14741:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760214:0:14741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:2.0:1746140893.760216:0:14741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140893.760218:0:14741:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00010000:00010000:2.0:1746140893.760222:0:14741:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9ac400/0x8156357b7fdbc186 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14741 initiator: MDT0 00000100:00100000:2.0:1746140893.760287:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:599:x1830960574033408:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 257us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.760293:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10923 00000100:00100000:2.0:1746140893.764586:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.764650:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574033536 00000100:00100000:1.0:1746140893.764659:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574033536 00000100:00100000:1.0:1746140893.764713:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10924 00000100:00100000:1.0:1746140893.764724:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+269:599:x1830960574033536:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.764741:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.764759:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a2796 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.764808:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 270 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.764824:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 270 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.764837:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:1.0:1746140893.764840:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140893.764843:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66c00, rc 0) 00000100:00100000:1.0:1746140893.764892:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:599:x1830960574033536:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 172us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.764897:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10924 00000100:00100000:0.0:1746140893.766644:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.766702:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574033664 00000100:00100000:1.0:1746140893.766709:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574033664 00000100:00100000:1.0:1746140893.766755:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10925 00000100:00100000:1.0:1746140893.766767:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+270:599:x1830960574033664:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.766780:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.766798:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdbc194 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a279d expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.766868:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdbc19b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140893.767014:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdbc19b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140893.767031:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdbc19b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00200000:1.0:1746140893.767060:0:27790:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x31d:0x0]: returning size 9078272 00000004:00200000:1.0:1746140893.767065:0:27790:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746140893.767077:0:27790:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdbc19b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140893.767104:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66a00/0x8156357b7fdbc194 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a279d expref: 272 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.767121:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdbc19b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a279d expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.767200:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:1.0:1746140893.767202:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746140893.767205:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66400, rc 0) 00000100:00100000:1.0:1746140893.767377:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:599:x1830960574033664:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 615us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.767383:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10925 00000100:00100000:0.0:1746140893.769034:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.769072:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.769102:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.769129:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.769143:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.769165:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140893.769171:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574033920 00000100:00100000:3.0:1746140893.769178:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574033920 00000100:00100000:3.0:1746140893.769215:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574033792 00000100:00100000:3.0:1746140893.769217:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574033792 00000100:00100000:3.0:1746140893.769229:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574034176 00000100:00100000:3.0:1746140893.769230:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574034176 00000100:00100000:3.0:1746140893.769236:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574034048 00000100:00100000:3.0:1746140893.769237:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574034048 00000100:00100000:1.0:1746140893.769239:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574034304 00000100:00100000:1.0:1746140893.769243:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574034304 00000100:00100000:3.0:1746140893.769246:0:32376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574034432 00000100:00100000:3.0:1746140893.769247:0:32376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574034432 00000100:00100000:3.0:1746140893.769261:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17703 00000100:00100000:1.0:1746140893.769266:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17704 00000100:00100000:3.0:1746140893.769267:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+27:1984:x1830960574033920:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746140893.769271:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960574033792:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746140893.769273:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17705 00010000:00010000:3.0:1746140893.769281:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746140893.769281:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960574034176:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.769284:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746140893.769288:0:4784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140893.769296:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27ab expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.769297:0:4784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27b9 expref: -99 pid: 4784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.769297:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27a4 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746140893.769335:0:4784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a2:0x0] initial LVB size: 2097152, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x81f 00002000:00010000:1.0:1746140893.769335:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a0:0x0] initial LVB size: 1048576, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x821 00002000:00010000:3.0:1746140893.769336:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 2097152, mtime: 0x6813fedb, atime: 0x6813fedb, ctime: 0x6813fedb, blocks: 0x821 00010000:00010000:3.0:1746140893.769349:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.769349:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.769349:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.769351:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.769351:0:4784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.769351:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.769357:0:4784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.769357:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.769358:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 28 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.769369:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 28 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746140893.769369:0:4784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.769370:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.769377:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed43800, rc 0) 00010000:00010000:1.0:1746140893.769377:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec66600, rc 0) 00010000:00010000:2.0:1746140893.769380:0:4784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9ad400, rc 0) 00000100:00100000:0.0:1746140893.769431:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17706 00000100:00100000:0.0:1746140893.769444:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960574034048:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746140893.769450:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746140893.769457:0:8458:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27b2 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746140893.769468:0:8458:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 2097152, mtime: 0x6813fedd, atime: 0x6813fedc, ctime: 0x6813fedd, blocks: 0x821 00010000:00010000:0.0:1746140893.769474:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.769476:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.769483:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140893.769492:0:8458:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746140893.769498:0:8458:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a476fc00, rc 0) 00000100:00100000:1.0:1746140893.769530:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960574033792:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 258us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.769537:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17704 00000100:00100000:1.0:1746140893.769551:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17707 00000100:00100000:1.0:1746140893.769556:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960574034432:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.769561:0:9872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.769568:0:9872:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27c7 expref: -99 pid: 9872 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746140893.769577:0:9872:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 4194304, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x1029 00010000:00010000:1.0:1746140893.769584:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.769585:0:9872:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.769588:0:9872:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 30 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.769595:0:9872:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 30 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.769601:0:9872:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67800, rc 0) 00000100:00100000:2.0:1746140893.769656:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960574034176:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 376us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.769658:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960574033920:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 391us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.769662:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17705 00000100:00100000:0.0:1746140893.769663:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960574034048:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 226us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.769665:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17703 00000100:00100000:0.0:1746140893.769668:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17706 00000100:00100000:3.0:1746140893.769674:0:32376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17708 00000100:00100000:3.0:1746140893.769677:0:32376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+18:1984:x1830960574034304:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746140893.769681:0:32376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746140893.769686:0:32376:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27c0 expref: -99 pid: 32376 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746140893.769696:0:32376:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3a3:0x0] initial LVB size: 4883968, mtime: 0x6813fedd, atime: 0x6813fedd, ctime: 0x6813fedd, blocks: 0x158d 00010000:00010000:3.0:1746140893.769701:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.769702:0:32376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.769705:0:32376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 19 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.769710:0:32376:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 19 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746140893.769714:0:32376:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed42400, rc 0) 00000100:00100000:3.0:1746140893.769725:0:32376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960574034304:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 48us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.769728:0:32376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17708 00000100:00100000:1.0:1746140893.769819:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960574034432:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 262us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.769824:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17707 00000100:00100000:0.0:1746140893.776627:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.776841:0:21376:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574034688 00000100:00100000:2.0:1746140893.776850:0:21376:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574034688 00000100:00100000:2.0:1746140893.776914:0:21376:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9077 00000100:00100000:2.0:1746140893.776922:0:21376:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960574034688:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746140893.776967:0:21376:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.776982:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.776985:0:21376:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.776989:0:21376:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.777001:0:21376:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.777739:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.777775:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140893.777789:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574034944 00000100:00100000:3.0:1746140893.777794:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574034944 00000100:00100000:3.0:1746140893.777830:0:8463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574035200 00000100:00100000:3.0:1746140893.777832:0:8463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574035200 00000100:00100000:3.0:1746140893.777847:0:8463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9078 00000100:00100000:3.0:1746140893.777851:0:8463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960574034944:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140893.777867:0:8463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.777875:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.777877:0:8463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.777880:0:8463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.777892:0:8463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.778376:0:8464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9079 00000100:00100000:0.0:1746140893.778396:0:8464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1984:x1830960574035200:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140893.778431:0:8464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.778575:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.778577:0:8464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.778581:0:8464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.778591:0:8464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.778630:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.778648:0:21692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574035456 00000100:00100000:1.0:1746140893.778652:0:21692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574035456 00000100:00100000:1.0:1746140893.778677:0:21692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9080 00000100:00100000:1.0:1746140893.778682:0:21692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960574035456:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140893.778700:0:21692:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.778707:0:21692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.778709:0:21692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.778712:0:21692:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.778720:0:21692:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.779876:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.780264:0:32429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574035712 00000100:00100000:2.0:1746140893.780270:0:32429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574035712 00000100:00100000:2.0:1746140893.780324:0:32429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9081 00000100:00100000:2.0:1746140893.780331:0:32429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1984:x1830960574035712:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746140893.780353:0:32429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.780368:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.780369:0:32429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.780372:0:32429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.780382:0:32429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.781135:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.781171:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.781191:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574035968 00000100:00100000:0.0:1746140893.781197:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574035968 00000100:00100000:0.0:1746140893.781247:0:21690:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574036224 00000100:00100000:0.0:1746140893.781250:0:21690:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574036224 00000100:00100000:3.0:1746140893.781264:0:8465:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9082 00000100:00100000:3.0:1746140893.781281:0:8465:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1984:x1830960574035968:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746140893.781302:0:8465:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.781331:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.781332:0:8465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.781335:0:8465:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.781344:0:8465:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.781700:0:21690:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9083 00000100:00100000:0.0:1746140893.781708:0:21690:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960574036224:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746140893.781820:0:21690:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.781831:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.781833:0:21690:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.781838:0:21690:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.781848:0:21690:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.782036:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.782056:0:21691:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574036480 00000100:00100000:1.0:1746140893.782060:0:21691:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574036480 00000100:00100000:1.0:1746140893.782090:0:21691:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9084 00000100:00100000:1.0:1746140893.782095:0:21691:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+33:1984:x1830960574036480:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746140893.782110:0:21691:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.782118:0:21691:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.782119:0:21691:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.782123:0:21691:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.782145:0:21691:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.788771:0:21376:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.788791:0:21376:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.788801:0:21376:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.788807:0:21376:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9ada00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140893.788812:0:21376:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.788820:0:21376:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.788839:0:21376:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.788845:0:21376:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ada00/0x8156357b7fdbc1cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21376 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.788959:0:21376:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:64a7ece3-6daa-4cf2-9f70-0208ad105443+25:1984:x1830960574034688:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 12032us (12335us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140893.788969:0:21376:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9077 00010000:00010000:2.0:1746140893.794605:0:8464:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.794619:0:8464:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.794627:0:8464:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.794632:0:8464:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a476e600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140893.794635:0:8464:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.794642:0:8464:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.794659:0:8464:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.794664:0:8464:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a476e600/0x8156357b7fdbc1da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.794752:0:8464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64a7ece3-6daa-4cf2-9f70-0208ad105443+34:1984:x1830960574035200:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 16362us (16971us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140893.794764:0:8464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9079 00010000:00010000:1.0:1746140893.797498:0:21692:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.797519:0:21692:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.797527:0:21692:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.797535:0:21692:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec67c00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140893.797540:0:21692:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.797548:0:21692:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.797568:0:21692:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.797575:0:21692:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc1e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21692 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.797677:0:21692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1984:x1830960574035456:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18989us (19042us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140893.797686:0:21692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9080 00010000:00010000:3.0:1746140893.799579:0:8465:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.799597:0:8465:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.799605:0:8465:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.799612:0:8465:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed43400 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140893.799617:0:8465:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.799626:0:8465:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.799644:0:8465:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.799650:0:8465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43400/0x8156357b7fdbc1ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140893.799753:0:8465:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+32:1984:x1830960574035968:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18469us (18618us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140893.799762:0:8465:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9082 00010000:00010000:2.0:1746140893.803497:0:32429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.803517:0:32429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.803526:0:32429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.803533:0:32429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9acc00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:2.0:1746140893.803537:0:32429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.803545:0:32429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.803564:0:32429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.803570:0:32429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9acc00/0x8156357b7fdbc1e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.803671:0:32429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1984:x1830960574035712:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 23334us (23790us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746140893.803681:0:32429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9081 00010000:00010000:3.0:1746140893.806210:0:8463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.806226:0:8463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.806234:0:8463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.806241:0:8463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed42a00 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:3.0:1746140893.806245:0:8463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.806252:0:8463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.806271:0:8463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.806277:0:8463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed42a00/0x8156357b7fdbc1d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140893.806401:0:8463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1984:x1830960574034944:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 28544us (28658us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746140893.806410:0:8463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9078 00010000:00010000:1.0:1746140893.810042:0:21690:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810057:0:21690:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810069:0:21690:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810075:0:21690:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a476f600 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140893.810079:0:21690:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810086:0:21690:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810105:0:21690:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810110:0:21690:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a476f600/0x8156357b7fdbc1f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21690 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.810215:0:21690:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960574036224:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 28504us (29037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140893.810225:0:21690:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9083 00010000:00010000:1.0:1746140893.810814:0:21691:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810821:0:21691:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810825:0:21691:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810828:0:21691:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f823000 already unused, calling callback (ffffffffa086ad70) 00010000:00010000:1.0:1746140893.810830:0:21691:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810833:0:21691:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810842:0:21691:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.810845:0:21691:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f823000/0x8156357b7fdbc1fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21691 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.810915:0:21691:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1984:x1830960574036480:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 28820us (28884us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746140893.810920:0:21691:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9084 00000100:00100000:0.0:1746140893.814260:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.814350:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574036736 00000100:00100000:1.0:1746140893.814359:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574036736 00000100:00100000:1.0:1746140893.814526:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10926 00000100:00100000:1.0:1746140893.814533:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:599:x1830960574036736:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746140893.814576:0:27790:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746140893.814604:0:27790:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66400/0x8156357b7fdbc19b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a279d expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.814620:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:1.0:1746140893.814624:0:27790:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746140893.814659:0:27790:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140893.814669:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:1.0:1746140893.814677:0:27790:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000004:00010000:1.0:1746140893.814813:0:27790:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129e0e300 reply state ffff88012d0f9000 transno 8589945272 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27790 initiator: MDT0 00000100:00100000:1.0:1746140893.814820:0:27790:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746140893.814912:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:599:x1830960574036736:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 379us (660us total) trans 8589945272 rc 0/0 00000100:00100000:1.0:1746140893.814918:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10926 00010000:00010000:2.0:1746140893.816120:0:3296:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.816130:0:3296:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.816136:0:3296:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.816141:0:3296:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec67c00 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140893.816144:0:3296:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.816150:0:3296:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.816161:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:2.0:1746140893.816163:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746140893.816166:0:3296:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00010000:00010000:2.0:1746140893.816170:0:3296:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec67c00/0x8156357b7fdbc204 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27790 initiator: MDT0 00000100:00100000:0.0:1746140893.816238:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.816259:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574036864 00000100:00100000:1.0:1746140893.816264:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574036864 00000100:00100000:1.0:1746140893.816296:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17709 00000100:00100000:1.0:1746140893.816302:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:599:x1830960574036864:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.816336:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.816348:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec67400/0x8156357b7fdbc20b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27ce expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.816370:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.816377:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.816379:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.816382:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec67400/0x8156357b7fdbc20b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ce expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.816412:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.816422:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.816432:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576170624:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140893.816510:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140893.817831:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576170624:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140893.817858:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec67400/0x8156357b7fdbc20b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ce expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.817871:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec67400, rc 0) 00000100:00100000:1.0:1746140893.817912:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:599:x1830960574036864:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1609us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.817918:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17709 00000100:00100000:2.0:1746140893.818630:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.818747:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574036992 00000100:00100000:0.0:1746140893.818758:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574036992 00010000:00010000:0.0:1746140893.818803:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 972 lvb_type: 1 00000100:00100000:0.0:1746140893.818838:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9188 00000100:00100000:0.0:1746140893.818847:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960574036992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746140893.818860:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746140893.818886:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.818896:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.818915:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec66600/0x8156357b7fdbc1b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27a4 expref: 20 pid: 9872 timeout: 972 lvb_type: 1 00010000:00010000:0.0:1746140893.818947:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.818948:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746140893.818955:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec67400/0x8156357b7fdbc20b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ce expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.818961:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec67400/0x8156357b7fdbc20b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ce expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746140893.818986:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec67400/0x8156357b7fdbc20b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ce expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746140893.819000:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576170752:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746140893.819069:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129ce4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140893.820400:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576170752:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140893.820418:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140893.820444:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960574036992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1600us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.820453:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9188 00000100:00100000:0.0:1746140893.820616:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.820659:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574037120 00000100:00100000:1.0:1746140893.820664:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574037120 00000100:00100000:1.0:1746140893.820702:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17710 00000100:00100000:1.0:1746140893.820708:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:599:x1830960574037120:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.820722:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.820736:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f822e00/0x8156357b7fdbc212 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27d5 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.820756:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 29 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.820762:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.820763:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.820765:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f822e00/0x8156357b7fdbc212 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27d5 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.820781:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 29 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.820788:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 29 pid: 32376 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.820795:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576170880:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140893.820848:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140893.822301:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.822336:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576170880:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140893.822361:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f822e00/0x8156357b7fdbc212 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27d5 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.822374:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f822e00, rc 0) 00000100:00100000:2.0:1746140893.822386:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574037248 00000100:00100000:2.0:1746140893.822391:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574037248 00010000:00010000:2.0:1746140893.822410:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 30 pid: 32376 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.822418:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:599:x1830960574037120:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1709us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.822424:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17710 00000100:00100000:2.0:1746140893.822434:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9189 00000100:00100000:2.0:1746140893.822439:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960574037248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140893.822448:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140893.822467:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 29 pid: 32376 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.822477:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 29 pid: 32376 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.822493:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed43800/0x8156357b7fdbc1a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ab expref: 29 pid: 32376 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.822511:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.822513:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.822518:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f822e00/0x8156357b7fdbc212 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27d5 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.822526:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f822e00/0x8156357b7fdbc212 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27d5 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.822546:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f822e00/0x8156357b7fdbc212 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27d5 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.822555:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576171008:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140893.822762:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140893.823656:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576171008:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140893.823670:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140893.823731:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960574037248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1289us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.823739:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9189 00000100:00100000:0.0:1746140893.823977:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.824042:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574037376 00000100:00100000:1.0:1746140893.824046:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574037376 00000100:00100000:1.0:1746140893.824073:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17711 00000100:00100000:1.0:1746140893.824079:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:599:x1830960574037376:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.824092:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.824107:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f823e00/0x8156357b7fdbc219 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27dc expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.824126:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.824133:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.824134:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.824137:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f823e00/0x8156357b7fdbc219 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27dc expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.824153:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.824161:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.824169:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576171136:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140893.824209:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140893.824973:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576171136:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140893.824994:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f823e00/0x8156357b7fdbc219 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27dc expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.825005:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f823e00, rc 0) 00000100:00100000:1.0:1746140893.825027:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:599:x1830960574037376:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 948us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.825035:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17711 00000100:00100000:0.0:1746140893.825212:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.825229:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574037504 00000100:00100000:2.0:1746140893.825233:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574037504 00010000:00010000:2.0:1746140893.825251:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 972 lvb_type: 1 00000100:00100000:2.0:1746140893.825268:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9190 00000100:00100000:2.0:1746140893.825274:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960574037504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140893.825282:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140893.825320:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.825331:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.825349:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a476fc00/0x8156357b7fdbc1b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b2 expref: 29 pid: 8458 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.825359:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.825360:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.825366:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f823e00/0x8156357b7fdbc219 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27dc expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.825377:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f823e00/0x8156357b7fdbc219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27dc expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.825398:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f823e00/0x8156357b7fdbc219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27dc expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.825407:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576171264:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140893.825463:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140893.826272:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.826329:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574037632 00000100:00100000:2.0:1746140893.826345:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576171264:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140893.826356:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746140893.826364:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574037632 00000100:00100000:2.0:1746140893.826376:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960574037504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1102us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.826383:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9190 00000100:00100000:1.0:1746140893.826397:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17712 00000100:00100000:1.0:1746140893.826404:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:599:x1830960574037632:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.826415:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.826426:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f822600/0x8156357b7fdbc220 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27e3 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.826444:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.826450:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.826452:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.826454:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f822600/0x8156357b7fdbc220 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27e3 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.826473:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.826483:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.826492:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576171392:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140893.826538:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140893.827505:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.827519:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576171392:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140893.827540:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f822600/0x8156357b7fdbc220 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27e3 expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.827549:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f822600, rc 0) 00000100:00100000:2.0:1746140893.827557:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574037760 00000100:00100000:2.0:1746140893.827568:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574037760 00000100:00100000:1.0:1746140893.827577:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:599:x1830960574037632:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1174us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.827582:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17712 00010000:00010000:2.0:1746140893.827599:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 972 lvb_type: 1 00000100:00100000:2.0:1746140893.827634:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9191 00000100:00100000:2.0:1746140893.827640:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1984:x1830960574037760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140893.827651:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140893.827669:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.827683:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.827700:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9ad400/0x8156357b7fdbc1a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27b9 expref: 20 pid: 4784 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.827712:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.827713:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.827719:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f822600/0x8156357b7fdbc220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27e3 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.827726:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f822600/0x8156357b7fdbc220 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27e3 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.827752:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f822600/0x8156357b7fdbc220 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27e3 expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.827762:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576171520:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140893.827847:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140893.828506:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576171520:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140893.828517:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140893.828532:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1984:x1830960574037760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 894us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.828538:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9191 00000100:00100000:0.0:1746140893.828640:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.828766:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574037888 00000100:00100000:1.0:1746140893.828769:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574037888 00000100:00100000:1.0:1746140893.828793:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17713 00000100:00100000:1.0:1746140893.828799:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:599:x1830960574037888:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.828811:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.828822:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f822800/0x8156357b7fdbc227 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27ea expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.828877:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 20 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.828883:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.828884:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.828886:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f822800/0x8156357b7fdbc227 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ea expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.828902:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 20 pid: 32376 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.828909:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 20 pid: 32376 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.828917:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576171648:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140893.828979:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140893.829543:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20960:1830960576171648:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140893.829560:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f822800/0x8156357b7fdbc227 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ea expref: 20 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.829570:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f822800, rc 0) 00000100:00100000:1.0:1746140893.829605:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:599:x1830960574037888:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 805us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.829611:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17713 00000100:00100000:0.0:1746140893.829753:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.829778:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574038016 00000100:00100000:2.0:1746140893.829782:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574038016 00010000:00010000:2.0:1746140893.829795:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 20 pid: 32376 timeout: 972 lvb_type: 1 00000100:00100000:2.0:1746140893.829819:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9192 00000100:00100000:2.0:1746140893.829863:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+20:1985:x1830960574038016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746140893.829871:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746140893.829890:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 20 pid: 32376 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.829899:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 20 pid: 32376 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.829913:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed42400/0x8156357b7fdbc1c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c0 expref: 20 pid: 32376 timeout: 972 lvb_type: 1 00010000:00010000:2.0:1746140893.829923:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.829924:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746140893.829929:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f822800/0x8156357b7fdbc227 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ea expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.829946:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f822800/0x8156357b7fdbc227 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ea expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.829965:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f822800/0x8156357b7fdbc227 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27ea expref: 19 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746140893.829973:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576171776:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746140893.830019:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746140893.831509:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.831526:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22044:1830960576171776:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746140893.831537:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746140893.831561:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+19:1985:x1830960574038016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1737us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140893.831569:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9192 00000100:00100000:1.0:1746140893.831627:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574038144 00000100:00100000:1.0:1746140893.831631:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574038144 00000100:00100000:1.0:1746140893.831666:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17714 00000100:00100000:1.0:1746140893.831672:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:599:x1830960574038144:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.831683:0:20960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.831695:0:20960:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f822400/0x8156357b7fdbc22e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27f1 expref: -99 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.831715:0:20960:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 29 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.831725:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.831726:0:20960:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746140893.831729:0:20960:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f822400/0x8156357b7fdbc22e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27f1 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.831754:0:20960:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 29 pid: 9872 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746140893.831765:0:20960:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 29 pid: 9872 timeout: 972 lvb_type: 1 00000100:00100000:1.0:1746140893.831774:0:20960:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576171904:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746140893.831831:0:20960:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac873b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746140893.832588:0:20960:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20960:1830960576171904:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746140893.832609:0:20960:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f822400/0x8156357b7fdbc22e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27f1 expref: 29 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.832618:0:20960:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f822400, rc 0) 00000100:00100000:1.0:1746140893.832717:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:599:x1830960574038144:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1044us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.832723:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17714 00000100:00100000:0.0:1746140893.832871:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746140893.833046:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574038272 00000100:00100000:3.0:1746140893.833051:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574038272 00010000:00010000:3.0:1746140893.833071:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 29 pid: 9872 timeout: 972 lvb_type: 1 00000100:00100000:3.0:1746140893.833103:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9193 00000100:00100000:3.0:1746140893.833108:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4908c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+29:1985:x1830960574038272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140893.833116:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140893.833137:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 29 pid: 9872 timeout: 972 lvb_type: 1 00010000:00010000:3.0:1746140893.833146:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 29 pid: 9872 timeout: 972 lvb_type: 1 00010000:00010000:3.0:1746140893.833162:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec67800/0x8156357b7fdbc1be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27c7 expref: 29 pid: 9872 timeout: 972 lvb_type: 1 00010000:00010000:3.0:1746140893.833191:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.833193:0:22044:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746140893.833199:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f822400/0x8156357b7fdbc22e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27f1 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.833207:0:22044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f822400/0x8156357b7fdbc22e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27f1 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746140893.833229:0:22044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f822400/0x8156357b7fdbc22e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27f1 expref: 28 pid: 20960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746140893.833237:0:22044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f123480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576172032:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746140893.833707:0:22044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d387840 going to sleep for 11 seconds 00000100:00100000:3.0:1746140893.835465:0:22044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f123480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22044:1830960576172032:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746140893.835484:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746140893.835513:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4908c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+28:1985:x1830960574038272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2404us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.835523:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9193 00000100:00100000:0.0:1746140893.835778:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.835806:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.835825:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.835838:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.835856:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746140893.835875:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.835886:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574038400 00000100:00100000:2.0:1746140893.835893:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574038400 00000100:00100000:2.0:1746140893.835974:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574038656 00000100:00100000:2.0:1746140893.835976:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574038656 00000100:00100000:1.0:1746140893.835992:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574038912 00000100:00100000:1.0:1746140893.835996:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574038912 00000100:00100000:1.0:1746140893.836018:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574038528 00000100:00100000:1.0:1746140893.836020:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574038528 00000100:00100000:1.0:1746140893.836031:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574038784 00000100:00100000:1.0:1746140893.836032:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574038784 00000100:00100000:1.0:1746140893.836040:0:9872:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574039040 00000100:00100000:1.0:1746140893.836042:0:9872:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574039040 00000100:00100000:1.0:1746140893.836054:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17715 00000100:00100000:1.0:1746140893.836060:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960574038400:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:2.0:1746140893.836092:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17716 00000100:00100000:2.0:1746140893.836098:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960574038656:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140893.836117:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17717 00000100:00100000:0.0:1746140893.836128:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960574038912:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140893.836269:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140893.836272:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140893.836274:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140892 -> 1746140893 00002000:00010000:2.0:1746140893.836276:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140893 -> 1746140894 00002000:00010000:2.0:1746140893.836278:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140893.836279:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17718 00002000:00010000:0.0:1746140893.836281:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:0.0:1746140893.836283:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.836285:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.836287:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140893 -> 1746140894 00002000:00010000:0.0:1746140893.836290:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5517 -> 5517 00000100:00100000:2.0:1746140893.836302:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960574038656:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 204us (495us total) trans 17179874280 rc 0/0 00000100:00100000:0.0:1746140893.836326:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960574038912:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 202us (499us total) trans 21474841583 rc 0/0 00000100:00100000:2.0:1746140893.836327:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17716 00000100:00100000:0.0:1746140893.836332:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17717 00000100:00100000:2.0:1746140893.836340:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17719 00000100:00100000:2.0:1746140893.836344:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+21:1985:x1830960574038784:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746140893.836346:0:24958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17720 00000100:00100000:0.0:1746140893.836352:0:24958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960574039040:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746140893.836412:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140893.836413:0:24958:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746140893.836415:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.836415:0:24958:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140893.836416:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.836417:0:24958:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:1.0:1746140893.836418:0:9872:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746140893.836419:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140893 -> 1746140894 00002000:00010000:0.0:1746140893.836419:0:24958:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140893 -> 1746140894 00002000:00010000:2.0:1746140893.836420:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:0.0:1746140893.836421:0:24958:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00002000:00010000:1.0:1746140893.836436:0:9872:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140891 -> 1746140893 00000100:00100000:0.0:1746140893.836436:0:24958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960574039040:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 85us (560us total) trans 17179874281 rc 0/0 00000100:00100000:2.0:1746140893.836438:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+23:1985:x1830960574038784:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 94us (581us total) trans 21474841585 rc 0/0 00002000:00010000:1.0:1746140893.836438:0:9872:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140891 -> 1746140893 00002000:00010000:1.0:1746140893.836440:0:9872:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140891 -> 1746140894 00000100:00100000:0.0:1746140893.836441:0:24958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17720 00002000:00010000:1.0:1746140893.836442:0:9872:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746140893.836444:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17719 00000100:00100000:1.0:1746140893.836583:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:64a7ece3-6daa-4cf2-9f70-0208ad105443+22:1985:x1830960574038400:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 425us (708us total) trans 21474841584 rc 0/0 00000100:00100000:1.0:1746140893.836590:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17715 00000100:00100000:1.0:1746140893.836614:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+30:1985:x1830960574038528:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746140893.836702:0:20960:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746140893.836705:0:20960:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140891 -> 1746140893 00002000:00010000:1.0:1746140893.836707:0:20960:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140891 -> 1746140893 00002000:00010000:1.0:1746140893.836709:0:20960:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140891 -> 1746140894 00002000:00010000:1.0:1746140893.836710:0:20960:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140893.836746:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:64a7ece3-6daa-4cf2-9f70-0208ad105443+31:1985:x1830960574038528:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 458us (906us total) trans 17179874282 rc 0/0 00000100:00100000:1.0:1746140893.836751:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17718 00000100:00100000:0.0:1746140893.837872:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.837963:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574039296 00000100:00100000:2.0:1746140893.837970:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574039296 00000100:00100000:2.0:1746140893.838358:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4832 00000100:00100000:2.0:1746140893.838366:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae1a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:599:x1830960574039296:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:2.0:1746140893.838415:0:16842:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x31d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82400/0x8156357b7fdbc14e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a278f expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.838460:0:16842:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16842 initiator: MDT0 00010000:00010000:2.0:1746140893.838472:0:16842:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.838479:0:16842:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16842 initiator: MDT0 00010000:00010000:2.0:1746140893.838509:0:16842:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 271 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746140893.838520:0:16842:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 271 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:2.0:1746140893.838531:0:16842:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16842:1830960576172160:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746140893.839230:0:16842:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4744b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746140893.841003:0:16842:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16842:1830960576172160:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746140893.841043:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746140893.841121:0:16842:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16842 initiator: MDT0 00000100:00100000:3.0:1746140893.841203:0:22044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574039424 00000100:00100000:3.0:1746140893.841211:0:22044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574039424 00010000:00010000:3.0:1746140893.841242:0:22044:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 272 pid: 27790 timeout: 972 lvb_type: 0 00000100:00100000:3.0:1746140893.841274:0:22044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9194 00000100:00100000:3.0:1746140893.841281:0:22044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+272:1985:x1830960574039424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746140893.841295:0:22044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746140893.841300:0:22044:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 272 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.841330:0:22044:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 272 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.841350:0:22044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec66c00/0x8156357b7fdbc18d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a2796 expref: 272 pid: 27790 timeout: 972 lvb_type: 0 00010000:00010000:3.0:1746140893.841376:0:22044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:3.0:1746140893.841381:0:22044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16842 initiator: MDT0 00010000:00010000:3.0:1746140893.841388:0:22044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16842 initiator: MDT0 00010000:00010000:3.0:1746140893.841394:0:22044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16842 initiator: MDT0 00010000:00010000:3.0:1746140893.841417:0:22044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746140893.841442:0:16842:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16842 initiator: MDT0 00010000:00010000:2.0:1746140893.841449:0:16842:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16842 initiator: MDT0 00000100:00100000:3.0:1746140893.841466:0:22044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+271:1985:x1830960574039424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 185us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140893.841473:0:22044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9194 00000040:00080000:2.0:1746140893.842149:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3576, 88 off303368 00000004:00080000:2.0:1746140893.842157:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872917851379ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842203:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3588, 88 off304600 00000004:00080000:2.0:1746140893.842209:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872917903672ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140893.842232:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3589, 88 off304688 00000004:00080000:2.0:1746140893.842235:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872917930189ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140893.842242:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3577, 88 off303456 00000004:00080000:2.0:1746140893.842245:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872917939944ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842251:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3578, 88 off303544 00000004:00080000:2.0:1746140893.842253:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872917948352ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842259:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3590, 88 off304776 00000004:00080000:2.0:1746140893.842262:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872917956954ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140893.842268:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3591, 88 off304864 00000004:00080000:2.0:1746140893.842270:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872917965169ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140893.842277:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3592, 88 off304952 00000004:00080000:2.0:1746140893.842279:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872917974337ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140893.842285:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3579, 88 off303632 00000004:00080000:2.0:1746140893.842287:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872917982500ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842333:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3593, 88 off305040 00000004:00080000:2.0:1746140893.842427:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872918121677ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140893.842446:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3580, 88 off303720 00000004:00080000:2.0:1746140893.842449:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872918144194ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842580:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3594, 88 off305128 00000004:00080000:2.0:1746140893.842583:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872918278382ns, next at 809142599738ns, rc = 0 00000040:00080000:2.0:1746140893.842599:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3581, 88 off303808 00000004:00080000:2.0:1746140893.842601:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872918296575ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842608:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3582, 88 off303896 00000004:00080000:2.0:1746140893.842610:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872918305094ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842616:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3583, 88 off303984 00000004:00080000:2.0:1746140893.842619:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872918314092ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842718:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3584, 88 off304072 00000004:00080000:2.0:1746140893.842723:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872918418075ns, next at 849271537162ns, rc = 0 00000040:00080000:2.0:1746140893.842735:0:16842:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3595, 88 off305216 00000004:00080000:2.0:1746140893.842737:0:16842:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872918432130ns, next at 809142599738ns, rc = 0 00000001:00080000:0.0:1746140893.863698:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945272 is committed 00000001:00080000:0.0:1746140893.863713:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945273 is committed 00000004:00080000:0.0:1746140893.863716:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2836 committed 00000004:00080000:0.0:1746140893.863723:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2828 committed 00000100:00100000:1.0:1746140893.863877:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576172672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140893.863950:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140893.863978:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576173184:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746140893.863985:0:16842:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ae1a050 reply state ffff88008f0c6000 transno 8589945273 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16842 initiator: MDT0 00000100:00100000:1.0:1746140893.863994:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140893.864000:0:16842:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746140893.864009:0:16842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:2.0:1746140893.864011:0:16842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:1.0:1746140893.864011:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746140893.864015:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576172288:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746140893.864020:0:16842:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc82400/0x8156357b7fdbc14e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a278f expref: 268 pid: 27790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746140893.864031:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140893.864041:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576172800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140893.864045:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576172672 00000100:00100000:3.0:1746140893.864053:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576172672 00000100:00100000:1.0:1746140893.864053:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140893.864072:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576172544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140893.864092:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1746140893.864115:0:16842:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:0.0:1746140893.864124:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2827 committed 00000004:00080000:0.0:1746140893.864126:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2826 committed 00000004:00080000:0.0:1746140893.864128:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2825 committed 00000004:00080000:0.0:1746140893.864129:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2835 committed 00000004:00080000:0.0:1746140893.864131:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2824 committed 00000004:00080000:0.0:1746140893.864132:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2834 committed 00000004:00080000:0.0:1746140893.864134:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2823 committed 00000004:00080000:0.0:1746140893.864136:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2833 committed 00000004:00080000:0.0:1746140893.864137:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2832 committed 00000004:00080000:0.0:1746140893.864139:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2831 committed 00000004:00080000:0.0:1746140893.864140:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2822 committed 00000004:00080000:0.0:1746140893.864141:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2821 committed 00000004:00080000:0.0:1746140893.864143:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2830 committed 00000004:00080000:0.0:1746140893.864144:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2829 committed 00000004:00080000:0.0:1746140893.864148:0:14812:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2820 committed 00000001:00100000:0.0:1746140893.864163:0:14812:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28b972ba-4133-49d1-b679-ce80456803d9 00000001:00080000:0.0:1746140893.864168:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945269 is committed 00000001:00080000:0.0:1746140893.864171:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945267 is committed 00000020:00000080:0.0:1746140893.864177:0:14812:0:(genops.c:904:class_export_put()) final put ffff88009ef5d000/28b972ba-4133-49d1-b679-ce80456803d9 00000001:00100000:0.0:1746140893.864193:0:14812:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a9944e31-822a-4286-b0f5-4880be82b6d9 00000001:00080000:0.0:1746140893.864199:0:14812:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945268 is committed 00000020:00000080:0.0:1746140893.864201:0:14812:0:(genops.c:904:class_export_put()) final put ffff88009f04a800/a9944e31-822a-4286-b0f5-4880be82b6d9 00000100:00100000:3.0:1746140893.864206:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576173184 00000100:00100000:3.0:1746140893.864210:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576173184 00000100:00100000:0.0:1746140893.864211:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576172416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140893.864233:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576172288 00000100:00100000:0.0:1746140893.864234:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140893.864235:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae1a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:599:x1830960574039296:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 25868us (26365us total) trans 8589945273 rc 0/0 00000100:00100000:3.0:1746140893.864236:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576172288 00000100:00100000:2.0:1746140893.864245:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4832 00000100:00100000:0.0:1746140893.864249:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576172928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140893.864252:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576172800 00000100:00100000:3.0:1746140893.864255:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576172800 00000100:00100000:0.0:1746140893.864263:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140893.864275:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576172544 00000100:00100000:3.0:1746140893.864277:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576172544 00000100:00100000:3.0:1746140893.864288:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576172416 00000100:00100000:3.0:1746140893.864290:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576172416 00000100:00080000:2.0:1746140893.864297:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746140893.864299:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576172928 00000100:00100000:3.0:1746140893.864300:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576172928 00010000:00010000:2.0:1746140893.864329:0:3297:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16842 initiator: MDT0 00000100:00100000:3.0:1746140893.864334:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17721 00010000:00010000:2.0:1746140893.864336:0:3297:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16842 initiator: MDT0 00000100:00100000:3.0:1746140893.864340:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3310:x1830960576172672:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746140893.864343:0:3297:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16842 initiator: MDT0 00010000:00010000:2.0:1746140893.864348:0:3297:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e33200 already unused, calling callback (ffffffffa1368690) 00010000:00010000:2.0:1746140893.864351:0:3297:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16842 initiator: MDT0 00010000:00010000:2.0:1746140893.864357:0:3297:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16842 initiator: MDT0 00010000:00010000:2.0:1746140893.864368:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff880093871e00) 00010000:00010000:2.0:1746140893.864370:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746140893.864373:0:3297:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16842 initiator: MDT0 00010000:00010000:2.0:1746140893.864377:0:3297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e33200/0x8156357b7fdbc235 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16842 initiator: MDT0 00000020:00000080:2.0:1746140893.864404:0:18141:0:(genops.c:863:class_export_destroy()) destroying export ffff88009ef5d000/28b972ba-4133-49d1-b679-ce80456803d9 for lustre-MDT0000 00000100:00100000:1.0:1746140893.864415:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576173056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140893.864434:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1746140893.864446:0:18141:0:(genops.c:863:class_export_destroy()) destroying export ffff88009f04a800/a9944e31-822a-4286-b0f5-4880be82b6d9 for lustre-MDT0000 00000100:00100000:1.0:1746140893.864446:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576173568:0@lo:2:osp-syn-0-0.0 00000020:00000080:2.0:1746140893.864471:0:18141:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009ef5b800 for lustre-MDT0000 00000020:00000080:2.0:1746140893.864474:0:18141:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009f04f000 for lustre-MDT0000 00000100:00100000:2.0:1746140893.864485:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576173056 00000100:00100000:2.0:1746140893.864488:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576173056 00000100:00100000:0.0:1746140893.864496:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17722 00000100:00100000:2.0:1746140893.864506:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17723 00000100:00100000:2.0:1746140893.864511:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576172288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140893.864511:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576173184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140893.864560:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140893.864572:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576174080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140893.864586:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140893.864593:0:3313:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746140893.864596:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576173440:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746140893.864602:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140893.864604:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140893.864607:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140893.864608:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb ctime from disk: 1746140894 -> 1746140894 00000100:00100000:1.0:1746140893.864609:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746140893.864610:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746140893.864615:0:3313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576173952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140893.864635:0:3313:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140893.864652:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960576172288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (620us total) trans 17179874284 rc 0/0 00000100:00100000:1.0:1746140893.864653:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576173568 00000100:00100000:3.0:1746140893.864654:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960576172672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 314us (704us total) trans 17179874283 rc 0/0 00000100:00100000:0.0:1746140893.864654:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960576173184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (658us total) trans 17179874285 rc 0/0 00000100:00100000:2.0:1746140893.864658:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17723 00000100:00100000:1.0:1746140893.864658:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576173568 00000100:00100000:0.0:1746140893.864662:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17722 00000100:00100000:2.0:1746140893.864668:0:4782:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576174080 00000100:00100000:3.0:1746140893.864669:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17721 00000100:00100000:2.0:1746140893.864671:0:4782:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576174080 00000100:00100000:0.0:1746140893.864674:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576173440 00000100:00100000:0.0:1746140893.864676:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576173440 00000100:00100000:3.0:1746140893.864680:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576173952 00000100:00100000:3.0:1746140893.864682:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576173952 00000100:00100000:1.0:1746140893.864684:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17724 00000100:00100000:2.0:1746140893.864689:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17725 00000100:00100000:1.0:1746140893.864689:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3310:x1830960576172800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140893.864693:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3313:x1830960576172544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140893.864702:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17726 00000100:00100000:3.0:1746140893.864706:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17727 00000100:00100000:0.0:1746140893.864707:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3312:x1830960576172416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746140893.864711:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3312:x1830960576172928:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1746140893.864726:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746140893.864735:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17728 00000100:00100000:1.0:1746140893.864740:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3313:x1830960576173056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746140893.864780:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746140893.864783:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.864786:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.864787:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb ctime from disk: 1746140894 -> 1746140894 00002000:00010000:0.0:1746140893.864790:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a8:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746140893.864796:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746140893.864799:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140893.864801:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140893.864802:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb ctime from disk: 1746140894 -> 1746140894 00002000:00010000:2.0:1746140893.864803:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3a9:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746140893.864808:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3312:x1830960576172416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (573us total) trans 17179874286 rc 0/0 00000100:00100000:0.0:1746140893.864813:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17726 00000100:00100000:1.0:1746140893.864818:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3313:x1830960576173056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (383us total) trans 17179874288 rc 0/0 00000100:00100000:0.0:1746140893.864823:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17729 00000100:00100000:2.0:1746140893.864826:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3313:x1830960576172544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (732us total) trans 17179874287 rc 0/0 00000100:00100000:1.0:1746140893.864826:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17728 00000100:00100000:0.0:1746140893.864828:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3313:x1830960576173568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140893.864831:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17725 00000100:00100000:1.0:1746140893.864841:0:9872:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17730 00000100:00100000:2.0:1746140893.864845:0:4782:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17731 00000100:00100000:1.0:1746140893.864846:0:9872:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3313:x1830960576174080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140893.864850:0:4782:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3313:x1830960576173440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140893.864923:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb size from disk: 4883968 -> 4883968 00002000:00010000:0.0:1746140893.864926:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.864928:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.864940:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb ctime from disk: 1746140894 -> 1746140894 00002000:00010000:0.0:1746140893.864942:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a3:0x0] updating lvb blocks from disk: 5517 -> 5517 00002000:00010000:2.0:1746140893.864947:0:4782:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746140893.864949:0:4782:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140893.864951:0:4782:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:2.0:1746140893.864954:0:4782:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb ctime from disk: 1746140894 -> 1746140894 00002000:00010000:2.0:1746140893.864955:0:4782:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746140893.864963:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3313:x1830960576173568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (402us total) trans 21474841586 rc 0/0 00000100:00100000:0.0:1746140893.864968:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17729 00000100:00100000:2.0:1746140893.864976:0:4782:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3313:x1830960576173440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (364us total) trans 21474841587 rc 0/0 00000100:00100000:0.0:1746140893.864979:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17732 00000100:00100000:2.0:1746140893.864983:0:4782:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17731 00000100:00100000:0.0:1746140893.864985:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3313:x1830960576173952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140893.865027:0:9872:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3313:x1830960576174080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (439us total) trans 21474841588 rc 0/0 00000100:00100000:1.0:1746140893.865033:0:9872:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17730 00000100:00100000:1.0:1746140893.865051:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576173696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140893.865055:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3313:x1830960576173952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (419us total) trans 21474841589 rc 0/0 00000100:00100000:0.0:1746140893.865060:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17732 00000100:00100000:1.0:1746140893.865066:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140893.865071:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576173696 00000100:00100000:0.0:1746140893.865074:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576173696 00000100:00100000:1.0:1746140893.865079:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576174208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140893.865080:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3310:x1830960576172800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 390us (1025us total) trans 17179874289 rc 0/0 00000100:00100000:2.0:1746140893.865086:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17724 00000100:00100000:0.0:1746140893.865090:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17733 00000100:00100000:1.0:1746140893.865093:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140893.865095:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3310:x1830960576173696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140893.865098:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576174208 00000100:00100000:2.0:1746140893.865101:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576174208 00000004:00080000:1.0:1746140893.865118:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1eed80/2, rc 0, transno 17179874284 00000100:00100000:1.0:1746140893.865122:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576172288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140893.865124:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17734 00000100:00100000:2.0:1746140893.865128:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3310:x1830960576174208:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140893.865131:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ed880/2, rc 0, transno 17179874289 00000100:00100000:1.0:1746140893.865134:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576172800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140893.865140:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1efb80/2, rc 0, transno 17179874283 00000100:00100000:1.0:1746140893.865142:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576172672:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140893.865148:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ec000/2, rc 0, transno 17179874285 00000100:00100000:1.0:1746140893.865150:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576173184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746140893.865156:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746140893.865160:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576173312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140893.865166:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3310:x1830960576173696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (99us total) trans 21474841590 rc 0/0 00000100:00100000:1.0:1746140893.865172:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746140893.865172:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17733 00000100:00100000:0.0:1746140893.865189:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576173312 00000100:00100000:0.0:1746140893.865192:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576173312 00000100:00100000:1.0:1746140893.865193:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576173824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140893.865204:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17735 00000100:00100000:0.0:1746140893.865208:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576173312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140893.865209:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140893.865215:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576174208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (120us total) trans 21474841591 rc 0/0 00000100:00100000:2.0:1746140893.865220:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17734 00000004:00080000:1.0:1746140893.865224:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09a300/2, rc 0, transno 21474841590 00000100:00100000:2.0:1746140893.865229:0:20960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576173824 00000100:00100000:1.0:1746140893.865230:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576173696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140893.865231:0:20960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576173824 00000004:00080000:1.0:1746140893.865237:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f099f80/2, rc 0, transno 21474841591 00000100:00100000:1.0:1746140893.865240:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576174208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140893.865244:0:20960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17736 00000100:00100000:2.0:1746140893.865247:0:20960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3310:x1830960576173824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746140893.865262:0:3310:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746140893.865267:0:3310:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576174336:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746140893.865275:0:4784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746140893.865277:0:4784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb mtime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.865279:0:4784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb atime from disk: 1746140893 -> 1746140893 00002000:00010000:0.0:1746140893.865281:0:4784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb ctime from disk: 1746140894 -> 1746140894 00000100:00100000:1.0:1746140893.865282:0:3310:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746140893.865282:0:4784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3a0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746140893.865301:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960576173312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (128us total) trans 21474841592 rc 0/0 00000004:00080000:1.0:1746140893.865302:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09aa00/2, rc 0, transno 21474841587 00000100:00100000:1.0:1746140893.865319:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576173440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140893.865324:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17735 00000004:00080000:1.0:1746140893.865327:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09a680/2, rc 0, transno 21474841589 00000100:00100000:1.0:1746140893.865329:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576173952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140893.865333:0:4784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576174336 00000004:00080000:1.0:1746140893.865334:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09b480/2, rc 0, transno 21474841588 00000100:00100000:0.0:1746140893.865335:0:4784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576174336 00000100:00100000:1.0:1746140893.865336:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576174080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140893.865341:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09ad80/2, rc 0, transno 21474841586 00000100:00100000:1.0:1746140893.865344:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576173568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140893.865347:0:20960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960576173824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (136us total) trans 21474841593 rc 0/0 00000100:00100000:0.0:1746140893.865348:0:4784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17737 00000004:00080000:1.0:1746140893.865352:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ee300/2, rc 0, transno 17179874287 00000100:00100000:0.0:1746140893.865352:0:4784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960576174336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746140893.865353:0:20960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17736 00000100:00100000:1.0:1746140893.865355:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576172544:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140893.865360:0:3313:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ed500/2, rc 0, transno 17179874288 00000100:00100000:1.0:1746140893.865362:0:3313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1830960576173056:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746140893.865378:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f099c00/2, rc 0, transno 21474841592 00000100:00100000:1.0:1746140893.865380:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576173312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746140893.865388:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f09b100/2, rc 0, transno 21474841593 00000100:00100000:1.0:1746140893.865390:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f09b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576173824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746140893.865427:0:4784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3310:x1830960576174336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (144us total) trans 21474841594 rc 0/0 00000100:00100000:0.0:1746140893.865432:0:4784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17737 00000004:00080000:0.0:1746140893.865459:0:3310:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f2c2300/2, rc 0, transno 21474841594 00000100:00100000:0.0:1746140893.865461:0:3310:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1830960576174336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746140893.865476:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1edc00/2, rc 0, transno 17179874286 00000100:00100000:0.0:1746140893.865479:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576172416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746140893.865480:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3312:x1830960576172928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 768us (1215us total) trans 17179874290 rc 0/0 00000100:00100000:2.0:1746140893.865486:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17727 00000004:00080000:0.0:1746140893.865487:0:3312:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1ec380/2, rc 0, transno 17179874290 00000100:00100000:0.0:1746140893.865490:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576172928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746140893.866917:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746140893.866998:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574039552 00000100:00100000:1.0:1746140893.867003:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574039552 00000100:00100000:1.0:1746140893.867040:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10927 00000100:00100000:1.0:1746140893.867046:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+266:599:x1830960574039552:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746140893.867141:0:27790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746140893.867158:0:27790:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f822a00/0x8156357b7fdbc23c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x623b1c64e82a27f8 expref: -99 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.867209:0:27790:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f822a00/0x8156357b7fdbc23c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27f8 expref: 267 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.867221:0:27790:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f822a00/0x8156357b7fdbc23c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x623b1c64e82a27f8 expref: 267 pid: 27790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746140893.867235:0:27790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31d:0x0].0x0 (ffff88008d152400) 00010000:00010000:1.0:1746140893.867238:0:27790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746140893.867241:0:27790:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f822a00, rc 0) 00000100:00100000:1.0:1746140893.867286:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:599:x1830960574039552:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 240us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140893.867292:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10927 00000100:00100000:0.0:1746140893.870423:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746140893.870510:0:16842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960574039808 00000100:00100000:2.0:1746140893.870519:0:16842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960574039808 00000100:00100000:2.0:1746140893.870565:0:16842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4833 00000100:00100000:2.0:1746140893.870572:0:16842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+267:599:x1830960574039808:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746140893.870826:0:16842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:64a7ece3-6daa-4cf2-9f70-0208ad105443+268:599:x1830960574039808:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 254us (412us total) trans 8589945274 rc 0/0 00000100:00100000:2.0:1746140893.870833:0:16842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4833 00000100:00100000:0.0:1746140894.171877:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576174464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746140894.171952:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140894.172095:0:4466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576174464 00000100:00100000:1.0:1746140894.172105:0:4466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576174464 00000100:00100000:1.0:1746140894.172155:0:4466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1746140894.172162:0:4466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3312:x1830960576174464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746140894.172189:0:4466:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 516096000 pending 11927552 free 3849322496 avail 3847225344 00000100:00100000:1.0:1746140894.172236:0:4466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3312:x1830960576174464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140894.172247:0:4466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1746140894.172355:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576174464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746140894.220767:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746140894.220791:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55f02bfa-093a-4e1f-9a53-4ed2824b373e:3312:1830960576174592:0@lo:400:kworker.0 00000100:00100000:0.0:1746140894.220862:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140894.220984:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576174976:0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221012:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140894.221031:0:3312:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746140894.221034:0:3312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1830960576175104:0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221060:0:3312:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140894.221088:0:8459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576174976 00000100:00100000:1.0:1746140894.221095:0:8459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576174976 00000100:00100000:1.0:1746140894.221141:0:8459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1746140894.221148:0:8459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3312:x1830960576174976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221189:0:8459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3312:x1830960576174976:12345-0@lo:400:kworker.0 Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140894.221194:0:8459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1746140894.221213:0:27790:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576175104 00000100:00100000:1.0:1746140894.221216:0:27790:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576175104 00000100:00100000:1.0:1746140894.221239:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1746140894.221243:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1830960576175104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221264:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1830960576175104:12345-0@lo:400:kworker.0 Request processed in 22us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140894.221269:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1746140894.221293:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1830960576175104:0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221302:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1830960576174976:0@lo:400:kworker.0 00000100:00100000:2.0:1746140894.221432:0:14740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576174592 00000100:00100000:2.0:1746140894.221438:0:14740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576174592 00000100:00100000:2.0:1746140894.221466:0:14740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1746140894.221472:0:14740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3312:x1830960576174592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221559:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1830960576174848:0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221578:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746140894.221595:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746140894.221600:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1830960576174720:0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221748:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746140894.221767:0:14740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55f02bfa-093a-4e1f-9a53-4ed2824b373e+18:3312:x1830960576174592:12345-0@lo:400:kworker.0 Request processed in 294us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746140894.221772:0:14740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1746140894.221794:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576174848 00000100:00100000:1.0:1746140894.221797:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576174848 00000100:00100000:2.0:1746140894.221805:0:3312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:55f02bfa-093a-4e1f-9a53-4ed2824b373e:3312:1830960576174592:0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.221818:0:14741:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576174720 00000100:00080000:2.0:1746140894.221819:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746140894.221820:0:14741:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576174720 00000100:00100000:0.0:1746140894.221845:0:27790:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1746140894.221854:0:27790:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1830960576174848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746140894.221878:0:27790:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1830960576174848:12345-0@lo:400:kworker.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746140894.221882:0:27790:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1746140894.221897:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1830960576174848:0@lo:400:kworker.0 00000100:00080000:2.0:1746140894.221994:0:7120:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746140894.222003:0:14741:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1746140894.222008:0:14741:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1830960576174720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.222031:0:14741:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1830960576174720:12345-0@lo:400:kworker.0 Request processed in 24us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746140894.222036:0:14741:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1746140894.222089:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1830960576174720:0@lo:400:kworker.0 00000100:00100000:1.0:1746140894.235674:0:3311:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746140894.236071:0:3311:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576175232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746140894.236128:0:3311:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746140894.236217:0:8462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830960576175232 00000100:00100000:3.0:1746140894.236225:0:8462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830960576175232 00000100:00100000:3.0:1746140894.236271:0:8462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1746140894.236278:0:8462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3311:x1830960576175232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746140894.236299:0:8462:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 509411328 pending 10223616 free 3847225344 avail 3845128192 00000100:00100000:3.0:1746140894.236423:0:8462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3311:x1830960576175232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746140894.236429:0:8462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1746140894.236439:0:3311:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1830960576175232:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1746140894.360025:0:5577:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:3.0:1746140894.697634:0:1273:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 70274 lines, 70274 kept, 0 dropped, 0 bad.